Fine-tuning an 8B language model usually calls for more GPU memory than a laptop has. Soup says it does it on a laptop GPU with 4 GB. Open source on GitHub. Worth checking: training time, and which fine-tuning method makes it fit. If you've fine-tuned with Soup, what should the next person ask about?
Comments