Fine-tuning an 8B language model usually calls for more GPU memory than a laptop has. Soup says it does it on a laptop GPU with 4 GB. Open source on GitHub. Worth checking: training time, and which fine-tuning method makes it fit. If you've...
Continue reading