What are the biggest challenges in LLM training right now? or How much data do you really need for ef

Wow, thanks for all the tips! Didn’t expect so many replies.

Gonna try PEFT and LoRA first—sounds like they’ll save me some $$$.

Anyone here actually used Gretel.ai for synthetic data? Wondering if it’s worth the hype.

(Also, *yes* to spot instances—forgot about those!)