What are the biggest challenges in LLM training right now? or How much data do you really need for ef

Totally feel you on the data quality struggle! One thing that’s helped me is using tools like Dedupe or OpenRefine to clean datasets before llm training.

Also, have you tried synthetic data generation? Tools like Gretel.ai can help fill gaps when real data is messy or scarce.

Compute costs are brutal tho. Cloud credits (like from GCP or AWS startups programs) can ease the pain a bit.