Honestly, the javascript web scraper llm combo is overkill for simple sites. If it’s just React, Puppeteer alone works fine.
But for messy, unstructured data? The LLM is a lifesaver. Try GPT-4 or Claude for parsing—way better than regex hell.
My setup: Puppeteer + LLM API (like OpenAI). Slow? Yeah, but accuracy > speed for my use case.
Pro tip: Cache responses. No need to rescrape the same page if nothing changed.
But for messy, unstructured data? The LLM is a lifesaver. Try GPT-4 or Claude for parsing—way better than regex hell.
My setup: Puppeteer + LLM API (like OpenAI). Slow? Yeah, but accuracy > speed for my use case.
Pro tip: Cache responses. No need to rescrape the same page if nothing changed.