Yo, scrapegraphai JavaScript is tricky but doable! For dynamic content, I’d recommend using Cheerio with Puppeteer. Cheerio is lightweight and great for parsing, while Puppeteer handles the dynamic part.
Also, check out the `waitForSelector` function in Puppeteer—it’s a lifesaver for waiting until the content loads.
As for rate limits, I use a combo of rotating proxies and throttling requests. Free proxies are hit or miss, so I’d suggest investing in a reliable proxy service if your project is big.
Good luck, and feel free to DM if you need more help!
Also, check out the `waitForSelector` function in Puppeteer—it’s a lifesaver for waiting until the content loads.
As for rate limits, I use a combo of rotating proxies and throttling requests. Free proxies are hit or miss, so I’d suggest investing in a reliable proxy service if your project is big.
Good luck, and feel free to DM if you need more help!