Best Tools for Scrapping Info – What Do You Recommend? or How Accurate Is Your Scrapping Info? Share

12 Replies, 1425 Views

I swear by Cheerio for Node.js scrapping. It’s like jQuery for the backend—super fast and lightweight.

For JS-heavy stuff, I’ll sometimes use Pyppeteer (Python port of Puppeteer). Works like a charm.

Pro tip: Always check a site’s `robots.txt` before scrapping info. Saved me from a few legal headaches.

---

Wow, didn’t expect so many recs! Gonna try Puppeteer and Scrapy+Splash first—seems like the best fit for my JS-heavy nightmare sites.

Quick Q: Anyone got a favorite proxy service for scrapping? Heard some are sketchy.

Also, that DDoS story has me terrified. Gonna double-check my loops now. 😂

Thanks, y’all!

Messages In This Thread



Users browsing this thread: 1 Guest(s)