Hey! I’ve built a few node js website scrapers, and here’s my take:
- Puppeteer if you need to click buttons or wait for AJAX.
- Cheerio if it’s just HTML parsing.
For blocking, use rotating proxies (like Bright Data or ScraperAPI) and randomize your headers. Some sites also track mouse movements, so Puppeteer’s stealth mode helps.
Btw, avoid scraping too fast—easy way to get banned lol.
- Puppeteer if you need to click buttons or wait for AJAX.
- Cheerio if it’s just HTML parsing.
For blocking, use rotating proxies (like Bright Data or ScraperAPI) and randomize your headers. Some sites also track mouse movements, so Puppeteer’s stealth mode helps.
Btw, avoid scraping too fast—easy way to get banned lol.
