I’ve been using Nightmare.js for screen scraping with Node.js—lighter than Puppeteer but still handles JS. Not as maintained tho, so YMMV.
For blocking, headers are key. Use ‘user-agent-randomizer’ to switch things up.
And always, ALWAYS respect rate limits. Got my IP banned once and learned the hard way.
For blocking, headers are key. Use ‘user-agent-randomizer’ to switch things up.
And always, ALWAYS respect rate limits. Got my IP banned once and learned the hard way.
