Need Help Building a Node Website Scraper – Any Tips or Best Practices?

7 Replies, 1995 Views

Hey there! For a node website scraper, I’d recommend checking out `playwright` as an alternative to Puppeteer. It’s similar but has some extra features that might make your life easier.

For rate limits, I use `bottleneck` to throttle requests. It’s super lightweight and easy to set up.

Also, if you’re scraping a lot of data, consider using `json2csv` to save your results in a more manageable format.

Messages In This Thread



Users browsing this thread: 1 Guest(s)