Should You Do Web Scraping in the Back End? Pros, Cons, and Best Practices or Is It a Good Idea to Do

16 Replies, 1581 Views

Backend scraping is a double-edged sword.

Clean frontend? Yes.
Server meltdown? Also yes.

If you must, use rate limiting (like slow down, buddy) and retry logic. Or just… use an API if the site offers one? Wild concept, I know.

For tools, check out Bright Data—pricey but bulletproof. Or roll your own with headless Chrome and prayers.

Messages In This Thread



Users browsing this thread: 1 Guest(s)