[b]"Should You Do Web Scraping in the Back End? Pros, Cons, and Best Practices"[/b] or [b]"Is It a Good Idea to Do

16 Replies, 1355 Views

Should you do web scraping in the back end? Sure, if you enjoy playing sysadmin on fire.

For small projects, it’s fine. But scaling? Nah.

Use serverless (AWS Lambda, Vercel) or a dedicated scraper box. And for the love of uptime, cache results so you’re not rescraping the same junk every hour.

Tools: Playwright for JS folks, Scrapy for Python nerds.

Messages In This Thread



Users browsing this thread: 2 Guest(s)