Honestly, should you do web scraping in the back end? Only if you hate sleep.
Jokes aside, it’s doable but risky. One misconfigured loop and your server’s toast.
Tools like Apify or ScrapingBee handle this better—outsource the headache. Or if you’re stubborn, at least use async (Python’s asyncio, Node.js) to keep things light.
Rate limits? Yeah, good luck. Rotate IPs or beg the site for an API key.
Jokes aside, it’s doable but risky. One misconfigured loop and your server’s toast.
Tools like Apify or ScrapingBee handle this better—outsource the headache. Or if you’re stubborn, at least use async (Python’s asyncio, Node.js) to keep things light.
Rate limits? Yeah, good luck. Rotate IPs or beg the site for an API key.
