Depends on your pain tolerance.
Should you do web scraping in the back end? Maybe, but expect fires.
Better idea: Use a queue (Redis, RabbitMQ) to decouple scraping from your main app. Or go full cowboy and scrape client-side (if the site allows it).
Tools? Selenium for stubborn sites, Cheerio for quick HTML parsing. And always, always monitor your scrapers. They *will* break.
Should you do web scraping in the back end? Maybe, but expect fires.
Better idea: Use a queue (Redis, RabbitMQ) to decouple scraping from your main app. Or go full cowboy and scrape client-side (if the site allows it).
Tools? Selenium for stubborn sites, Cheerio for quick HTML parsing. And always, always monitor your scrapers. They *will* break.