imo, the big diff between web crawling vs scraping is scope.
Crawling = broad, scraping = precise.
Need data from a single page? Scrape it with Puppeteer or Selenium.
Wanna index a whole domain? Use a crawler like Scrapy (which can do both, btw).
Legal issues? Depends on how you use the data. Don’t overload servers, and avoid personal data unless you’re allowed.
Crawling = broad, scraping = precise.
Need data from a single page? Scrape it with Puppeteer or Selenium.
Wanna index a whole domain? Use a crawler like Scrapy (which can do both, btw).
Legal issues? Depends on how you use the data. Don’t overload servers, and avoid personal data unless you’re allowed.
