Scrapy is awesome but has a learning curve. For quick dirty scraping, try Puppeteer (JS). Lets you handle JS-heavy sites easily.
Found this GitHub repo with useful scripts to scrape websites tutorials: [link]. Has examples for both Python and JS.
Tip: Don’t hammer sites too fast. Got my IP banned once lol.
Found this GitHub repo with useful scripts to scrape websites tutorials: [link]. Has examples for both Python and JS.
Tip: Don’t hammer sites too fast. Got my IP banned once lol.
