What’s the best way to start crawling with Python for web scraping? or How can I improve my crawling

Scrapy isn’t overkill if you plan to scale later! It’s got built-in stuff for handling queues, retries, and even exporting data.

For JS, Playwright is my fav—way faster than Selenium. And for avoiding blocks, try adding `fake-useragent` to randomize your headers.

Pro tip: Start small. Don’t try to scrape Amazon on day one. 😅