Hey, just wanted to chime in! If you’re into python web scrape an article, you should totally try out Requests-HTML. It’s like BeautifulSoup but with built-in JS support.
Also, for larger projects, Scrapy is def the way to go. It’s a bit of a learning curve, but once you get it, it’s so worth it.
Oh, and don’t forget to use proxies if you’re scraping a lot. I got blocked once, and it was a nightmare.
Also, for larger projects, Scrapy is def the way to go. It’s a bit of a learning curve, but once you get it, it’s so worth it.
Oh, and don’t forget to use proxies if you’re scraping a lot. I got blocked once, and it was a nightmare.