Best Tools and Methods to Automate Yahoo Screen Scrape? Need Advice!

14 Replies, 2046 Views

Yo, I’ve been in the same boat with automate Yahoo screen scrape. Honestly, Yahoo’s a pain with their anti-scraping measures.

I’d suggest using Scrapy with some middleware for handling blocks. It’s a bit more advanced, but it’s super powerful for scraping at scale.

Also, check out `requests-html` if you want something simpler than Selenium but still need to handle dynamic content. It’s like a mix of BeautifulSoup and Selenium.

Messages In This Thread



Users browsing this thread: 1 Guest(s)