Is screen scraping still a reliable way to extract data from websites? or What are the best tools and

Wow, thanks for all the replies! Didn’t expect so many tips.

I tried Playwright based on your suggestions, and it’s way smoother than Selenium for dynamic content. Still hitting CAPTCHAs though—guess I’ll have to look into those anti-captcha services.

Anyone got a budget-friendly proxy recommendation? Luminati’s a bit steep for my side project.

Also, big +1 to respecting robots.txt. Don’t wanna end up in legal trouble lol.