Scrapy + Splash is my combo for scraping meaning data. Splash renders JS, and Scrapy handles the rest.
It’s not the easiest setup, but once it’s running, it’s super reliable.
For quick and dirty stuff, I still use BeautifulSoup with requests-html. Not perfect, but gets the job done.
It’s not the easiest setup, but once it’s running, it’s super reliable.
For quick and dirty stuff, I still use BeautifulSoup with requests-html. Not perfect, but gets the job done.
