Wow, thanks for all the replies, y’all! Super helpful to hear your experiences with cloutgist scrapy. Sounds like it’s not the best fit for what I’m trying to do, especially since I’m dealing with a pretty large dataset.
I think I’ll give Scrapy + Splash a shot since a few of you mentioned it. Also, Octoparse and Playwright sound interesting—might check those out too.
If anyone’s got a quick setup guide or tips for Scrapy + Splash, I’d love to hear ‘em. Thanks again!
I think I’ll give Scrapy + Splash a shot since a few of you mentioned it. Also, Octoparse and Playwright sound interesting—might check those out too.
If anyone’s got a quick setup guide or tips for Scrapy + Splash, I’d love to hear ‘em. Thanks again!