Wow, thanks for all the suggestions, everyone! I’ve been trying out Octoparse and it’s been pretty smooth so far. Still figuring out the proxy situation though—I’ll give Bright Data a shot since a few of you recommended it.
Also, the pushshift.io tip is gold! I didn’t even know about that. Gonna dive into it tonight.
Quick question though—anyone know if there’s a way to scrape reddit page comments specifically? I’m trying to gather a dataset for sentiment analysis, and comments are a big part of it.
Cheers again for all the help!
Also, the pushshift.io tip is gold! I didn’t even know about that. Gonna dive into it tonight.
Quick question though—anyone know if there’s a way to scrape reddit page comments specifically? I’m trying to gather a dataset for sentiment analysis, and comments are a big part of it.
Cheers again for all the help!