Have you tried using Pushshift with the PMAW wrapper? It’s a Python library that makes Pushshift way easier to work with.
I’ve been using it for my datahoarder reddit scrapper project, and it’s been a game-changer for pulling large datasets. Doesn’t handle media, though, so you’ll need something else for that.
I’ve been using it for my datahoarder reddit scrapper project, and it’s been a game-changer for pulling large datasets. Doesn’t handle media, though, so you’ll need something else for that.