Has anyone tried to scrape IndieHackers for data? What tools or methods worked best?

---
Hey y’all,

So, I’ve been thinking about trying to scrape IndieHackers for some data (don’t @ me, I’m just curious lol). Has anyone else tried to scrape IndieHackers before? Like, what tools did you use?

I’ve heard mixed things about BeautifulSoup and Scrapy, but idk if they’re overkill or not. Also, does IndieHackers even allow scraping? I don’t wanna get banned or anything.

If you’ve managed to scrape IndieHackers successfully, pls share your secrets. Or if it’s a bad idea, tell me why before I waste my weekend on this.

Thx in advance!

---