Has anyone tried to scrape IndieHackers for data? What tools or methods worked best?

20 Replies, 2651 Views

Hey! I’ve actually tried to scrape IndieHackers before, and it’s not as straightforward as it seems. I used BeautifulSoup and Requests in Python, but you gotta be careful with the rate limits. IndieHackers has some protections in place, so if you go too fast, you’ll get blocked.

I’d recommend starting slow and maybe using a proxy service like BrightData to avoid getting banned. Also, check their TOS—scraping might not be explicitly allowed, so tread lightly.

Good luck!

Messages In This Thread



Users browsing this thread: 1 Guest(s)