Hey! I’ve actually tried to scrape IndieHackers before, and it’s not as straightforward as it seems. I used BeautifulSoup and Requests in Python, but you gotta be careful with the rate limits. IndieHackers has some protections in place, so if you go too fast, you’ll get blocked.
I’d recommend starting slow and maybe using a proxy service like BrightData to avoid getting banned. Also, check their TOS—scraping might not be explicitly allowed, so tread lightly.
Good luck!
I’d recommend starting slow and maybe using a proxy service like BrightData to avoid getting banned. Also, check their TOS—scraping might not be explicitly allowed, so tread lightly.
Good luck!
