Has anyone tried to scrape IndieHackers for data? What tools or methods worked best?

20 Replies, 2643 Views

I wouldn’t recommend scraping IndieHackers unless you’re super careful. They’ve got some pretty aggressive bot detection, and you could get IP banned real quick.

If you’re set on doing it, maybe try using Puppeteer or Playwright. They’re headless browsers that can mimic human behavior better than traditional scraping tools. Still, it’s risky, so maybe look for an API or dataset that’s already out there?

Messages In This Thread



Users browsing this thread: 1 Guest(s)