I wouldn’t recommend scraping IndieHackers unless you’re super careful. They’ve got some pretty aggressive bot detection, and you could get IP banned real quick.
If you’re set on doing it, maybe try using Puppeteer or Playwright. They’re headless browsers that can mimic human behavior better than traditional scraping tools. Still, it’s risky, so maybe look for an API or dataset that’s already out there?
If you’re set on doing it, maybe try using Puppeteer or Playwright. They’re headless browsers that can mimic human behavior better than traditional scraping tools. Still, it’s risky, so maybe look for an API or dataset that’s already out there?
