What's the best way to automate tasks with Headless Chrome? or Headless Chrome for web scraping—any t

20 Replies, 1264 Views

Headless chrome is awesome, but yeah, the quirks are real. One thing nobody talks about: some sites sniff headless mode with JS tricks.

You can bypass it by overriding `navigator.webdriver` in Puppeteer:
```javascript
await page.evaluateOnNewDocument(() => {
delete navigator.__proto__.webdriver;
});
```

Also, check out ScraperAPI—it handles proxies and CAPTCHAs for you.

Messages In This Thread



Users browsing this thread: 1 Guest(s)