Yo, I feel your pain! LinkedIn scraping is a nightmare if you don’t have the right setup. I’ve been using Scrapy with a bunch of residential proxies, and it’s been working okay.
The trick is to randomize your request intervals and avoid scraping during peak hours. Also, don’t forget to rotate user agents—LinkedIn blocks you super fast if they detect automation.
As for tools, check out Scrapy Cloud or Apify. They’re pretty solid for this kind of stuff.
The trick is to randomize your request intervals and avoid scraping during peak hours. Also, don’t forget to rotate user agents—LinkedIn blocks you super fast if they detect automation.
As for tools, check out Scrapy Cloud or Apify. They’re pretty solid for this kind of stuff.
