Hey everyone!
So, I’ve been trying to scrape LinkedIn data for a project, and man, it’s been a rollercoaster. 😅 Anyone else struggling with this in 2023?
What tools are y’all using to scrape LinkedIn these days? I’ve heard mixed reviews about some of the popular ones like Octoparse and Scrapy, but idk if they’re still reliable with all the updates LinkedIn keeps throwing at us.
Also, is it even *legal* to scrape LinkedIn anymore? I’ve seen so many conflicting opinions online, and I don’t wanna get into any trouble.
Lastly, any tips on avoiding getting blocked while trying to scrape LinkedIn? I’ve been IP banned twice already, and it’s driving me nuts.
Would love to hear your thoughts and experiences! Cheers! 🍻
Hey! Scraping LinkedIn is such a pain these days, right? I’ve been using PhantomBuster for a while now, and it’s been pretty solid. It’s not perfect, but it handles most of the LinkedIn updates better than others I’ve tried.
As for legality, it’s a gray area tbh. LinkedIn’s terms say no, but if you’re not scraping sensitive data or spamming, you’re probably fine. Just don’t overdo it.
To avoid blocks, rotate your IPs and use proxies. I’ve had good luck with Bright Data’s proxies—they’re pricey but worth it if you’re serious about scraping LinkedIn.
Good luck!
Yo! I feel your pain. LinkedIn scraping is a nightmare in 2023. I’ve been using Scrapy with custom middleware to mimic human behavior, and it’s worked okay. But yeah, you gotta be careful with the rate limits.
For avoiding blocks, try using residential proxies. I’ve heard good things about Oxylabs, though I haven’t tried them myself.
And legality? Honestly, it’s risky. LinkedIn’s been cracking down hard, so tread carefully. Maybe look into their API if your project allows it.
Hey there! I’ve been scraping LinkedIn for a while, and it’s definitely gotten tougher. I use a combo of Octoparse and custom scripts. Octoparse is decent, but you need to tweak it a lot to avoid detection.
For proxies, I recommend Smartproxy. They’re affordable and work well for LinkedIn scraping.
As for legality, it’s a bit of a minefield. If you’re scraping public data for personal use, you’re probably okay. But if it’s for commercial purposes, you might wanna consult a lawyer.
Scraping LinkedIn is such a headache now! I’ve been using Apify, and it’s been a lifesaver. It’s not free, but it handles a lot of the heavy lifting for you.
To avoid blocks, I use rotating user agents and slow down my requests. It’s tedious, but it works.
Legality-wise, it’s a gray area. Just make sure you’re not violating LinkedIn’s terms too blatantly.
Hey! I’ve been scraping LinkedIn for a research project, and it’s been a wild ride. I use ParseHub, and it’s been pretty reliable. It’s not the fastest, but it gets the job done.
For avoiding blocks, I’ve found that using a VPN helps. I use NordVPN, and it’s been solid so far.
As for legality, it’s tricky. If you’re scraping public profiles and not selling the data, you’re probably okay. But don’t quote me on that!
Scraping LinkedIn is a total pain these days. I’ve been using Zenscrape, and it’s been a game-changer. It’s not perfect, but it’s way better than trying to build your own scraper.
To avoid blocks, I use a mix of proxies and random delays between requests. It’s slow, but it works.
Legality is a big question mark. If you’re scraping for personal use, you’re probably fine. But if it’s for business, you might wanna rethink your approach.
Wow, thanks for all the responses, everyone! This is super helpful. I think I’m gonna give PhantomBuster and Smartproxy a try based on your suggestions.
Quick follow-up: has anyone tried LinkedIn’s API? I’ve heard it’s restrictive, but maybe it’s worth looking into if scraping LinkedIn is this much of a headache.
Also, for those using proxies, do you recommend rotating them manually or using a service that does it automatically?
Thanks again, y’all! This thread has been a lifesaver. 🍻
Hey! I’ve been scraping LinkedIn for a while, and it’s definitely gotten harder. I use a tool called Scrapy Cloud, and it’s been pretty reliable.
For avoiding blocks, I use a combination of proxies and rotating user agents. It’s a bit of a hassle, but it’s worth it.
As for legality, it’s a gray area. Just make sure you’re not scraping sensitive data or violating LinkedIn’s terms too blatantly.
Yo! Scraping LinkedIn is such a pain now. I’ve been using a tool called DataMiner, and it’s been pretty solid. It’s not perfect, but it gets the job done.
To avoid blocks, I use a mix of proxies and random delays between requests. It’s slow, but it works.
Legality is a big question mark. If you’re scraping for personal use, you’re probably fine. But if it’s for business, you might wanna rethink your approach.
|
