Has Anyone Tried Scrapping LinkedIn with Screaming Frog? Tips and Pitfalls?

8 Replies, 1076 Views

Scrapping linkedin screaming frog is a bit of a gamble. I tried it once and got blocked almost immediately.

What I learned is that you need to rotate IPs and user agents constantly. Also, avoid scraping during peak hours—LinkedIn’s monitoring is tighter then.

If you’re looking for alternatives, maybe try Phantombuster or even a custom Python script with BeautifulSoup.

Good luck, but don’t say I didn’t warn you!

Messages In This Thread



Users browsing this thread: 1 Guest(s)