Great thread! The legality of scraping really depends on how you do it. I’ve used Scrapy for years, and the key is to respect robots.txt and avoid aggressive crawling.
Also, check out Bright Data—they have a legal proxy network that keeps things above board.
Anyone know if scraping public LinkedIn profiles is still a gray area? Heard mixed things.
Also, check out Bright Data—they have a legal proxy network that keeps things above board.
Anyone know if scraping public LinkedIn profiles is still a gray area? Heard mixed things.
