How to scrap data from web with Golang – Any tips or best practices? or What’s the best way to scrap

18 Replies, 578 Views

Golang’s decent for scraping, but it’s not as smooth as Python. Colly’s your best bet, though.

Blocking: Use proxies (I like Smartproxy) and mimic human behavior. Some sites detect headless browsers, so watch out.

Speed: Try concurrent requests with goroutines, but keep it reasonable. Too many = instant ban.

Messages In This Thread



Users browsing this thread: 1 Guest(s)