How to scrap data from web with Golang – Any tips or best practices? or What’s the best way to scrap

18 Replies, 784 Views

Python fan here, but Golang’s not bad for scraping! Colly’s good, but if you need something lighter, check out goquery.

Blocking? Yeah, proxies + delays. But also, don’t ignore cookies. Some sites track sessions.

Efficiency: Profile your code. Maybe it’s not the scraping—could be your DOM parsing slowing things down.

Messages In This Thread



Users browsing this thread: 2 Guest(s)