Why not both?
I use crawling (with Python’s Scrapy) to find product pages, then scrape prices with lxml. Saves so much time!
Just watch out for IP bans—rotate those proxies!
I use crawling (with Python’s Scrapy) to find product pages, then scrape prices with lxml. Saves so much time!
Just watch out for IP bans—rotate those proxies!
