"Looking for Advice: How to Scrape Way Pages Are Setup Through a Website?"
Hey folks!
I’ve been trying to figure out how to scrape way pages are setup through a website for a lil’ project of mine. Not sure if I’m overcomplicating it or just missing the right tools.
Anyone got tips on the best way to do this? Like, do y’all use Python + BeautifulSoup, or is there a simpler scraper out there that handles it well?
Also, how do you deal with sites that have dynamic loading or weird structures? Lowkey struggling with that part lol.
Appreciate any help or even just a nudge in the right direction! Cheers.
Hey folks!
I’ve been trying to figure out how to scrape way pages are setup through a website for a lil’ project of mine. Not sure if I’m overcomplicating it or just missing the right tools.
Anyone got tips on the best way to do this? Like, do y’all use Python + BeautifulSoup, or is there a simpler scraper out there that handles it well?
Also, how do you deal with sites that have dynamic loading or weird structures? Lowkey struggling with that part lol.
Appreciate any help or even just a nudge in the right direction! Cheers.
