Don’t forget encoding issues! Sites throw weird chars at you. `response.encoding = 'utf-8'` is your friend.
For async, `aiohttp` is slick if you’re comfy with async/await. Makes your python web crawler *zoom*.
And yeah, always assume the site will change tomorrow. Write flexible selectors!
For async, `aiohttp` is slick if you’re comfy with async/await. Makes your python web crawler *zoom*.
And yeah, always assume the site will change tomorrow. Write flexible selectors!
