How to use Python to get URL and ignore 404 errors?

18 Replies, 1406 Views

If you’re into scraping, you might wanna look into `Scrapy`. It’s a full framework and handles 404s out of the box. You don’t even need to write extra code for python get url ignore 404.

Just set up a spider and it’ll skip broken links automatically. Plus, it’s super fast for large projects.

Messages In This Thread



Users browsing this thread: 1 Guest(s)