Getting a 403 Forbidden Error with My Python Website Crawler – How to Fix It? Alternatively: Why Is M

14 Replies, 705 Views

403 errors suck! For your website crawler python 403 forbidden issue, double-check your headers. Some sites reject missing `Accept` or `Connection` fields.

Also, try using `session()` in `requests` to persist cookies. Works sometimes.

If all else fails, yeah, proxies or even Tor (slow but works).

Messages In This Thread



Users browsing this thread: 1 Guest(s)