Where Are Scrapy Cookies Stored? A Beginner's Guide to Managing Cookies in Scrapy

18 Replies, 1773 Views

Scrapy cookies are stored in memory, so they’re gone after the spider stops. If you wanna save them, you’ll need to write some custom code.

I usually use the `cookies` middleware or save them to a file using `json`. You can also check out the `scrapy-cookies` library for persistent storage.

For debugging, I’d recommend using tools like Charles Proxy or Burp Suite.

Messages In This Thread



Users browsing this thread: 1 Guest(s)