Wow, thanks so much for all the replies! I didn’t expect so many helpful tips. So, Scrapy cookies are stored in memory by default, and I need to save them manually if I wanna reuse them later. Got it!
I tried the `json` method, and it worked like a charm. Also, thanks for recommending the `scrapy-cookies` library—I’ll definitely check that out.
One quick follow-up: if I’m using multiple spiders, can I share cookies between them? Or do I need to save and load them separately for each spider?
Thanks again, y’all are awesome!
I tried the `json` method, and it worked like a charm. Also, thanks for recommending the `scrapy-cookies` library—I’ll definitely check that out.
One quick follow-up: if I’m using multiple spiders, can I share cookies between them? Or do I need to save and load them separately for each spider?
Thanks again, y’all are awesome!