Latest Threads


Looking for a solid Python web scraping article (GitHub) – any recommendations? or What’s the best Py


Web Scraping    18 Replies

InvisibleLegend77, 10-06-2024, 08:52 PM

Hey folks!

Anyone got a solid Python web scraping article (GitHub) they can recommend? Been digging around but most stuff is either outdated or way too basic.

Looking for something with clean code examples, maybe some BS4 or Scrapy stuff. Bonus if it covers handling JS-heavy sites!

Found a few repos but not sure which ones are worth the time.

Thanks in advance!

---

*Or alternatively:*

---

Yo!

What’s the best Python web scraping article (GitHub) you’ve stumbled on lately? Need something practical, not just theory.

Preferably with actual code snippets and maybe some real-world use cases.

Drop links if you got ‘em! Cheers.

---

*Or even shorter:*

---

Hey, has anyone seen a good Python web scraping article (GitHub) recently?

Trying to up my scraping game and could use some fresh resources.

Thanks!


  Open Thread

What Are the Latest Zillow API Rules and Regulations Developers Should Know? or How Strict Are Zillow


API and Development    22 Replies

stealthFly99, 10-06-2024, 08:47 PM

"Can someone clarify the Zillow API rules and regulations for commercial use?"

Hey all,

I’m working on a project that’ll use Zillow data, but I’m kinda confused about their zillow api rules and regulations for commercial stuff.

Like, can I display listings on a client’s website if I credit Zillow? Or is that a no-go? Their docs are a bit dense, ngl.

Also, anyone know if there’s a limit on how much data you can pull? Don’t wanna get banned lol.

If you’ve dealt with this before, pls share your experience! Or point me to a clearer breakdown of the zillow api rules and regulations.

Thanks in advance!


  Open Thread

Need help converting JSON to CSV in Python? Best methods for 'python json to csv'?


API and Development    16 Replies

ProxyMimic77, 10-06-2024, 08:30 PM

Hey everyone!

So, I’ve been stuck trying to figure out the best way to do *python json to csv* conversion. Like, I know there are a ton of methods out there, but which one actually works without making me pull my hair out?

I tried using pandas (obvi), and it’s pretty straightforward with `pd.read_json()` and `to_csv()`, but sometimes the nested JSON just doesn’t play nice. Anyone else run into that?

Also, heard about the `csv` module + `json` module combo. Is that worth the hassle or nah?

What’s your go-to method for *python json to csv*? Drop your tips below, pls!

P.S. If you’ve got a snippet that just works™, you’re my hero. 🙏


  Open Thread

How to Handle jpython json.dumps Annotation Data Type Correctly? or What’s the Best Way to Annotate D


API and Development    18 Replies

secureVoy77, 10-06-2024, 07:19 PM

"Struggling with jpython json.dumps annotation data type – any tips?"

Hey folks!

So I’ve been messing around with jpython json.dumps and keep hitting snags with the annotation data type stuff. Like, it *kinda* works but sometimes throws weird errors or misformats things.

Anyone else run into this?

Specifically, how do you handle custom types or nested data without it freaking out? I’ve tried a few hacks, but feels like I’m missing something obvious.

Also, does jpython json.dumps annotation data type even support custom classes, or do I gotta serialize everything manually?

Appreciate any pointers—thanks in advance!

(PS: sorry for typos, typing this on my phone lol)


  Open Thread

Best Way to Check Proxy? Looking for Reliable Methods or How Do You Check Proxy Speed and Anonymity E


Others    20 Replies

HideProxyFast, 10-06-2024, 06:38 PM

"Best Way to Check Proxy? Looking for Reliable Methods"

Hey guys, so I’ve been using proxies for a while, but I’m never 100% sure if they’re actually working like they should.

What’s your go-to method to check proxy speed and anonymity? I’ve tried a few online tools, but some seem sketchy or give inconsistent results.

Also, how do you *really* check proxy settings to make sure there’s no IP leak? I’ve heard horror stories of people thinking they’re anonymous when they’re not lol.

Any favorite tools or tricks? Free options preferred, but I’m open to paid if they’re worth it.

Thanks in advance!


  Open Thread

Looking for Reliable Proxy Great Britain Services – Any Recommendations?


Dedicated Proxies - Datacenter Proxies    18 Replies

vpnVoyX, 10-06-2024, 04:36 PM

Hey folks,

So, I’ve been on the hunt for a solid proxy Great Britain service lately, and honestly, it’s been a bit of a headache. Everyone claims to be the best, but half of them are either slow, unreliable, or just straight-up sketchy.

I need something that actually works for UK-based stuff, y’know? Like, I’m talking about streaming, browsing, and maybe a bit of sneaky shopping without getting blocked.

Anyone got any legit recommendations for a proxy Great Britain service that doesn’t suck? Preferably one that doesn’t cost an arm and a leg either.

Also, if you’ve had a bad experience with one, feel free to warn me so I can avoid it. Cheers in advance!

P.S. No shady stuff, pls. Just looking for something reliable and easy to use.


  Open Thread

Need Help with Shadowrocket Server Setup – Any Tips or Step-by-Step Guides?


Mobile Setup (iOS/Android)    25 Replies

maskedXchange77, 10-06-2024, 04:20 PM

Hey everyone,

So, I’ve been trying to figure out this shadowrocket server setup thing for a while now, but I’m kinda stuck. 😅 I’ve got the app installed, but when it comes to configuring the server, I’m totally lost.

Does anyone have a step-by-step guide or some tips to make this easier? I’ve seen a few tutorials online, but they’re either outdated or way too technical for me.

Also, if you’ve got any recommendations for reliable servers or settings that work best, that’d be awesome. I’m not looking for anything super fancy, just something stable and easy to use.

Thanks in advance! 🙏

P.S. If you’ve got any shortcuts or hacks for shadowrocket server setup, feel free to share. I’m all ears!


  Open Thread

Looking for a Reliable Instagram Scraper – Any Recommendations or Tips?


Web Scraping    14 Replies

HyperStealth77, 10-06-2024, 03:26 PM

Hey guys!

So, I’ve been on the hunt for a solid Instagram scraper lately, but man, it’s been a struggle. There’s so many options out there, and I’m not sure which ones are actually reliable.

Anyone got any recommendations? Like, something that doesn’t break after 2 uses or get me blocked lol.

Also, if you’ve got any tips on using an Instagram scraper without getting flagged, that’d be awesome. I’m kinda new to this whole thing, so any advice is appreciated!

Thanks in advance, y’all! 🙌


  Open Thread

What's the Best Way to Handle HTML Parsing in Modern Web Projects? or Struggling with HTML Parsing? A


API and Development    22 Replies

stealthDrift77, 10-06-2024, 02:48 PM

"Struggling with HTML parsing? Any tips for clean and efficient code?"

Yo, so I’ve been wrestling with html parsing lately, and man, it’s a pain sometimes. Like, you got these messy DOM trees, inconsistent markup, and suddenly your elegant code turns into spaghetti.

What’s your go-to for html parsing these days? Cheerio? BeautifulSoup? Or just raw regex (please say no lol)?

I’m all for readability, but some libs make it feel like overkill. And don’t even get me started on dynamic content—headless browsers? Puppeteer? Ugh.

Any hot takes or secret hacks to keep html parsing sane? Share your wisdom (or misery)!

P.S. If you say "just use jQuery in 2024," I *will* judge you. 😆


  Open Thread

Are You Making These Mistakes on Messenger Very Easy to Make? Let’s Talk!


Troubleshooting    9 Replies

cloakByteX77, 10-06-2024, 02:38 PM

Hey everyone!

So, I was scrolling through my Messenger chats earlier and realized I’ve been making some *mistakes on messenger very easy to make* without even noticing. Like, sending a message to the wrong person (yikes!) or typing wayyy too fast and ending up with a bunch of typos.

Anyone else guilty of this? Or maybe accidentally hitting “like” on an old message and making it awkward? lol

Let’s share our experiences and maybe help each other avoid these *mistakes on messenger very easy to make*. I feel like we all do it, but no one talks about it.

What’s your biggest Messenger fail? Spill the tea! ☕


  Open Thread