"Has anyone had success with training an LLM using books? Tips welcome!"
Hey folks,
So I’ve been digging into training an LLM using books—classic novels, textbooks, you name it. Seems like a goldmine for high-quality text, but I’m kinda stuck on the best way to prep the data.
Anyone here actually pulled this off? How’d you handle formatting issues (like footnotes or weird OCR errors)? And is it worth the effort compared to just scraping the web?
Also, did you chunk the text by chapters or just throw it all in raw? Low-key worried about overfitting if the model gets too cozy with one author’s style lol.
Would love to hear your war stories or any gotchas!
Sooo my device’s been acting up with this weird unblocked static noise—like a fuzzy radio vibe but worse. It’s driving me nuts! Happens randomly, especially during calls or when I’m gaming.
Tried restarting, checking connections, even blew into the ports (old-school fix, lol). Nothin’ works.
Is it just me or are others dealing with unblocked static too? Maybe it’s a recent update or something?
If you’ve got fixes, hmu! Or just vent here if you’re equally annoyed.
Thanks! ✌️
---
*Word count: ~80*
*Casual, relatable, and slightly messy—just like a real forum post!*
I’m kinda stuck here and could use some advice. I’m trying to figure out the best way of using proxy with scrapy for a project I’m working on. I’ve got the basics down, but I keep running into issues like getting blocked or the proxies just not working properly.
Anyone got tips on the best practices for using proxy with scrapy? Like, how do you handle rotating proxies or avoid getting banned? Also, what are some common pitfalls I should watch out for?
I’ve tried a few things, but it’s hit or miss, and I’m not sure if I’m doing it right. Any help or pointers would be awesome!
So, I’ve been diving into web scraping amazon lately, and honestly, it’s a bit of a minefield. Like, how do you even do it effectively without getting blocked or crossing ethical lines?
I’ve read that respecting robots.txt is a must, but also, using proper headers and rotating IPs can help avoid detection. Anyone got tips on how to scrape without being a jerk about it?
Also, what tools are y’all using? I’ve tried a few, but some are hit or miss. And yeah, I know Amazon’s TOS is pretty strict, so I’m trying to stay on the right side of things.
Would love to hear your thoughts or any best practices you’ve picked up. Cheers!
P.S. If this has been discussed before, my bad—feel free to point me to the thread!
"Best practices for an externally managed environment Ubuntu setup?"
Hey folks!
So I’ve been tinkering with an externally managed environment Ubuntu setup for a small biz project, and I’m kinda lost on the best practices. Like, how do y’all handle security, updates, and all that jazz when it’s *externally* managed? (oops, typo lol).
Do you just rely on Ubuntu Pro? Or are there better tools for this? Also, how often do you check for updates? I don’t wanna mess this up and leave gaps.
And hey, is an externally managed environment Ubuntu even *worth* it for bigger setups? Or is it more hassle than it’s worth?
Drop your tips, tricks, or horror stories below! Cheers 🍻
(Also, sorry if this has been asked a million times—I’m new to this whole thing!)
"Can I Purchase a Static IP Address? Best Providers and Costs?"
Hey folks! So, I’ve been wondering—can i purchase a static ip address for my home setup? Tired of my dynamic IP messing with my server and remote access.
Any recommendations for providers that won’t break the bank? Heard some ISPs offer it, but their pricing is all over the place.
Also, what’s the avg cost? Seen stuff like $5/month to $50, which seems wild.
If you’ve got one, was it worth it? Or am I better off sticking with dynamic + DDNS?
Thanks in advance! 🙏
(PS: If you’ve got a fav provider, drop the name—no shady stuff pls lol)
So, I’m on the hunt for a *paid http proxy spain* that’s actually reliable. Been burned a couple times already with sketchy providers, so I’m hoping someone here has some solid recs?
Looking for something stable, decent speeds, and obv Spain-based IPs. Not tryna break the bank tho, ya feel me?
If you’ve got experience with a good paid http proxy spain, drop a comment or DM me. Would really appreciate it!
"Confused About Web Scraping vs Web Crawling? Let’s Break It Down!"
Hey everyone!
So, I’ve been seeing a lot of talk about web scraping vs web crawling lately, and tbh, I was kinda confused at first. Aren’t they the same thing? Turns out, nope!
Web crawling is like a spider (think Googlebot) just *exploring* the web, indexing pages without really grabbing specific data.
Web scraping, on the other hand, is more targeted—it *extracts* specific info from sites, like prices or reviews.
So, if you need data *from* pages, scraping’s your friend. If you’re mapping the web, crawling’s the way.
Anyone else mix these up at first? Or got tips on which to use when?
(Also, yes, I totally typed 'crawling' wrong in the title at first. Oops!)