How Reliable Are LLMs When They Operate Outside Their Database Source?

Hey everyone,

So, I’ve been messing around with LLMs lately, and I’m kinda curious—how reliable are they when they operate outside their database source? Like, do they just start making stuff up or what?

I mean, I get that they’re trained on a ton of data, but what happens when you ask something totally random or niche? Does it just wing it? Or does it give you that “I don’t know” vibe?

Also, has anyone noticed if LLMs outside database source tend to hallucinate more? Or is it just me?

Would love to hear your thoughts or experiences!

Cheers!