Generalized LLMs like ChatGPT are. If you train a model on your own documentation then all it “knows” is what is in the docs and it can perform very well at finding relevant results. It’s just kind of a context-aware search engine at that point.
The problem again is that companies mostly aren’t doing that, they’re trying to replace humans with ChatGPT.
“Fixes companies internal documentation” is actually a huge get for AI, and would be worth some real hype, but yeah.
That’s still peanuts compared to the marketing, which is why people are getting pretty tired of the whole AI push. The actual, incremental improvements are being run over roughshod by snake oil salesmen.
Anyone who has used intranet search engines at large companies
Sharepoint search functionality comes to mind. Our team commonly refers it as write-once storage as once you throw something in there you’ll never find it again. And yes, we stole the term from somewhere.
deleted by creator
LLMs are absolute garbage for knowledge retrieval.
Generalized LLMs like ChatGPT are. If you train a model on your own documentation then all it “knows” is what is in the docs and it can perform very well at finding relevant results. It’s just kind of a context-aware search engine at that point.
The problem again is that companies mostly aren’t doing that, they’re trying to replace humans with ChatGPT.
Except that your context aware search engine would tell you when there is no result and AI will just make shit up and distort the results it did find.
They are “media transformers” and might be useful if limited to it.
Knowledge retrieval certainly not, as “they” know nothing besides how likely one data fragment is to appear near other data fragments.
deleted by creator
I’ve tested it with both python and Cisco iOS pretty thoroughly and it very convincingly gets things wrong a lot.
The problem with that is the constant hallucinations and complete lack of correctness checks.
deleted by creator
So your overall point is that AI is a better search engine. “It’s like google, but better.”
This is both likely true, and no where near fantastical enough to justify the trillion dollar hype cycle.
deleted by creator
“Fixes companies internal documentation” is actually a huge get for AI, and would be worth some real hype, but yeah.
That’s still peanuts compared to the marketing, which is why people are getting pretty tired of the whole AI push. The actual, incremental improvements are being run over roughshod by snake oil salesmen.
deleted by creator
Sharepoint search functionality comes to mind. Our team commonly refers it as write-once storage as once you throw something in there you’ll never find it again. And yes, we stole the term from somewhere.
So at best it might be useful for hinting.
deleted by creator
When I try that, I just get confidently incorrect answers.
my dad said the same about excel. it just gives him incorrect results compared to his handwritten sheet. now let’s get you to bed grandpa.