Published on: Sept. 18, 2023, 5:08 p.m.
If I were to bet on one application with LLMs (Large Language Models), it's this: in a short time, maybe months or years, every organization, big or small, will have its own custom LLM for their private data. I've spoken with many companies, both big ones and small ones, and also public organizations. Every single one has plans to build their own LLM based on their data.
So, why is this happening? One big reason: PRIVACY.
Around the world, so many organizations, whether public or private, see privacy as their main concern. A lot of the data they have, like medical or personal information, can't leave their data centers. They're worried about data leaks and breaches of privacy. This is why I think we'll soon see a lot of custom LLMs made for private data.
Right now, aside from well-known LLMs like GPT4 and Bard, the open-source scene is buzzing. There are lots of models out there, like the Llama meta models that come in different sizes. And it's not just these. There are loads of open-source LLM models to pick from. In a lot of situations, if you don't need the power of models like GPT4, an open-source model will do the job.
But why the focus on LLMs for private data? There's a big worry: Hallucinations.
LLMs are doing big things in the AI world, but hallucinations are a problem. That's when the model makes up an answer, which can be wrong or misleading. It's a real issue. Using LLMs for private data can fix this. Every answer the LLM gives has a source or citation. So, if you trust where the information comes from, you can trust the answer. And because you're the one adding all your data to the LLM, you can make sure it's all good before it goes in.
With all this in mind, a few months back, I made a demo using LLMs for private data. I added my 13 reports from JRC, and now you can ask questions and get answers from those reports. Here's the link to see it in action and to check out the open-source code.
What's next for the future? I think every organization will use this. Picture it: having your own Google for your company. You ask a question, and you get an answer with a source. Imagine that for all your stuff – emails, notes, reports. Now think bigger, like a whole company or organization using it. I'm sure it's going to happen.One last thing to mention: LLMs are improving super fast. So, it won't be long before they're on your phone, computer, and in big company systems.
If this all sounds as exciting to you as it does to me, and you're looking for someone who knows the ins and outs of it, reach out. I'm here to help. Contact me on LinkedIn., or send me an email at blagoj @ bitt.solutions