Adding a LLM AI bot to your community to answer (product) questions
Many first timers (especially in product oriented communities) that go through your community (or even ask a question) aren't looking to join a new community at all, they're not there for your amazing community plan and experience (sorry): they just want an answer to their question, ideally as quickly as possible.
To facilitate this, we're already looking into using Vanilla's federated search which hopefully will allow our community members to simultaneously search through the Forum, our Documentation, Github, Academy (courses). Maybe even add Youtube and StackOverflow.
But I'd want to go beyond federated search.
I'm interested in enhancing the core community function of (quickly) answering questions, inspired by the latest LLM/AI developments.The LLM would need to be trained specifically on our data (Forum, Documentation, Github, Academy, maybe even support tickets) and when a user either searches on forum or posts a question in a specific subforum, the AI could post a near immediate response.
Just like with GPT-4, I wouldn't expect the answers to be perfect (but neither are many real forum responses). It could even state this as a default disclaimer. But it would be great if the bot could provide quick solution directions that help the user solve their problem faster/better. Maybe we can even build in a feedback model where community members rate the bots response and then feed that back into the training data.
A quick mockup/example of what this could look like in Vanilla:
I know I could connect GPT to our forum through Zapier, and that you can fine-tune GPT-3 (no 4 so far AFAIK). But would that be my best approach? Since I also want this training not to be one-off, but want to keep it trained on ongoing basis on new community messages. Are there already services around this (connected to GPT-4 or other LLMs)? Freelancers that could build this?