Power BI LLM Chatbot
02-10-2023
Introduction
Interacting with Large Language Learning Models (LLM) such as ChatGPT has become an integral part of modern business, almost like using search engines like Google. However, there are significant challenges when using ChatGPT within an organization. First, the official ChatGPT records all conversations to further improve their models which can raise substantial privacy concerns for your organization. Second, jumping back and forth between applications can be cumbersome and not reasonable for business users. Third and last but not least, democratizing a secure ChatGPT version hosted on Azure OpenAI or even your own fine-tuned LLM can be very challenging.
Prerequisites
The visual works via the platform's REST API and is basically designed to be very intuitive. In the "LLM" section, you can currently choose between OpenAI and Azure OpenAI. For OpenAI it's just required to populate the model name as well as a valid API key. Azure OpenAI on the other hand requires the OpenAI resource name, deployment name, and also a valid API key which you can find in the Azure portal of the corresponding resource under "Endpoint and Keys", more regarding this see here.
The Chatbot section allows you to personalize your Chatbot with the following options:
If you have any problems or additional feature requests, please feel free to reach out to service@creativedata.io
Interacting with Large Language Learning Models (LLM) such as ChatGPT has become an integral part of modern business, almost like using search engines like Google. However, there are significant challenges when using ChatGPT within an organization. First, the official ChatGPT records all conversations to further improve their models which can raise substantial privacy concerns for your organization. Second, jumping back and forth between applications can be cumbersome and not reasonable for business users. Third and last but not least, democratizing a secure ChatGPT version hosted on Azure OpenAI or even your own fine-tuned LLM can be very challenging.
This is where we are excited to introduce the Power BI LLM Chatbot custom visual, a solution designed to address these issues. It's a ready-to-use and customizable Chatbot that allows you to seamlessly connect to any LLM hosted on OpenAI or Azure OpenAI. It eliminates the need to develop your own frontend for interacting with a secure ChatGPT version hosted on Azure OpenAI, resulting in cost savings and safeguarding privacy.
- Power BI
- OpenAI or Azure OpenAI access
The visual works via the platform's REST API and is basically designed to be very intuitive. In the "LLM" section, you can currently choose between OpenAI and Azure OpenAI. For OpenAI it's just required to populate the model name as well as a valid API key. Azure OpenAI on the other hand requires the OpenAI resource name, deployment name, and also a valid API key which you can find in the Azure portal of the corresponding resource under "Endpoint and Keys", more regarding this see here.
The Chatbot section allows you to personalize your Chatbot with the following options:
- Chatbot name: The name of the Chatbot appearing in the header and "Chatbot initial message"
- Chatbot avatar: The photo of the Chatbot appearing next to the name in the header. Copy a base64 encoded string into the field.
- Chatbot instructions: A general instruction enabling more precise control over the behavior and responses by using the system role behind the scenes.
- Chatbot initial message: The first message in the chat when opening the report.
- Chatbot response: This value allows for a balance between generating creative responses and maintaining a certain level of consistency and relevance by using the temperature parameter behind the scenes. Default means that the parameter isn't passed on at all.
If you have any problems or additional feature requests, please feel free to reach out to service@creativedata.io