Skip to main content

Configuring Your Vendor

The Data Studio AI Assistant follows a bring-your-own-key model. Before you can create and use assistants, you must configure a supported large language model (LLM) vendor and provide a valid API key.

Vendor configuration establishes two required connections. First, it allows the AI Assistant to authenticate with your approved LLM provider so that assistants can generate responses. Second, it connects the system to your vector database, where Knowledge Stores are created and maintained.

The vector database stores vectorized representations of your data, which enable semantic search and contextual retrieval. InterSystems IRIS functions as the vector store for the AI Assistant. As part of the configuration process, provide connection information for your InterSystems IRIS instance in the Vector DB section of the configuration screen.

You can also optionally configure Langfuse to enable logging and observability.

Providing Your Model Key

To configure a vendor and provide the required credentials:

  1. Click the Management icon in the application menu.

  2. Under Semantic Search, click Vendors.

  3. Select a vendor from the list of available providers.

  4. On the Configuration, provide the required information. The fields vary by vendor:

    API Key

    Required Provide your API key to enable access to models and services from your vendor.

    (Azure Only) Azure OpenAI Endpoint

    Required Provide the Azure OpenAI endpoint.

    (Azure Only) OpenAI API Version

    Required Select the Azure OpenAI API Version you are providing.

    Provide Langfuse configuration

    Optional Enable this setting to configure logging. If enabled, provide:

    • Host—(Required)

    • Public Key—(Required) Provide the Langfuse public key for API authentication.

    • Secret Key—(Optional) Provide the secret key to authenticate with the API.

    • Access URL—(Required) Provide the access URL for Langfuse.

    Vector DB Host

    Required Specify the hostname or IP address of your vector database.

    Vector DB Port

    Required Enter the port number used by your InterSystems IRIS instance.

    Vector DB Username

    Required Enter the username for the InterSystems IRIS instance hosting the vector database.

    Vector DB Password

    Required Enter the password used for connecting to the VectorDB instance.

    Vector DB Namespace

    Required IRIS namespace for your VectorDB.

  5. Once all the fields are completed, click Save.

Deleting a Model Key

To delete a model key:

  1. Click the Management icon in the application menu.

  2. Under Semantic Search, click Vendors.

  3. Click the vendor with the key you wish to delete from the list of available vendors.

  4. At the bottom of the page, click Delete Configuration. The model key is deleted and cannot be recovered

Deleting a vendor configuration removes the stored credentials. Assistants and Knowledge Stores associated with that vendor will not function until a new valid configuration is provided.

FeedbackOpens in a new tab