Uploading Unstructured Documents via the Document Store

A Document Store is used to upload and manage unstructured files, such as PDFs, Word documents, or text files. These files can then be processed and made searchable by the AI Assistant.

A Document Store holds the original documents. When used with a Knowledge Store of type Document Based Knowledge Store, the contents of those documents are processed into vector embeddings and stored in the Knowledge Store. Assistants retrieve information from the Knowledge Store, not directly from the Document Store.

After creating a Document Store and uploading documents, you can configure how those documents are processed and added to a Knowledge Store. This configuration is completed when creating a Narrative, which is described in the next chapter.

Creating a New Document Store

Click the Document Store icon in the application menu.
Click + New Store.
Store name

Required— Unique Identifier of the document store.

Storage capacity limit

Required— Defines the maximum storage capacity for this Document Store. The system warns you if the limit is exceeded.

Description

Optional— A description for the document store.
Click Create Store.

Once you’ve created your store, you may wish to create a synchronization configuration for the document store. To do so:

Adding Documents to Your Document Store

Once you have created your document store, it’s time to upload documents. To do so:

Click the Document Store icon in the application menu.
Click a store name from the Document Stores list.
Click the name of the folder you would like to upload documents to.
Either drag and drop your documents into the document list, or click Upload to open a file explorer where you can select your documents.
Your documents appear in the document list.

Configuring Document Store Synchronization

Prior to configuring document store synchronization, you will need to create any tags you would like to use.

Click the Document Store icon in the application menu.
Click a store name from the Document Stores list.
Click Configure.
On left side, click Sync Configurations.
Click +Add Sync.
Document Source

Required— Select the configured document data source (such as S3 or SFTP) from which files will be synchronized.

File Mask

Required— Enter one or more file masks (for example., *.pdf;*.docx). Only files matching these patterns will be synchronized.

Recursive

Optional— Checking this box will include all subfolders under the selected source path during synchronization.

Target Folder

Required— Select the User Folder within the Document Store where synchronized files will be saved.

Source Synchronization Path

Required— The folder in the source system from which files will be synchronized.

Tags

Optional— Select tags to apply automatically to every file imported through this synchronization configuration. Find out more about tags in Configuring Document Tags.

Document Tags

Document tags help you organize and filter documents in a Document Store. You can use tags to find documents quickly and to automatically label documents that are added through synchronization configurations.

Data Studio supports the following tag types:

File type tags (system-provided)—Tags such as pdf or docx that are applied automatically based on the document format. These tags cannot be renamed or deleted.
User tags—Tags you create to categorize documents by purpose or content (for example, contracts, sec-filings, or research). User tags can be applied manually or automatically during document synchronization.

Configuring Document Tags

To create or manage document tags:

Click the Management icon in the application menu.
Under General, click Tags.
To create a new user tag, click + New Tag.
Enter a Name and, optionally, a Description.
Click Save.

After creating user tags, you can apply them to documents in a Document Store or select them when defining a synchronization configuration so that imported documents are tagged automatically.

Editing an Existing Document Store

Click the Document Store icon in the application menu.
Click a store name from the Document Stores list.
Click Configure.
Modify any of the fields.
Click Save Settings.

Deleting a Document Store

Click the Document Store icon in the application menu.
Click a store name from the Document Stores list.
Click Configure.
Click Delete Document Store. A confirmation modal appears.
Type the confirmation text in the text box.
Click Delete Document Store. Your document store has been deleted.

Deleting a document store is a permanent action and cannot be reversed. Deleting a document store results in all of the documents in the document store being deleted as well as any synchronization configurations.