Skip to main content

Content Ingestion

Overview​

The Documents section is a centralized repository where you can upload content that the AI copilot will use to extract information and answer user queries. By providing comprehensive and relevant documentation, you empower the copilot to deliver accurate and helpful responses to your customers, prospects, and employees.

Best Practice for Websites is to use a CMS connector

Note: Use a CMS Connector to keep your content syncronized. It requires access to your CMS system. Enable Connectors from organization settings, then you will see the connectors in the project.

The image features a section of the ai12z interface for ingesting content. It includes options for adding new files, URLs, or an entire website to the project's document repository, which serves as the data source for an AI assistant to access and provide information. The "Documents" tab is selected in the navigation menu, emphasizing the document management aspect of the interface.

Uploading Content to Documents​

Adding Files​

  • To upload files such as product documentation, PDFs, or sales decks, click on the Add a new file button.
  • Acceptable file formats include .pdf, .docx, .pptx, .xlsx, .csv, .txt, .json, .markdown, .md , and more, ensuring versatility in the types of content you can provide.

Adding URLs​

  • Use the Add URL option to include specific content from a website, such as help articles or FAQ page.
  • This includes YouTube, .pdf, .docx, .pptx, .xlsx, .csv, .txt, .json, .markdown, .md files hosted on a web site
  • Simply paste the URL, and the system will retrieve the content to be included in the copilot's knowledge base.

Adding Entire Websites​

  • For a broader range of content, select Add Website to include an entire website as a source for the copilot.
  • This option is ideal for providing a wide array of information from comprehensive sources, such as corporate websites or online catalogs.

Adding Documents to Your Project​

Once you have navigated to the Documents section, you can begin adding content:

  • Click on the Add Document button to see the options.
  • Choose Add File to upload individual files, Add URL to include specific web pages, or Add Website to ingest an entire website.

Managing Your Documents​

Overview of Document Management​

After the first document is added, you will see it listed with details such as its name, description, and when it was last modified. Each document has an Action menu on the right side that allows for further management.

After the first document is added, you will see it listed with details such as its name, description, and when it was last modified. Each document has an Action menu on the right side that allows for further management. such as info, delete, and continue igestion

Available Actions for Each Document​

  • Info: View detailed information about the document, such as its type, size, and when it was uploaded.
  • Continue Ingest: If a document requires additional steps to be fully integrated into the copilot's knowledge base, this option will appear.
  • Sync: After you have ingested a website, sync checks for updates, deletes and new documents added to a website.
  • Delete: Remove the document from the repository if it is no longer needed or relevant.

The elispse dot dot dot, for the Action menu for each action , info, continue ingestion, and delete

Processing Documents​

Some documents and website ingestion require a multi-step ingestion process:

  1. Select Continue Ingest from the action menu if this option is available.
  2. Follow the prompts to complete any necessary steps, ensuring the content is fully accessible to the AI copilot.

Document Status​

Each web site, document or asset has associated with it 'Document Information' that includes a tab for the basic information associated with the document including ids and status. It includes tabs to navigate to the Vector documents that are created and the Settings.

Each web site, document or asset has associated with it 'Document Information' that includes a tab for the basic information associated with the document including ids and status. It includes tabs to navigate to the Vector documents that are created and the Settings.

Vector Tab​

The Vector documents is what is stored in the vector database plus the associated embeddings The Vector documents is what is stored in the vector database plus the associated embeddings,the interface lists documents with columns for 'Title', 'Description', 'Page Content', 'Url', and 'Word Count','Action' column with a vertical ellipsis to select edit or delete a document

Settings Tab​

Shows you the settings of the ingestion process, for example what where the include and Exclude pattern, and Languages selected.

hows you the settings of the ingestion process for example what where the include and Exclude pattern, and Languages selected.

Best Practices for Document Management​

  • Regularly review your uploaded content to verify that all documents have been fully ingested and are available for the copilot's use.
  • Use the Info action to check document details and ensure they match the expected content types and sources.
  • Keep your document repository organized and up-to-date to maintain the highest level of accuracy in your copilot's responses.

By effectively managing the Documents section, you can ensure that your AI copilot has all the necessary information to assist users accurately and efficiently.

Best Practices​

  • Relevance: Ensure that the content you upload is relevant to the queries your copilot will encounter.
  • Organization: Categorize and tag documents properly to facilitate efficient information retrieval by the AI.
  • Updates: Keep your documents up-to-date with the latest information to maintain the accuracy of the copilot's responses.
  • Review: Regularly review the content to ensure it aligns with your current offerings and user expectations.

By maintaining a well-organized and updated Documents section, you can significantly enhance the effectiveness of your AI copilot, providing your users with an exceptional experience.