Skip to main content

Create QA Test

User Documentation for Create/Update QA Test Dialog​

Overview​

The Create/Update QA Test dialog allows you to define or modify the details of a QA test for your copilot agents. This includes specifying the name of the test and providing detailed instructions for the test scenarios.

WThe Create/Update QA Test dialog allows you to define or modify the details of a QA test for your copilot agents. This includes specifying the name of the test and providing detailed instructions for the test scenarios.

Screen Elements​

  1. Header Section:

    • Title: "Update QA Test" (or "Create QA Test" when creating a new test)

  2. Fields:

    • Name:
      • Description: The name of the QA test.
      • Input: Text field.
    • Instruction:
      • Description: Detailed instructions outlining the test scenarios and steps for the QA test.
      • Input: Text area.

  3. Action Buttons:

    • Save:
      • Function: Saves the test configuration.
    • Cancel:
      • Function: Discards changes and closes the dialog.

How to Use​

  1. Creating a New Test:

    • Click the "Create" button on the Copilot QA Tests screen to open the Create QA Test dialog.
    • Fill in the details:
      • Name: Enter a descriptive name for the test.
      • Instruction: Provide detailed instructions for the test. Include specific scenarios, expected responses, and any conditional logic.
    • Click "Save" to create the new test.

  2. Updating an Existing Test:

    • On the Copilot QA Tests screen, locate the test you want to update.
    • Click the three vertical dots in the 'Action' column next to the test and select "Edit".
    • Update the necessary details in the dialog:
      • Name: Modify the test name if required.
      • Instruction: Edit the test instructions to reflect any changes or new scenarios.
    • Click "Save" to apply the changes.

  3. Discarding Changes:

    • If you do not wish to save the changes, click "Cancel" to close the dialog without saving.

Example of Test Instructions​

  • Name: Test time, weather, and stock
  • Instruction: 
    Ask for what time of day from the copilot in New York City.
    If the response back is in the morning, ask for the weather in New York City.
    If the response back is in the afternoon, ask for the weather in Los Angeles.
    If the response back is at night, ask for the weather in Boston.
    If not raining, ask for the stock for Apple.
    If raining, ask for the stock of Nvidia.

Notes​

  • Ensure the test name is clear and descriptive to easily identify the test.
  • Provide comprehensive instructions in the Instruction field to cover all necessary test scenarios and conditions.
  • Use this dialog to iteratively refine your tests based on test results and agent performance.

This documentation should help you effectively use the Create/Update QA Test dialog to manage your QA tests for copilot agents. If you have any further questions or need assistance, please refer to the help section or contact support.