Create test group
EARLY ACCESSA test group organizes related test cases for a specific AI agent. Each test group is linked to exactly one agent, but you can create multiple test groups for the same agent to cover different use cases.
Group tests by scenario type, agent version, or evaluation goal to keep your quality assessments structured.
You must have an AI agent configured in AgentOS.
Create a test group
- Go to Quality center > Create test group.
- In the New test group dialog, configure the following:
- AI agent: Select the agent that you want to test.
- Test group name: Enter a descriptive name for the test group.
- Select Create test group.
You can now add test cases to the group.
Duplicate or delete a test group
If you want to run an existing set of test cases on a different AI agent, you can duplicate the test group. You can also delete test groups you no longer need.
For each test group, select the menu icon (three dots) to access the following options:
- Duplicate test group: Create a copy of the test group.
- Delete: Remove the test group.
To duplicate or delete a test group:
- In the list of test groups, select the menu icon (three dots) next to the test group.
- Select Duplicate test group or Delete.
- If duplicating, you can duplicate the test group for the same agent or choose a different one.
- Select Duplicate or Delete to confirm.
Test group page
When you open a test group, the test group page displays all test cases for that group.
On this page, you can do the following:
- Search: Search for test cases by using the search box.
- Filter: Filter test cases.
- Add test cases: Add test cases by selecting Add test case.
- View test cases: View a list of test cases. For each test case, you can view the following information:
| Column | Description |
|---|---|
| User input | The first end user message in the test case. |
| Conversation turns | Number of messages exchanged between the agent and the end user. |
For each test case, select the menu icon (three dots) to access the following options:
- Edit: Update the test case.
- Duplicate: Create a copy of the test case.
- Delete: Remove the test case.
Next steps
- Add test cases: Define the expected behavior of your agent by adding test cases to the group.
Best practices
- Group related test cases - Create separate test groups for different features or user journeys.
- Use descriptive names - Name test groups clearly to identify their purpose at a glance.
- Run multiple times - Execute test groups 3–10 times to verify that agent responses are consistent.
- Save useful conversations - During manual testing in Preview, save conversations that represent important scenarios.