Verified AI summary ◀▼
Create exact text-match AI insights to automatically evaluate messages based on specific keywords or phrases. This feature helps you maintain quality standards by scoring agent responses. You can set up to 20 categories, using conditions like "contains" or "is not" to refine your criteria. Once created, add these categories to your scorecards to start using them.
Exact text-match categories use autoscoring to identify specific keywords or phrases and evaluate whether responses meet your quality standards.
Admins and account managers can create exact text-match custom rating categories.
You can create up to 20 exact text-match AI insights per account. When you reach this limit, you must either mark one as inactive or delete it before you can create or activate more.
To create an exact text-match category
- In Quality Assurance, click your profile icon in the top-right corner.
- Click Settings (
).
- In the sidebar (
) under Account, click AI.
- Click Create AI insight.
- Select the Exact text-match AI insight type.
- Enter an AI insight name and Description for reviewers (optional). This is displayed when hovering over a category name while rating a conversation.
- Under If , select if you want to search only the Agent message, the Client message or Any message.
- Select the operator (default: contains) and enter one keyword or phrase per row
that you want to score automatically if they occur in messages. See Exact text-match conditions.
You can:
- Click Add row for each additional keyword or phrase you want to autoscore in this category.
- Click Add condition to specify more complex keywords and phrases.
- Enter '/' to add the variable {..}. You can use this dynamic content placeholder {..} to represent any name. For example, “Hello {··}!”
- Under Then score and Otherwise score, select how you want to automatically
rate the agent. For example, if the text does not include “let’s schedule a demo,” the
agent receives a negative (
) score for this category. Otherwise, you can choose to score them positively (
) or use "N/A" if unsure.
- Select Use as a category on a scorecard.
- Click Create category.
- After creating it, you must add the category to your scorecards to start using it.
Exact text-match conditions
You can add multiple rows and use the following conditions for complex findings:
Condition name | Condition type | Search query example |
Do you get a thumbs up as a result for this conversation
message? "Thank you for contacting Acme Corporation, how can I help you today?" |
is | is any of |
"Thank you for contacting" "how can I help you today?" |
No, because we look for entirely equal matches. |
is all of |
"Thank you for contacting Acme Corporation, how can I help you today?" "how can I help you today?" |
No, although the first query matches, the second does not. | |
contains | contains any of |
"Thank you for contacting us” “how can I help you today?" |
Yes, because the second query is part of the message. |
contains all of |
"Thank you for contacting” “how can I help you today?" |
Yes, because both queries are part of the message. | |
is not | is not any of |
"Thank you for contacting us” “we are unavailable today?" |
Yes, because neither of these queries are an exact match of the message. |
is not all of |
"Our business is closed" "Please contact us tomorrow" |
Yes, because none of these queries are an exact match of the message. | |
does not contain | does not contain any of |
"Our business is closed" "how can I help you today?" |
No, because the second query is part of the message. |
does not contain all of | "Thank you for contacting” “how can I help you today?" | No, because both queries are part of the message |