| Add-on | AI agents - Advanced |
The Performance Overview dashboard gives you a comprehensive, at-a-glance view of your organization’s overall AI agent performance. By providing you with insights into key automation metrics, this dashboard helps you report on the value of AI agent outcomes and make data-driven decisions to improve future efficiency.
This article contains the following topics:
About the reports
The Performance Overview dashboard contains the following tabs:
- Performance overview. Shows the performance of AI agents across different channels.
- Messaging details. Shows the performance of messaging AI agents specifically. Appears only if you have at least one messaging AI agent.
- Email details. Shows the performance of email AI agents specifically. Appears only if you have at least one email AI agent.
Performance overview tab
The Performance overview tab shows the performance of AI agents across different channels.
This tab includes the following reports:
-
Total volume. Shows the actual number and change-over-time percentage of emails and messages received by your AI agents.
The drop-down field above the visualization includes the following report views:
- Total volume vs automation. Shows the total volume, AI agent-handled volume, and the answered emails volume graphed over time.
- Total volume overall trend. Shows the total volume graphed over time.
- Total volume by AI agent. Shows the total volume for each AI agent graphed over time.
- Total volume by channel. Shows the total volume for each channel (messaging or email) graphed over time.
- Total volume by language. Shows the total volume for each language graphed over time.
-
Automated resolutions. Appears only if you have a Zendesk-provisioned account. Shows the percentage, actual number, and change-over-time percentage of AI agent-handled (for messaging AI agents) and answered (for email AI agents) conversations that have passed verification by our large language model (LLM) as not requiring human intervention. Automated resolutions data is available only from October 7, 2024 and later.
The drop-down field above the visualization includes the following report views:- Total volume vs automated resolutions. Shows the total volume compared and automated resolutions volume graphed over time.
- Automated resolutions overall trend. Shows the volume of automated resolutions graphed over time.
- Automated resolutions by channel. Shows the volume of automated resolutions for each channel (messaging or email) graphed over time.
- Automated resolutions by AI agent. Shows the volume of automated resolutions broken for each AI agent graphed over time.
- Automated resolutions by language. Shows the volume of automated resolutions for each language graphed over time.
For more information about automated resolutions, see About automated resolutions for AI agents.
-
Messaging conversation volume. Appears only if you have messaging AI agents. Shows the actual number, percentage, and change-over-time percentage of messaging conversations received by your AI agents.
The drop-down field above the visualization includes the following report views:- Messaging volume vs AI agent-handled. Shows the messaging volume and AI agent-handled volume graphed over time.
- Messaging volume overall trend. Shows the messaging volume graphed over time.
- Messaging volume by AI agent. Shows the messaging volume for each AI agent graphed over time.
- Messaging volume by language. Shows the messaging volume for each language graphed over time.
-
AI agent-handled rate. Appears only if you have messaging AI agents. Shows the percentage, actual number, and change-over-time percentage of messaging conversations that are considered AI agent-handled.
The drop-down field above the visualization includes the following report views:- Messaging volume vs AI agent-handled. Shows the messaging volume and AI agent-handled volume graphed over time.
- AI agent-handled overall trend. Shows the AI agent-handled volume graphed over time.
- AI agent-handled rate by AI agent. Shows the AI agent-handled volume for each AI agent graphed over time.
- AI agent-handled rate by language. Shows the AI agent-handled volume for each language graphed over time.
-
Email volume. Appears only if you have email AI agents. Shows the actual number, percentage, and change-over-time percentage of email conversations received by your AI agents.
The drop-down field above the visualization includes the following report views:- Email volume vs answered emails. Shows the email volume and answered email volume graphed over time.
- Email volume overall trend. Shows the email volume graphed over time.
- Email volume by AI agent. Shows the email volume for each AI agent graphed over time.
- Email volume by language. Shows the email volume for each language graphed over time.
-
Answered emails. Appears only if you have email AI agents. Shows the percentage, actual number, and change-over-time percentage of email conversations that are considered answered (meaning a reply was sent).
The drop-down field above the visualization includes the following report views:- Email volume vs answered emails. Shows the email volume and the answered email volume graphed over time.
- Answered emails overall trend. Shows the answered email volume graphed over time.
- Answered emails rate by AI agent. Shows the answered email volume for each AI agent graphed over time.
- Answered emails by language. Shows the answered email volume for each language graphed over time.
Messaging details tab
The Messaging details tab shows the performance of messaging AI agents specifically.
This tab includes the following reports:
-
Total messaging conversation volume. Shows the actual number and change-over-time percentage of messaging conversations received by your AI agents.
The drop-down field above the visualization includes the following report views:- Total messaging conversation volume vs deflection vs automation vs escalation. Shows the total number of messaging conversations alongside the number of deflections, escalations, and automated conversations graphed over time.
- Total messaging conversation volume overall trend. Shows the number of messaging conversations graphed over time.
- Total messaging conversation volume by AI agent. Shows the number of messaging conversations for each AI agent graphed over time.
- Total messaging conversation volume by language. Shows the number of messaging conversations for each language graphed over time.
-
Volume breakdown. Appears only when the Total messaging conversations volume report is selected. Shows the percentage and actual-number breakdown of conversations by AI agent.
-
Deflection rate. Shows the percentage, actual number, and change-over-time percentage of conversations that are handled entirely by an AI agent without being escalated to a human agent or having a follow-up ticket created. The following conversations are considered deflected conversations: AI agent-handled conversations, failed escalation conversations, and no status conversations.
The drop-down field above the visualization includes the following report views:- Total messaging conversation volume vs deflection rate. Shows the total messaging volume and the deflection rate graphed over time.
- Deflection rate overall trend. Shows the deflection rate and number of deflections, escalations, and automated conversations graphed over time.
- Deflection rate by AI agent. Shows the deflection for each AI agent graphed over time.
- Deflection rate by language. Shows the deflection rate for each language graphed over time.
- Deflection breakdown trends. Shows the number of total messaging conversations, AI agent-handled conversations, failed escalation conversations, and no status conversations graphed over time.
-
Deflection breakdown. Appears only when the Deflection Rate report is selected. Shows the percentage and actual-number breakdown of conversations by deflection status.
-
Custom resolution rate. Shows the percentage, actual number, and change-over-time percentage of conversations that reached a point where all necessary information to resolve the user’s question was provided and/or the user confirmed the issue was resolved. These conversations have a final resolution of Resolved or Informed.
The drop-down field above the visualization includes the following report views:- Total messaging conversation volume vs custom resolution rate. Shows the number of total messaging conversations and automated conversations graphed over time.
- Custom resolution rate overall trend. Shows the custom resolution rate and number of deflections, escalations, and automated conversations graphed over time.
- Custom resolution rate by AI agent. Shows the custom resolution rate for each AI agent graphed over time.
- Custom resolution rate by language. Shows the custom resolution rate for each language graphed over time.
- Resolutions breakdown trends. Shows the number of total messaging conversations alongside conversations with the following final resolutions graphed over time: Informed, Resolved, Escalated, Not Resolved, and Undefined.
-
Resolution breakdown. Appears only when the Custom resolution rate report is selected. Shows the percentage and actual-number breakdown of conversations by final resolution.
-
Escalation rate. Shows the percentage, actual number, and change-over-time percentage of conversations that were successfully escalated by an AI agent via live escalation, email escalation, or custom escalation.
The drop-down field above the visualization includes the following report views:- Total messaging conversation volume vs escalation rate. Shows the number of total messaging conversations and the escalation rate graphed over time.
- Escalation rate overall trend. Shows the escalation rate graphed over time.
- Escalation rate by AI agent. Shows the escalation rate for each AI agent graphed over time.
- Escalation rate by language. Shows the escalation rate for each language graphed over time.
- Escalation breakdown trends. Shows the number of total messaging conversations alongside the conversations with the following escalation paths, graphed over time: Agent, Email, Custom, and Failed Escalation.
-
Escalation breakdown. Appears only when the Escalation rate report is selected. Shows the percentage and actual-number breakdown of conversations by escalation path.
Email Details tab
The Email Details tab shows the performance of email AI agents specifically.
This tab includes the following reports:
-
Total email volume. Shows the actual number and change-over-time percentage of emails received by your AI agents.
The drop-down field above the visualization includes the following report views:- Total email volume vs email resolutions. Shows the total number of emails alongside the number of ticket resolutions graphed over time.
- Overall trend. Shows the number of emails graphed over time.
- By AI agent. Shows the number of emails for each AI agent graphed over time.
- By language. Shows the number of emails for each language graphed over time.
- Email resolutions. Shows the number of emails for each ticket resolution graphed over time.
-
Recognized emails. Shows the percentage, actual number, and change-over-time percentage of emails that were understood, but where no actions or replies were triggered.
The drop-down field above the visualization includes the following report views:- Total email volume vs recognized emails. Shows the total email volume and the number of recognized emails graphed over time.
- Overall trend. Shows the number of recognized emails graphed over time.
- By AI agent. Shows the number of recognized emails for each AI agent graphed over time.
- By language. Shows the number of recognized emails for each language graphed over time.
- Email Resolutions. Shows the number of recognized emails for each ticket resolution graphed over time.
-
Processed emails. Shows the percentage, actual number, and change-over-time percentage of emails that were understood and where an action was taken, but where no reply was sent outside of the default reply.
The drop-down field above the visualization includes the following report views:- Total email volume vs processed emails. Shows the total email volume and the number of processed emails graphed over time.
- Overall trend. Shows the number of processed emails graphed over time.
- By AI agent. Shows the number of processed emails for each AI agent graphed over time.
- By language. Shows the number of processed emails for each language graphed over time.
- Email resolutions. Shows the number of processed emails for each ticket resolution graphed over time.
-
Answered emails. Shows the percentage, actual number, and change-over-time percentage of emails that were understood and where a reply was sent, with or without any actions being triggered.
The drop-down field above the visualization includes the following report views:- Total email volume vs answered emails. Shows the total email volume and the number of answered emails graphed over time.
- Overall trend. Shows the number of answered emails graphed over time.
- By AI agent. Shows the number of answered emails for each AI agent graphed over time.
- By language. Shows the number of answered emails for each language graphed over time.
- Email resolutions. Shows the number of answered emails for each ticket resolution graphed over time.
-
Unrecognized emails. Shows the percentage, actual number, and change-over-time percentage of emails that were not understood and where no actions or replies were triggered.
The drop-down field above the visualization includes the following report views:- Total email volume vs unrecognized emails. Shows the total email volume and the number of not understood emails graphed over time.
- Overall trend. Shows the number of not understood emails graphed over time.
- By AI agent. Shows the number of not understood emails for each AI agent graphed over time.
- By language. Shows the number of not understood emails for each language graphed over time.
- Email resolutions. Shows the number of not understood emails for each ticket resolution graphed over time.
Filtering the dashboard
You can filter the dashboard reports by AI agent and date to focus on only the information you want to see.
To filter the dashboard
- In the main menu, click Dashboard.
- To filter by AI agent, click the AI Agent drop-down beneath the dashboard tabs, select the AI agent or agents you want to see results for, and click Apply. You can select as many AI agents as needed.
- To filter by date, click Timeframe in the upper right and use the calendar to select the period of time you want to see results for.
- Alternatively, click one of the following preset timeframes to apply: Today, Yesterday, Last 7 Days, Last 30 Days, This Month, or Last Month.
Applied filters persist when you switch between dashboard tabs, but are reset when you close your browser.
Changing a report’s view
For each report, you can apply different views that change how the results are presented. Different views let you focus on different aspects of the overall data.
To change a report’s view
- In the main menu, click Dashboard.
- Select the dashboard tab you want to view.
- Select the report you want to view.
- Above the visualization on the left side, click the drop-down to select a report view. The options depend on which report you have selected. See About the reports for a list of views available for each report.
- (Optional) Above the visualization on the right side, click Daily, Weekly, Monthly, or Quarterly to change how the report’s results are aggregated.
- (Optional) Above the visualization on the right side, click # or % to toggle the visualization between actual numbers and percentages.
Downloading a report’s results
You can download the results of an individual dashboard report as a CSV file. This allows you to further manipulate the results or upload them into your business intelligence tool of choice.
Note: Visualizations aren’t preserved when you download a report’s results.
To download a report results
- In the main menu, click Dashboard.
- Select the dashboard tab you want to view.
- Select the report you want to view.
- Click the download button (
) to download the report as a CSV file.
0 comments
Sign in to leave a comment.