How to Review Copilot Studio Agent Analytics
🔍 WiseChecker

How to Review Copilot Studio Agent Analytics

You need to understand how your Copilot Studio agent is performing after deployment. The analytics dashboard shows session volume, user satisfaction, and topic effectiveness. Without reviewing this data, you cannot identify bottlenecks or improve your agent. This article explains how to access and interpret the key reports in Copilot Studio analytics.

Key Takeaways: Interpreting Copilot Studio Agent Analytics

  • Copilot Studio > Analytics tab: Central location for all session, topic, and user satisfaction data.
  • Session metrics (Total Sessions, CSAT, Abandon Rate): Measure overall engagement and user happiness.
  • Topic-level reports (Resolution Rate, Escalation Rate): Identify which topics perform well and which need retraining.

ADVERTISEMENT

Overview of Copilot Studio Analytics Reports

Copilot Studio provides a built-in analytics dashboard that tracks every user interaction with your agent. The data refreshes every few hours and covers the last 30 days by default. You can filter by date range, channel, or specific topic. The dashboard includes four main report sections: Summary, Sessions, Topics, and User Satisfaction. Each report gives you a different view of agent performance. To use analytics, you need a Copilot Studio license and at least Analyst or Maker permissions on the agent. The analytics tab is available immediately after the agent processes its first session.

Summary Report

The Summary report shows high-level KPIs for your agent. You see total sessions, average CSAT score, average session duration, and abandon rate. The abandon rate is the percentage of sessions where the user left without a resolution. A high abandon rate often indicates that the agent could not answer the user’s question. The Summary report also includes a trend line so you can see if metrics are improving or declining over time.

Sessions Report

The Sessions report lists every individual conversation your agent had. Each row shows the session ID, start time, channel, topic triggered, and final outcome. You can click a session to see the full transcript. This report is useful for debugging specific user issues. For example, you can find a session where the agent gave a wrong answer and review the exact conversation.

Topics Report

The Topics report breaks down performance by each topic in your agent. For every topic, you see the number of sessions, resolution rate, escalation rate, and average CSAT score. The resolution rate is the percentage of sessions where the topic was resolved without escalating to a live agent. The escalation rate shows how often the topic transferred the user to a human. Topics with low resolution rates need improvement. You can edit the topic’s trigger phrases or conversation flow directly from this report.

User Satisfaction Report

The User Satisfaction report displays CSAT scores collected after each session. Users see a thumbs up or thumbs down prompt at the end of a conversation. The report shows the total number of ratings, the average score, and a breakdown of positive vs negative ratings. You can filter by topic to see which topics have the lowest satisfaction. Low CSAT scores indicate that the user did not get the answer they expected.

Steps to Access and Filter Agent Analytics

Follow these steps to open the analytics dashboard and apply filters for specific data.

  1. Open the Copilot Studio app
    Go to copilotstudio.microsoft.com and sign in with your work or school account. The app opens to the Home page by default.
  2. Select your agent
    On the Home page, click the name of the agent you want to review. The agent’s detail page opens.
  3. Click the Analytics tab
    In the left navigation menu, click Analytics. The Summary report loads by default. You see the date range selector at the top right. The default range is the last 30 days.
  4. Change the date range
    Click the date range dropdown and select a custom range or a preset like Last 7 Days or Last 90 Days. Click Apply to refresh the reports.
  5. Filter by channel
    Click the Filter button next to the date range. Select a channel from the dropdown, such as Microsoft Teams or Web. The reports update to show only sessions from that channel.
  6. Switch to the Sessions report
    Click Sessions in the left pane under Analytics. The report shows a table of individual sessions. Use the search box to find a session by ID or user name.
  7. Open a session transcript
    Click any session row. A side panel opens with the full conversation transcript. Review the messages to see what the user asked and how the agent responded.
  8. Switch to the Topics report
    Click Topics in the left pane. The table lists every topic. Click a topic name to see its detailed metrics and conversation examples.
  9. Export report data
    Click the Export button at the top of any report. Choose CSV or Excel format. The file downloads with the current filter settings applied.

ADVERTISEMENT

Common Misconceptions and Limitations

Analytics data is not real-time

The dashboard refreshes every 2 to 4 hours. If you just deployed a change, wait at least 4 hours before checking the impact. Data from the current day may appear incomplete until the next refresh cycle.

CSAT scores are optional for users

Users can skip the satisfaction prompt. A low number of ratings makes the average CSAT score less reliable. Check the total number of ratings in the User Satisfaction report before acting on the score. If the sample size is under 50, consider the score as directional only.

Abandon rate includes sessions where the user closed the chat

The abandon rate counts any session that ended without a resolution event. This includes sessions where the user simply closed the browser tab. A high abandon rate does not always mean the agent failed. Cross-check with the session transcripts to see if the agent actually answered the question before the user left.

Topic resolution rate depends on topic design

A topic with a low resolution rate may need better trigger phrases or a clearer conversation flow. Use the Topics report to find the exact sessions where the topic failed. Open those transcripts to see where the conversation broke down. Then edit the topic in Copilot Studio to improve its responses.

Item Summary Report Sessions Report
Purpose High-level KPIs for overall agent health Detailed list of every individual conversation
Key metrics Total sessions, CSAT, abandon rate, duration Session ID, channel, topic, outcome, transcript
Best use case Weekly performance review and trend analysis Debugging specific user issues and reviewing transcripts
Export format CSV or Excel with aggregated data CSV or Excel with row-per-session data

You can now open the Analytics tab in Copilot Studio and review your agent’s session volume, CSAT scores, and topic performance. Start with the Summary report to spot overall trends, then drill into the Topics report to find underperforming topics. For deeper investigation, open session transcripts from the Sessions report. To get the most out of analytics, set a weekly reminder to check the dashboard and export a CSV for record keeping. If you need to share reports with stakeholders, use the Export button to generate an Excel file with the current filters applied.

ADVERTISEMENT