The first section in the Intelligent Analytics tool is the Overview section. As the name suggests, this section helps you get a quick overview of the important metrics to measure the IVA’s performance.
The Overview section provides information about:
The Overview section provides information about:
On top of all screens inside the Intelligent Analytics tool, you will find the business options. This option helps you select the business name from the dropdown for which you want to analyze the data.
This option would enable you to see the channel on which your bot is deployed. Upon selecting the channel, you will be able to see the analytics for the same.
On the right-hand side of the filter section, you will find the duration filters. Using these settings you can filter the time period of the data presented.
There is a compare feature available that will help you to compare the performance of all metrics between the selected duration and its previous duration.
The first section in the overview section is the number. And you can be able to check the actual number of new users and the number of returning users i.e., repeat users.
Unique Users refer to the number of unique individuals who have visited your bot over a period of time. As the name indicates, the number of visits per user does not affect this count.
Eg. If Mary visits the bot on Tuesday, Wednesday and Thursday, the unique user count will be displayed as 1. It does not increase by 3 as Mary is one ‘unique’ user.
CSAT Stands for Customer Satisfaction Score. This key performance indicator tracks how satisfied are the customers with the service.
How is CSAT Calculated?
The following colors are used to show the benchmarks of CSAT –
For example, if you have 35 positive responses (4 and 5) and a total of 50 responses, your CSAT would be 70%.
The following colors are used to show the benchmarks of CSAT –
Query Completion helps to track whether the bot is helping the end-user to resolve. A user’s query is resolved on the bot when the user goes through the designed bot’s journey and reaches the end of the journey.
A conversation is defined as a series of messages exchanged between the IVA and the user in a 24-hour window, from the time user sent the first message on the bot.
This section gives the first 5 funnels as per volume coming on the bot.
A funnel is a stage or a series of stages designed to see the effectiveness of the bot to help users reach their goals.
Along with the funnel name, funnel hits and completion rate are also shown.
Funnel Hits: Defines the number of times a particular tunnel has been hit by all the used on the bot.
Completion Rate: Defines the number of instances where the user reached their end goal.
Bot Automation percentage tells us about what percentage of the conversations did not have either a bot break or an agent involved for the selected duration of time.
Language Usage shows the split of languages, conversations, and bot automation percentage for all the languages users are interacting in, on the IVA. This section helps in understanding capabilities that should be added to support end-users who reach out in different languages.
The Conversation Split metrics will help you understand which conversations are broken and which are being handed over to agents for live support.
Demo data is the data shown for demonstration purposes. When you create a new bot, it won’t have any data to show on Analytics because there has been no activity of users on it. If you want to understand what each metric stands for, and how can they be used with some real data examples, you can use the demo data toggle.