Before beginning to use the Quality Assurance tool, it's crucial to set it up in a way that suits our requirements.
There are several reasons why reviewing the Settings is important prior to defining the QA workflow:
- Ensuring that an adequate number of QA evaluations are performed for each agent within the week.
- Ensuring that only conversations that are relevant or significant to you are reviewed.
- Ensuring that quality standards are effectively communicated to the rest of your team.
- Keeping management informed about the targets to be achieved and working towards reaching them.
Let's start our setup by visiting Settings -> Quality Assurance -> Tickets funnel
The Tickets Funnel Settings will aid in specifying the type of tickets that require the attention of QA experts, and the number of QA evaluations expected per agent per week.
1. Choose the tickets to be rated by QA
To begin with the setup process, we need to define our preferences by selecting whether we're only interested in resolved cases or we'd also like to include ongoing conversations in our QA review. 🤝
- Solved and Handled tickets: This category includes all tickets where an agent has left a comment, whether internal or external, that will be displayed on the Scorecard for QA evaluation.
- Solved tickets: This category includes only tickets that have been resolved by the agent, irrespective of whether they responded to the customer in the ticket or not. It may be the case that the agent only solved or merged the ticket with another one, but it will still appear on the Scorecard for evaluation.
💡Pro-tip: If you want to provide feedback in real-time, we recommend selecting the Solved and Handled option. This allows you to offer tips and feedback to your agent while they are still working on the same ticket.
2. Narrow down the selection
Now it's time to specify the type of tickets that require QA rating, ensuring that your QA experts are not spending their time evaluating unimportant cases. 👆🏽
To define your preferences, use the three filters: tag filter, channel filter, and metric filter.
- Tag filter: Add tags to tickets inside Zendesk. If you select more than one tag, the filter will suggest tickets for QA rating that contain at least one of the defined tags.
💡Pro-tip: If no tags are defined, we include tickets with all present tags.
💡Pro-tip x2: Define tags in Zendesk to group similar cases together - #refund_issues, #order_cancelation, #legal, etc. This helps evaluate conversations supported by different agents that are related to the same case, determining if the entire team struggles with a certain type of case, or if only Agent A requires additional coaching in this regard.
❗️ QA Insights Dashboard helps understand the results on the team and agent level. Check it out here!
- Channel filter: Define channel groups through which agents provided support - Email, Chat, and Phone. If multiple channel groups are selected, we include all tickets supported in each of these channels.
💡Pro-tip: If no channels are defined, we include tickets supported through any channel.
💡Pro-tip x2: You can always adjust the settings to focus on a specific channel support for the week. For instance, if you introduced Live Chat support and need to ensure the same high-quality level as with Email support, set a filter to focus only on chat tickets this week or month!
❗️ Did you know that you can quickly switch between Chat, Email, and Phone QA results in the QA Insights dashboard? This helps quickly understand which channel needs more attention during coaching. Learn more about the QA Insights dashboard here!
- Metrics filter: Focus on tickets that meet your preferred criteria (e.g., have at least 2 messages from the agent before solved) or outside your desired outcome (e.g., the first reply time is longer than 1h). If more than one metric is selected, we include tickets that meet at least one of the metric criteria (e.g., either had more than 2 Public Replies or Chat Messages before solved or had longer than 1h First Reply Time).
💡Pro-tip: If no metrics are selected, we do not specify if the ticket had a specific metric result.
💡Pro-tip x2: If only the CSAT metric is selected, and both positive and negative ratings are chosen, we include only the tickets rated by the customer.
💡Pro-tip x3: You can leave the metric limits half-open. For instance, if you want at least 4 Public replies or Chat Messages sent before the ticket was resolved, you can select Messages to Solve as (4;-) (as shown in the example)👇🏽.
How does it work?
After defining your preferred criteria, your QA experts will be presented with tickets for QA rating that have at least one of the defined tags, were supported through one of the chosen channels, and had a result for at least one of the selected Metrics and values.
Using the example above👆🏽, one of the tickets suggested for QA rating could be related to "Shipping," supported through Chat, and negatively rated by the customer.