Numbers about speed tell you if replies are fast. They do not tell you if they are kind or correct. Reply quality scoring adds that, and the same card shows how much each person has on their plate right now. This page is for owners who coach the team and for agents who want feedback.
Before you start
- You need the Reports feature and a plan with the AI assistant. Free plans do not get AI reviews.
- Each review is a short AI call, so turn it on only for the websites you want reviewed. See AI budget and usage.
How do I turn it on?
- Open Settings → Widget and open the website.
- Tick Let the AI review team replies for tone and accuracy (uses your AI budget).
- Save the website settings.
From then on replies on that website are reviewed in the background. It does not look at old replies.
What does the AI judge?
For each reply it gets the recent conversation and, if you have a knowledge base, the passages that match the customer's question. It scores two things from 1 to 5 and adds one sentence of advice:
- Tone: 5 is warm, polite and professional. 1 is rude or dismissive.
- Accuracy: 5 is correct and complete and agrees with your own notes. 1 is wrong, made up, contradicts your notes or ignores the question.
Card numbers, passwords and keys are masked before the AI reads anything. It is a guide for a conversation with your teammate, not a verdict, so read the conversation before acting on a score.
Where do I read the results?
Open Reports. The card Team workload and reply quality shows, for each person:
- Open and Waiting: conversations assigned to them right now, and how many of those have something new they have not read.
- Reviewed: how many of their replies in the chosen dates were scored.
- Tone and Accuracy: their averages.
Below it, Replies worth a look lists the replies that scored 2 or lower on tone or accuracy, with the AI's sentence and a link to the conversation, so you can coach with a real example.
Quality over time shows each person's tone and accuracy averages by day, week or month, so you can see whether coaching is working. It appears once there are reviews in at least two steps.
Owners see everyone. Other team members see only their own row. The website, channel and agent filters narrow the card.
Common problems
- The card is empty. Quality scoring is off for the websites, or no replies were reviewed yet. Reviews run in the background and wait five minutes after a reply.
- A reply was not reviewed. It may be shorter than about 25 characters, a private note, older than two days, or the AI budget was used up.
- A score seems unfair. The AI only sees the conversation and your knowledge base. If the answer was right for reasons it could not see, ignore the score.
Related
See Reports, roles and permissions, and satisfaction and NPS surveys.