When a customer was told the wrong price or the wrong number of days, the first question is where the assistant got it. This page is for the people who manage the assistant and review its answers.
Before you start
- You need the AI assistant and a knowledge base, so the assistant has passages to read. See the AI assistant.
- The record is kept for answers written from now on. Older answers show no evidence.
How do I see why an answer was given?
- Open a conversation the assistant answered.
- Under the assistant's message, choose Why this answer.
- Read the panel. It lists each passage the assistant read, with the title, a short excerpt, a link to the page when there is one, and the time of the answer.
What do the labels mean?
- Unchanged since the answer: the source is the same as when the assistant read it.
- Changed since the answer: someone edited or refreshed the source afterwards. The excerpt shown is what the assistant actually read, so you can compare it with the current text.
- Removed since the answer: the source was deleted.
- Revision not recorded: the source had no stored version when the answer was written.
If the answer states a number, price, percentage or date that appears in none of the passages, the panel says so and lists those figures. Check them before relying on the answer. A figure the visitor wrote themselves is not counted as the assistant's claim.
What happens on a STRICT site?
In Settings → Widget, open the website and look at When the assistant answers. If it is set to Only when the knowledge base clearly covers it (the strict setting), and the answer contains a figure that none of its sources contain, the assistant does not send it. A person takes the conversation, and the reason shows as unsure in reports. On the other setting the answer is sent and flagged for your review.
How do I report a wrong or outdated answer?
In the panel, choose This answer is wrong or outdated. The answer is marked as wrong in your answer review, with a note naming any source that has changed or been removed. From the review you can teach the assistant the right answer. See replaying past answers to check the fix against real questions.
Common problems
- There is no Why this answer button. The answer was written before evidence was recorded, or the assistant did not read any knowledge.
- It says "Revision not recorded". The source predates version tracking. Refreshing or re-importing it records one.
- It lists figures as unsupported but the answer is right. The assistant may have worked a figure out, such as a total. Add that wording to your knowledge base so it is stated in a source.
- The excerpt looks short. Only the start of each passage is kept, not the whole page.
Related
See the AI assistant, the assistant safety check, replaying past answers, and reports.