# Replay past assistant answers before you go live

Source: https://frosvo.com/docs/replay-past-assistant-answers
Updated: 2026-11-05

After changing your assistant's instructions or knowledge, ask it your visitors' recent questions again and see which answers improve, change or get worse. Nothing is sent to visitors.

Changing your assistant's instructions or adding an article can fix one answer and break another. Replaying lets you check against real questions before more visitors meet the change. This page is for owners who manage the assistant.

## Before you start

- You must be an owner, and your plan needs the AI assistant.
- The website needs some history. Replay uses the questions the assistant has already received.
- Make your change first, for example edit the assistant's instructions in **Settings → Widget** or publish an article, then replay.

## How do I replay answers?

1. Open **Settings → Websites**, then **Assistant safety check** for the website.
2. In **Replay past answers**, choose the website and **How many questions** (5, 10 or 15).
3. Choose **Replay past answers** and wait while the assistant answers each one again.

## How do I read the result?

A summary line counts the questions, then each one is listed with what happened. The ones most worth your attention come first.

- **Now hands over:** it answered this question before and now steps back to your team. Check whether your change made it less sure.
- **Answers differently:** it answered both times but in clearly different words. Read both answers to see which you prefer. Each row shows **Then** and **Now**.
- **Now answers:** it could not answer before and now can, usually because you added knowledge.
- **Same:** no meaningful change.

Whether two answers are "the same" is judged by how many of their words match, so small rewording does not count as a change.

## When should I use it?

- After changing the assistant's instructions or its name and tone.
- After adding, editing or removing articles and website pages.
- Before and after turning the confidence setting stricter.

Pair it with the [assistant safety check](/docs/assistant-safety-check), which tests known attacks, while replay tests the questions your customers really ask.

## Common problems

- **"There are no past assistant answers".** The website has not had assistant answers yet, or all of them were held for safety.
- **The replay is slow.** Each question is a separate AI call, so 15 questions take a little while. Choose fewer questions.
- **Most answers say Same, but I changed a lot.** Replay asks each question with up to six messages of the conversation that came before it, so follow-ups such as "and how much is that?" are judged in context. Questions that did not depend on your change will, rightly, come out the same.
- **"Replayed a lot this hour".** Replays are limited to a few per hour per workspace. Wait and try again.

## Related

See the [assistant safety check](/docs/assistant-safety-check), the [AI assistant](/docs/ai-assistant), and [AI budget and usage](/docs/ai-budget-and-usage).

## Common questions

### Does replaying send anything to visitors?

No. The questions are asked privately in the background. No message is sent, no conversation changes and nothing is added to your answer history.

### Which questions are replayed?

The most recent different questions your assistant answered or handed over for that website, up to 15. Questions it held back for safety are left out, and a question asked many times is replayed once.

### Does it cost anything?

Each replayed question is one short AI call, charged to your AI budget as a test.
