FlowsBook a callSign inCreate free accountSign up
Building flows

Test your AI employee’s answers: the Quality panel

Test cases, ratings of answers, two versions side by side, and a daily watch of answer quality.

By the xMap team · Updated

Open it in the app

Every flow has a Quality panel: open the flow, then the ... menu, Quality: tests and feedback, or press the Tests score on the editor’s bar. It has four tabs.

Tests

  • Add a message a customer would send (with earlier messages of the conversation if you like), or an input for flows that do not chat, and say what a right answer is: words it must say (a | b for either), words it must never say, what xMap AI should check in plain words, or, for flows that find things, how many items, a field every item must have, or an item by name. Up to 25 tests a flow.
  • Run all tests shows the price first, then runs each as a test run: nothing is sent and nothing is remembered. Each test shows Passed or Failed and why.
  • The score on the editor’s bar says when the flow changed since the tests last ran. Switch on Remind me before Deploy and Deploy asks you once when the tests are out of date or failed.

Feedback

People can give a thumbs up or down under each answer on your chat page and in the editor’s Chat with this flow, and on WhatsApp by replying to a Chat flow’s answer with a thumbs or words such as "bad answer" and what was wrong. The tab lists them; Turn into a test makes a bad one a test in one click, or Dismiss it.

Compare

Pick an older version (or the one before your last change) and run both on your tests or your last real chats. You see both answers side by side, with what passed, the items, credits and time, and how many differ. The price is shown first.

Watch

The flow’s owner or an admin can switch on Watch answer quality for a flow that chats or has tests. Once a day xMap AI scores up to 20 real answers of the last day against three rules (it follows its instructions, stays on topic and invents no facts) and the tests you mark for the watch. The tab draws the score of each day, the rules broken most and the worst answers. When the score drops, you get a notice and an email with the likely cause. Each answer it checks uses a few credits.

Viewers can read the panel; people who may change the flow add, run and compare.

Templates that use these blocks

Related articles

Still need help?

Ask xMap in the app answers from this help and your own flows. Our team is one message away.