FlowsBook a callSign inCreate free accountSign up
AI employees and automation

A WhatsApp assistant that understands voice notes and talks back

Hold the mic, ask your AI employee a question, and get a spoken answer in the same chat. How a whatsapp voice note ai assistant works in xMap Flows, and where it stops.

Part of the guide AI employees

By the xMap team · · 5 min read

A whatsapp voice note ai assistant lets you speak instead of type: you hold the microphone in WhatsApp, say what you want, and the assistant turns your recording into words, works out the answer and replies with a voice note of its own, plus the written words underneath. In xMap Flows that assistant is Ask xMap on xMap's WhatsApp number, and any of your own Chat flows you choose to talk to. It can tell you what your AI employees found overnight, look up what is around you, or start a change you then confirm with a tap.

This is for people who run AI employees but are rarely at a desk: field sales reps between visits, area managers driving from store to store, owners who think of a question while walking. It explains what happens to a voice note, what you can ask, a made-up day in Nairobi, the limits worth knowing, and how to set it up.

What happens when you send a voice note

  1. You record a voice note to xMap's WhatsApp number from a phone number you confirmed in Settings, Your WhatsApp.
  2. Your words are written out by speech recognition. The answer you get back starts with what was heard, so you can see straight away if it misunderstood a name.
  3. Ask xMap reads the question as if you had typed it, working as you in your own organization: it can read your flows, runs and results, and the places data your flows use.
  4. Because you spoke, the reply comes as a voice note as well as text. Links, files and place pins come as their own messages under it.

If you send three short voice notes in a row, it waits a few seconds after the last one and answers them together, the way a colleague would rather than replying to half a sentence.

Things people ask out loud

  • What did my pharmacy scout find this morning? A short summary of the latest run, and the list as a file if you ask for one.
  • Why did the Toronto cafe flow fail? It reads the run and says which step stopped and why.
  • Add Lyon to my bakery watcher. It prepares the change and sends Yes and No buttons. Nothing changes until you tap Yes.
  • Remind me to call the Westlands clinic at four. A reminder that arrives on WhatsApp at four, in your time zone.
  • Share your location, then say which hardware stores are near me? It searches around the pin and sends the nearest as places you can open in your maps app.

Talking to one of your own AI employees

Ask xMap answers by default. If you have built a flow that starts with the Chat block and has Chat from my WhatsApp switched on, you can speak to it directly. In the voice note, say "at" and its name, or "ask" and its name, then your question: ask site advisor, is the corner on Ngong Road close to any gyms? That flow keeps answering what you say next, so you name it only once. Say "talk to xMap", or start with "xMap", to go back to Ask xMap; after three quiet hours it goes back by itself.

Behind the Chat block, an AI agent with tools such as Nearby places or Weather forecast does the looking up, and its answer comes back on WhatsApp. If you spoke, it answers by voice too.

A made-up day in Nairobi

The person and everything she asks are invented. Wanjiru is an area manager for a chain of phone accessory shops in Nairobi, with an AI employee that watches for new electronics shops near her stores and another that sends a weekly report.

  • 7:40, in a taxi. She records: anything new near my stores? The voice note back says two electronics shops were newly found this week, one near the Kilimani store, and the written list arrives under it.
  • 11:15, after a store visit. Ask site advisor, what is within five hundred metres of the Thika Road mall? Her own Chat flow answers with a short voice summary and a list of places.
  • 15:30. Send the weekly report to Brian as well. Yes and No buttons arrive. She taps Yes when she reaches the next store.
  • 18:05. Remind me tomorrow at nine to review Kilimani. Done, by voice, in one sentence.

She never opens a laptop that day, and nothing changed without a tap from her.

Where it stops

  • Only your own confirmed number. It answers people whose number is confirmed in their xMap Flows account. Your customers cannot reach your flows on xMap's number; for them you connect your own WhatsApp Business number.
  • Noisy places. Speech recognition does well with normal speech and struggles with loud traffic or several voices. The heard words at the top of each answer show you if something went wrong.
  • No spoken confirmations. Changes and sends wait for the button, always.
  • Your company's rules apply. An admin can switch Ask xMap on WhatsApp off for the organization, or limit it to answering questions only.

Setting it up

  1. In the app, open Settings, Your WhatsApp, add your number with its country code, and type the code that xMap's WhatsApp number sends you.
  2. Send a voice note to that number: what did my flows find this week?
  3. To talk to an AI employee of your own, open its flow, start it with the Chat block, switch on Chat from my WhatsApp, and deploy it. A ready one: the template WhatsApp assistant with live places.
  4. Optional: in Settings, Notifications, switch on the morning briefing on WhatsApp, and reply to it by voice.

This is one of several ways to run your AI employees without a desk; the AI employees guide covers the others.

Questions

Which languages can I speak in?

Speech recognition handles many languages, and Ask xMap answers in the language you use. Names of small places and businesses are the most common thing to be misheard, so check the heard words at the top of the reply.

Is my voice note kept?

Your words are turned into text and the conversation is kept for a week so follow-up questions make sense. Files you send are kept two hours.

Can my customers send voice notes to my AI employee?

Not on xMap's number, which answers only confirmed users. Connect your own WhatsApp Business number and build a flow with an AI agent and Reply for customers.

Can it do something just because I said so?

It can answer questions and read your data straight away. Anything that changes a flow, sends a message or spends credits waits for you to tap Yes.

Templates that do this

Read next

More on ai employees and automation · Every article · Templates

Put it to work

An AI employee in xMap Flows does this on live data, on its own timetable. Start from a template or describe it in plain words.