Meihaku

AI support launch audit

Know which customer questions your AI support agent is cleared to answer before launch

Meihaku audits your help center, tickets, macros, and policies against real support intents, then shows which questions are cleared for AI, which must route to a human, and which sources need fixing before launch.

AI support launch audit · click to watch the overview

Product overview

Separate AI-ready questions from human-only, blocked, and unsupported topics.

The audit loop is deliberately narrow: connect the knowledge you already have, map it to customer intents, resolve blockers, then approve only the answers your team can defend.

01

Connect

Docs, tickets, macros

02

Map

Real customer intents

03

Decide

Answer, block, or route

04

Clear

Source-backed answers

Step 01

Connect read-only support sources

Point Meihaku at the docs, tickets, macros, and notes your team already relies on.

Meihaku sources screen showing connected Google Drive and Zendesk source bundles

Step 02

Map intents to answer decisions

See which customer questions are cleared for AI, blocked, conflicted, or must route to a human before your AI support agent handles them.

Meihaku topics screen showing billing, plans, and account-management intents with gap, answered, and conflict labels

Step 03

Resolve source conflicts before approval

When two sources disagree, reviewers see both claims side by side and choose the canonical answer.

Meihaku conflict screen comparing two refund-window sources

Step 04

Clear the answers for launch

Only source-backed answers become clearable for the downstream agent your team is about to launch.

Meihaku answer screen showing an approved service outage answer with supporting evidence

Why readiness comes first

Every unsupported AI answer becomes your company’s answer.

If the source knowledge is missing, stale, or contradictory, your AI agent can still answer with confidence. Meihaku turns source risk into explicit decisions: cleared for AI, human handoff required, blocked topic, or source fix needed.

  • Air Canada

    Tribunal ordered the airline to honor a bereavement-fare policy its chatbot invented. C$812 + ruling that the chatbot is part of the website.

    Moffatt v. Air Canada, BCCRT 2024
  • Cursor

    Support bot “Sam” invented a one-device-per-subscription policy that did not exist. Subscription cancellations followed.

    Fortune, April 2025
  • DPD

    Chatbot swore at a customer and wrote a poem calling DPD “the worst delivery firm in the world.” 1.3M views on X.

    TIME, January 2024

“Air Canada is responsible for all of the information on its website, regardless of whether said information comes from a ‘static’ webpage or a chatbot.”

BC Civil Resolution Tribunal, Moffatt v. Air Canada, 2024 BCCRT 149. Read the decision

Readiness, not chat

Audit the sources. Clear the answers. Launch with evidence.

Most teams discover the real work after the chatbot project starts: outdated docs, conflicting policies, missing answers, and tribal knowledge trapped in tickets. Meihaku turns that cleanup into a structured answer-clearance workflow.

Point Meihaku at your sources

Connect read-only docs, tickets, macros, and notes. Meihaku keeps citations tied to source evidence.

Meihaku surfaces the questions customers actually ask

It matches real intents to source evidence, drafts cited answers, and flags the gaps and conflicts blocking safe automation.

You clear the answers

Review each draft with sources attached. Cleared intents can move toward AI automation. Unsupported intents stay blocked or routed to a human.

Built for the support manager carrying launch risk

Launch with approved knowledge, not hopeful retrieval.

Cleared for AI

See which intents have cited, reviewed answers your AI support agent is cleared to use.

Human handoff required

Mark account-specific, high-risk, or judgement-heavy questions as human-owned before launch.

Blocked topic

Keep unsupported intents out of automation until the source evidence exists.

Source fix needed

Turn stale, conflicting, or incomplete sources into fix work before AI automation expands.

Frequently asked

Questions support and compliance teams ask before they buy.

How do I stop my AI support agent from hallucinating?

Hallucinations usually happen when the model can’t find a clear answer in the source material it retrieves from. Meihaku audits your support docs, tickets, macros, and notes for the gaps and conflicts that force the model to guess, then gates which intents your agent is cleared to answer. Many teams pair Meihaku as the pre-flight check with runtime tools like Cleanlab or Ada-style monitoring as the in-flight safety net.

Why is my AI agent hallucinating?

Three common patterns: (1) gaps — the customer asked something not covered in any source, so the model fills in plausible-sounding nonsense; (2) conflicts — one support source says one thing and another says something else, and the model picks the wrong one; (3) stale or out-of-date content. Meihaku surfaces all three before launch so you can fix them rather than ship them.

What helps reduce AI hallucinations in customer support?

A two-layer approach. Pre-flight audits (Meihaku) catch the gaps and conflicts in your sources before the AI agent ever has to retrieve from them. Runtime monitoring (Cleanlab, Ada, others) catches the residual hallucinations that slip through. The fastest single improvement is usually source cleanup — no amount of runtime checking can save you from a knowledge base the model can’t retrieve clearly from.

I haven’t picked an AI support agent yet — is Meihaku still useful?

Yes — and it’s the cleanest case to start with. Meihaku audits your support knowledge before you commit to a vendor. You’ll know in advance which intents are well-supported, which need source cleanup, and which can’t be answered safely by any agent. Most teams find the audit changes which agent they pick, because some handle gap-prone intents better than others.

How is Meihaku different from AI support agents like Intercom Fin or Decagon?

Meihaku is the readiness layer that runs before and alongside AI support agents, not a replacement. Tools like Intercom Fin, Decagon, Sierra, and Maven generate answers at runtime. Meihaku audits whether your knowledge base actually supports those answers in the first place, surfacing conflicts, gaps, and ungrounded intents before they reach a customer. Most teams use Meihaku to pre-flight an AI agent rollout, then keep it running as a governance layer.

How is Meihaku different from runtime monitoring like Cleanlab or Ada?

Cleanlab and Ada-style runtime tools score AI responses as they’re produced and can block bad outputs in real time. Meihaku works one layer earlier: it audits the source knowledge your AI agent retrieves from, so the bad answer never gets generated in the first place. The two are complementary — Meihaku as the pre-flight check, runtime tools as the in-flight safety net.

What sources can Meihaku read today?

Google Drive folders containing your support policies, SOPs, macros, and FAQ docs, plus Zendesk source bundles. Intercom, Notion, Confluence, and broader helpdesk connectors are on the near-term roadmap. Meihaku connects read-only and never writes back to the source — what you see in the audit is exactly what your team approves.

Does Meihaku replace my AI support agent?

No. Meihaku is complementary. Your AI agent (Fin, Decagon, Sierra, custom) still answers customers. Meihaku decides which intents are cleared for that agent to handle, with cited evidence, and exports the approved answer set. Unsupported or conflicting intents stay out of automation until your team has source evidence or a handoff path.

Can my team approve answers before customers see them?

Yes — that’s the core workflow. Meihaku drafts cited answers from your sources, your team reviews each one with the source line attached, and only cleared intents move toward automation. Nothing reaches production until you greenlight it.

How do you detect conflicts between policies and macros?

When the same intent (for example, the refund window for international orders) resolves to different answers across support sources, Meihaku flags it as a conflict and shows both source lines side-by-side. Your team picks the canonical answer, which becomes the approved version exported to your AI agent.

What if my knowledge base is a mess?

That’s the most common starting point — and exactly what Meihaku is designed for. You don’t need to rewrite anything before connecting. Meihaku reads what you have, drafts cited answers from the strongest evidence, flags gaps and conflicts, and lets your team triage them in priority order. The first audit usually surfaces the small set of intents blocking most of the customer-risk conversations.

How long does setup take?

Connecting a read-only source takes minutes when credentials are ready. The first useful launch audit depends on source volume, but the workflow is designed so teams can start with one high-risk folder or ticket bundle before expanding the review.

Is my support data used to train AI models?

No. Customer data is processed in your isolated workspace. We don’t train foundation models on your content, and we don’t share data across customers. Source content is processed transiently and not retained beyond what’s needed for citations.

Know what your AI can answer before customers ask.

Connect support knowledge read-only. Meihaku finds the gaps, conflicts, and human-only routes, then helps your team approve what the AI is cleared to say.

Run a launch audit