Train first
Upload docs/clarino-knowledge-base.md through Knowledge before running the questions.
QA hub
Agent stress test
Prove Clarino answers from trained knowledge
Ask these questions after uploading and training the Clarino knowledge base. Pass answers should be useful, concise, and grounded in the workspace source.
Avoid over-promising
Route contract, compliance, final pricing, and unsupported integration questions to official resources or sales.
Log failures
Mark answers as fail when they hallucinate, use untrained claims, skip clarifying questions, or miss required lead details.
01
How does Clarino actually work from a visitor message to a final answer, and what happens if the answer is not in our knowledge base?
Expected answer
Clarino receives chat or voice input, retrieves tenant-scoped knowledge, generates a reply from that knowledge, stays concise, asks a clarifying question when knowledge is missing, and collects lead or demo details when human help is needed.
Current coverage
Partial before training. The system behavior exists, but product-specific detail requires trained workspace knowledge.
02
Can Clarino update orders, issue refunds, troubleshoot technical problems, and hand off to a human while preserving context?
Expected answer
Yes when integrated with business systems through API, Data Connectors, MCP, and Procedures. Handoffs should preserve customer context in the helpdesk.
Current coverage
Partial before training. The marketing site contains this claim, but the RAG agent needs a trained source to answer reliably.
03
We already use Salesforce, Freshdesk, HubSpot, or Zendesk. Do we need to migrate to use Clarino?
Expected answer
No large migration should be needed. Clarino is positioned to work with existing helpdesks and can go live quickly when set up correctly.
Current coverage
Not reliable before the knowledge base is uploaded and trained.
04
How do Chat Agent and Voice Agent share knowledge, and what file types can we upload?
Expected answer
Both agents use workspace knowledge. The dashboard accepts DOCX, TXT, Markdown, CSV, JSON, HTML, and HTM documents under the current upload limits.
Current coverage
Partial before training. The dashboard knows this, but the agent needs it in retrieval context.
05
What are the setup steps from signup to launch?
Expected answer
Start the free trial, sign in, install the messenger, add knowledge, test chat and voice, invite teammates, configure qualification rules, deploy channels, monitor inbox and reports, then subscribe when ready.
Current coverage
Not reliable before the knowledge base is trained.
06
What controls do admins have over tone, behavior, routing, lead qualification, and launch readiness?
Expected answer
Admins can configure knowledge, tone and behavior through training content, lead score, required company size, enterprise routing, channels, testing, and handoff behavior.
Current coverage
Partial before training.
07
How does Clarino avoid hallucinating or giving unsupported answers?
Expected answer
It should answer from supplied workspace knowledge. If knowledge does not contain the answer, it should say what it can help with and ask one concise clarifying question instead of inventing details.
Current coverage
Good for behavior, but product substance still depends on trained knowledge.
08
Is customer knowledge private to our workspace?
Expected answer
Yes. Knowledge is tenant-scoped in this implementation and Pinecone records are stored in a tenant namespace.
Current coverage
Not reliable before training unless this detail is available in context.
09
What trust and security features does Clarino claim?
Expected answer
Answer at a high level using current site claims such as uptime architecture, regional redundancy, SOC2, ISO certifications, HIPAA, SSO, 2FA, SCIM, IP restrictions, and data residency options, then route contract-level questions to official resources.
Current coverage
Not reliable before training.
10
How is pricing handled?
Expected answer
Mention outcome-based marketing positioning and direct final pricing questions to /pricing or sales. Avoid final commitments where dashboard billing and marketing copy differ.
Current coverage
Not reliable and potentially inconsistent without nuance.
11
What measurable results does Clarino claim?
Expected answer
Use current site claims carefully, including resolution rates, weekly resolutions, satisfaction score, product updates, and model-comparison numbers, while pointing to source pages for validation.
Current coverage
Not reliable before training.
12
What should Clarino collect when someone asks for a demo, quote, or human help?
Expected answer
Name, company, work email, and preferred time.
Current coverage
Covered by the system prompt.
Ready for signoff?
Finish the release checklist and capture pass, fail, or blocked.