Your AI Voice Agent Passed Its Lab Test, Will It Survive In The Wild?
Reported by Forbes1 source ↓
Klearcom CTO Satish Barot argues that lab benchmarks may not reflect how voice agents perform over real phone networks. He points to reliability concerns in production and calls for testing through deployed numbers in the markets agents serve.
Key points
- AssemblyAI’s 2026 survey found 75% of more than 450 builders struggled with production reliability
- A retailer piloting an agent reported replies taking up to five seconds
- A healthcare company said one prompt change affected 42 other call flows
- Barot says deployed-agent tests should use local carriers and repeat after changes
- Barot says it can be difficult to tell whether silence comes from the carrier or agent vendor
Details
Forbes contributor Satish Barot, Klearcom’s co-founder and CTO, says lab tests using clean audio and direct connections can miss problems callers encounter through mobile codecs, noisy surroundings and local phone networks. He cites AssemblyAI’s 2026 survey of more than 450 builders: 82.5% said they were confident building voice agents, while 75% reported struggling with technical reliability in production.
Barot describes a retailer piloting an agent in one country before expanding to others. Its team tested calls manually, and callers reported waits of up to five seconds. He also recounts a healthcare company’s report that a shared prompt change altered 42 other call flows before the issue was noticed; a pharmaceutical team told him it was not ready to use agents on adverse-event numbers.
Barot says his company tests deployed agents by calling their real numbers from local fixed and mobile networks, using varied accents, noise, interruptions and language switches. It scores response time, audio quality, intent, task completion and invented answers, and treats violations of hard rules as failures regardless of the overall score. He notes that determining whether silence came from a carrier or an agent vendor can be difficult, and that connecting to different agent platforms requires separate integration work.
Written from coverage as of
Images
- Forbes