ai newsMo., 19. Okt.
EilmeldungInside Prometheus: Meta’s Journey to a Gigawatt-Scale Supercluster

Voicing AI Owns the Runtime Beneath Enterprise Customer Service

Discover how Voicing AI builds an enterprise voice runtime with sub-second latency, grounded answers, multilingual support, and flexible deployment options.

HackerNoonMontag 10:16 · 19.10.5 Min. Lesezeit
Bild: HackerNoon

Signup Write New Story Voicing AI Owns the Runtime Beneath Enterprise Customer Service by Jon Stojan Journalist by Jon Stojan Journalist | @ jonstojanjournalist Jon Stojan is a professional writer based in Wisconsin committed to delivering diverse and exceptional content..

Jon Stojan is a professional writer based in Wisconsin committed to delivering diverse and exceptional content..

Building a voice agent is no longer the hard part. A speech API, a hosted language model, a synthetic voice, and a phone number will produce something that answers a call and demos well enough to get budget approved. What that assembly cannot do is survive contact with a real phone network, a real security review, or ten times the pilot volume.

Voicing AI, the enterprise voice runtime for Fortune 2000 companies, was built on the opposite bet. Rather than assembling a product above other vendors' services, it owns every layer on the conversational hot path — speech recognition, turn-taking, the action models that decide what to do, speech synthesis, transport, and the context layer that grounds every answer.

“Most of the market is competing at the application layer, where the work is now a weekend of assembly,” says Abhi Kumar, co-founder of Voicing AI. “We went down the stack instead. Latency, entity accuracy, grounding, cost per minute, and where the software is allowed to run are all decided beneath the agent. That layer is the product.”

Kumar's career in enterprise software and venture capital includes roles at Oracle, Microsoft, and M12, Microsoft's venture arm, where he evaluated and invested in enterprise technology companies globally. He learned where AI projects stall while assessing which technologies actually reached enterprise adoption. At Voicing AI, that knowledge shaped a platform designed to support production reality in banking, healthcare, telecommunications, and aviation – not just provide a great demo.

Human conversation runs on a roughly 200-millisecond gap between speakers. Production voice AI commonly lands between 2 and 2.5 seconds because an assembled chain inherits the sum of its vendors' latencies plus the network hops between them.

Voicing AI runs at a 700-millisecond median and 850 milliseconds at the 95th percentile, measured over real telephony on production banking deployments.

“That gap isn't a faster component; it's a systems decision,” Kumar says. “Every stage gets a budget of tens of milliseconds, and stages overlap where possible — synthesis starts on the first completed sentence while the model is still generating. And we replaced silence-based turn detection with a decision that combines acoustics, partial transcription, and look-ahead – a decision that cut false interruptions by around 45%.”

The same ownership shows up where enterprise conversations are won or lost. Voicing AI's action model — eight billion parameters, fine-tuned on voice-transcribed conversation rather than clean text — reaches 97% function-calling accuracy, and is small enough to serve on a hybrid CPU infrastructure at conversational speed. On telephony card-number capture, parallel recognition consensus validates formats and utilizes confidence-gated read-back to deliver 99.2% accuracy across 12,400 utterances.

Enterprise agents rarely fail because the model is weak. They fail because the right knowledge never reached them in time.

Knowledge Mesh is Voicing AI's answer — a context layer built to the same latency budget as the rest of the runtime. Three retrieval engines run in parallel across vector, knowledge graph, and full-text search, with agentic multi-hop traversal for questions whose answers must be determined based on relationships and not similarity. Retrieval, organization, and selection complete inside a sub-250-millisecond window, so grounding happens mid-call rather than after it.

“Most platforms bolt retrieval after the agent already exists,” Kumar says. “Not our agents. They were engineered to consider the context layer from day one. Every answer carries its source along with a relevance score, proper citation, guardrails are enforced before context ever reaches the model, and every turn leaves a provenance record. In a regulated contact center, an answer you can't trace is an answer you can't use.”

Language is handled inside the stack, not outsourced to it. Voicing AI provides native-quality real-time translation across more than 30 languages. Neural translation preserves the speaker's intent, their tone, and the context of their message, all of which ensure the urgency of a message and its empathy survive the language change. Domain-trained models cover the unique needs of an organization’s specific industry, including HIPAA-compliant patient-provider communication for healthcare organizations and similar targeted communication for financial institutions and legal firms.

Brand voice runs on the same principle. Neural voice conversion maps a reference voice onto every agent response, with prosody extraction that captures the rhythmic signature of the brand, disfluency suppression that removes filler and artifacts, and a style-tone controller that applies brand-defined emotional registers before a low-latency vocoder produces the final waveform.

“Generic text-to-speech is content without character, and it erodes brand equity on every call,” Kumar says. “A Fortune 2000 enterprise should sound like itself in every language, every time zone, at any volume.”

Voicing AI's observability covers real-time audio quality and live hallucination detection. It also provides insights on function-calling success rates, token consumption, governance, auditability, traceability, and brand playbook adherence. Combined, these observability features give operations teams the signal to intervene, reroute, or escalate before customers feel a problem.

Deployment is where owning the stack is a benefit that becomes commercial. Because the models and the inference path are Voicing AI's own and run CPU-native, the platform ships in the form of container images and a Helm chart into fully air-gapped on-premises environments, a customer's own cloud tenancy, or a managed service — from one codebase and one control plane, with no GPU procurement in the critical path.

“Enterprises don't buy a demo; they buy something their CISO signs off on, and their CFO can still afford at 10 million minutes,” Kumar says. “That only works if you own the layer underneath.”

This story was distributed as a release by Jon Stojan under HackerNoon’s Business Blogging Program.

The Morris Worm Didn’t Break Anything. It Just Couldn’t Tell It Had Already Been There

Ruwiki and the Digital Echo Problem: Why AI Needs Better Sources, Not Just Fresher Data

Quelle: HackerNoon (HackerNoon). Original öffnen