Benten is open-source observability for Voice AI. We listen to the actual conversation — the latency, the silence, the interruptions — so you hear what your customers hear.
MIT licensed · Self-hosted · No hosted service, no lock-in
Two conversations can say the exact same words. The difference isn't language — it's rhythm. Benten measures the rhythm.
Instant
100msFeels like a person.
Conversational
400msYou barely notice it.
Slow
1200msSomething feels off.
Broken
2500ms"Hello?…"
Your customers never read the transcript. They hear the pauses, the interruptions, the dead air. Words are not the product. Timing is.
What the transcript shows
User: I'd like to change my flight.
Agent: Sure, I can help with that.
Looks perfect. Ship it.
What Benten hears
User: I'd like to change my flight.
Agent: Sure, I can help with that.
The customer already thinks the call disconnected.
Every voice provider grades their own homework. Benten is an independent layer of truth above ElevenLabs, Vapi, and Retell — so you can compare providers fairly, and see what actually shipped.
Your provider dashboard
Says: "Everything is healthy."
What Benten measured
Reality: Your customers are hanging up.
Every delay changes perception. 100ms feels instant. 400ms feels human. 1,200ms feels slow. 2,500ms and they think the line dropped.
Cloud providers monitor servers. Voice providers monitor APIs. Neither monitors conversations — and conversations are what your users actually experience.
Your QA team never notices these — they're not crashes, they're half-second hesitations. The bugs your customers notice first are the ones your logs never record.
The silence that makes callers think you dropped.
When the model cuts the human off mid-word.
When the human has to talk over the assistant to be heard.
The gap from human-stop to agent-start, in milliseconds.
Line quality, distortion, and background artifacts.
The two-people-talking-at-once moments.
ElevenLabs says one thing. Vapi shows another. Retell exposes something else. Benten sits above all of them and gives you one timeline, one set of metrics, one truth.
ElevenLabs
Their version
Vendor-graded metrics
Vapi
Their version
Vendor-graded metrics
Retell
Their version
Vendor-graded metrics
Benten
One conversation. One timeline. One truth.
Some feel effortless. Some feel awkward. Some make people hang up. Benten shows you exactly why — the shape of every call, the moment it went wrong, the millisecond it fell apart.
"That felt weird" has a cause.
Too much silence. Interruptions. Talking over people. Bad pacing.
Benten measures the moments that make conversations feel human.
Benten is 100% open source. Clone it, run it on your own infrastructure, and own your voice observability stack end-to-end. We don't run a cloud. We don't want your call audio.
$ git clone github.com/ayusrjn/benten $ cd benten $ docker compose up → syncing agents from ElevenLabs... → syncing agents from Vapi... → syncing agents from Retell... ✓ 34 agents discovered ✓ listening to conversations ✓ dashboard live at localhost:3000