About
We’re building the LLM gateway you can put in front of a diligence team.
TokenTriage’s brand — and its moat — is honesty. In a category that competes on provider count and throughput, we compete on trust: provenance, quality-proven routing, and a dashboard where every number survives an audit.
The mission
Teams are spending more on inference than ever and can explain less of it. The obvious fix — switch to a cheaper model — keeps getting rolled back, because nobody can prove the cheaper path held quality. So spend stays high and trust stays low.
Our mission is to make LLM cost legible and safely reducible: to show where every dollar goes, and to cut the bill only after the cheaper path is proven just as good — with evidence you can audit. The product would rather say “I can’t prove that” than show you a pretty lie.
Why now
Three things changed at once
Spend went vertical
Agentic workloads multiplied token consumption. Inference is now a top line item, and it grows faster than the usage that drives it.
The tooling optimizes blind
Gateways compete on provider count and throughput. Few can tell you, with evidence, whether a cheaper route held quality.
Local-first is now a feature
After a wave of acquisitions, an Apache-2.0, local-data gateway is not a preference — it’s an exit-proof, diligence-friendly choice.
The vision
The decision plane
A router is the first step. The destination is the decision plane: for every workload, the cheapest LLM execution plan that can be shown to meet its quality, latency, cost, and policy requirements. Not “cheaper on average,” but cost reduction with bounded risk and defensible evidence — a control plane that treats a quality guarantee the way a database treats a transaction.
Everything we ship today — the ledger, the shadow report, the honesty verdict — is a building block for that: the evidence layer a decision plane needs to be trusted.
Principles
What we hold ourselves to
Provenance over polish
Every number carries its lineage. We would rather show an ugly “UNPRICED, excluded” than a tidy, wrong $0.00.
Refuse before you fabricate
When the evidence can’t support a claim, the product says so. A refusal is a feature, not a failure.
Off the hot path, always
Visibility must never become a liability. A dead dashboard is invisible to your traffic; errors fail open.
Open core, honest gates
The free product is complete, not a teaser. Paid value is additive, never a fork — and the honesty invariants apply at every tier.
The project
TokenTriage is open source under Apache-2.0 — one self-contained binary with the dashboard baked in. The trust artifacts (the ledger, verdicts, provenance, the shadow report) are the brand, and they stay free. The code is the argument: read it, run it, and check every number for yourself.
Building something here, evaluating for your team, or investing? Get in touch.
Read the code. Check the numbers.
The fastest way to trust an honesty-first product is to audit it yourself.