About

Model choice became an infrastructure problem. We treat it like one.

Our mission

We spent years shipping LLM features and watching the same pattern repeat: a team picks the strongest model during prototyping, ships it, and then discovers that most of their traffic never needed it. Classification, extraction, short summaries and repeat questions were being billed at frontier rates.

Fixing it by hand meant writing routing logic, keeping a model matrix current, adding a cache, then adding failover when a provider had a bad afternoon. Every team was rebuilding the same layer, badly, and rewriting it each time a new model shipped.

Thalera is that layer, maintained as a product. One endpoint, a policy you control, and a model landscape that stays current without you touching it.

61%

Median inference cost reduction across pilot workloads

43ms

Added p50 routing latency

99.98%

Request success rate during provider incidents

30+

Models reachable through one endpoint

What we optimize for

01

Cheapest capable, never cheapest possible

A wrong answer at a tenth of the price is not a saving. Every routing decision starts from a quality floor you define, and only then optimizes cost.

02

No lock-in, by construction

You keep your provider accounts and your rates. Thalera is a decision layer, not a reseller. Removing us is a one-line change back.

03

Explain every decision

Routing you can't inspect is routing you can't trust. Each response carries the model chosen, the reason, the cache status and the exact cost.

04

Boring where it matters

An OpenAI-compatible API, predictable failover, no surprise migrations. The interesting work happens behind a very dull interface.

The team

A small distributed team of infrastructure and ML engineers, previously building inference platforms, API gateways and data pipelines at scale. We are hiring across routing, evaluation and developer experience.

Get in touch