Skip to main content
fanout

Calculations run on this device. Scenario values are not sent anywhere — the engine is fully local.

inference calculator · free

Model Router & Pareto Explorer

Plot models on price/quality axes and route each request class to the frontier.

Which model sits on the cost–quality frontier for this traffic?

Engine 1.0.0 · calculation
0.5
10
0100
12
Blended $/1M
$2.40
Est. quality
72.4
Cost vs all-strong
24%
Routed strong
20%

Route only hard traffic to the frontier model — Pareto on cost/quality.

20% strong @ $10

Method

  • Deterministic local model of the mechanism — knobs recompute outputs instantly with no network.
  • Numbers are teaching approximations, not production capacity guarantees.

Sources

Keep going in inference

inference calculatorKV Cache CalculatorWhy do long context and batch size compete for the same GPU?inference calculatorGPU Model FitDoes this checkpoint actually fit on that GPU?inference calculatorLatency Numbers Every Engineer Should KnowWhich operation dominates this request's budget?