Usage And Spend
Usage and spend views show how model traffic behaves across projects, keys, and registered models. Use them to understand cost before changing routing policy.
What Olyx Measures
Olyx tracks:
- total requests
- failed requests
- project spend
- key usage
- model spend
- latency trends
- replay deltas
- infrastructure and model-cost split where available
The precision depends on the metadata available from traces and registered model pricing.
Model Pricing
Cost intelligence depends on the model registry. If a model entry has missing or placeholder pricing, usage views may understate cost.
Before relying on spend reports:
- Register every model used by the project.
- Enter input and output token prices.
- Confirm completed traces include model identifiers.
- Review one trace detail page to verify cost is non-empty.
Project Spend
Project spend helps you answer:
- Which project is driving model cost?
- Did a routing change increase spend?
- Are staging workloads accidentally using production models?
- Are private deployment paths being compared fairly?
Use separate projects for staging and production so the monthly view remains readable.
Key Usage
Key usage helps you locate traffic sources.
Use one key per service or environment:
support-api-prod
support-api-staging
replay-worker-prod
If a key suddenly spikes, rotate or disable it and inspect recent traces.
Spend Limits
Spend limits are managed in the dashboard where available. Treat them as operational controls, not as the only defense against unexpected provider bills.
Recommended pattern:
- Set project budgets conservatively during evaluation.
- Watch trace volume and model spend.
- Use routing to move simple work to lower-cost paths.
- Review replay comparisons before changing production routes.
Cost Investigation Workflow
When spend changes unexpectedly:
- Open Usage to identify the project or key.
- Open Spend to inspect model-level cost.
- Open recent traces for that project.
- Check selected models and routing decisions.
- Queue replay comparisons against lower-cost model paths.
- Update routing only after the comparison is acceptable.
Next Steps
- Use Model Registry to keep cost metadata accurate.
- Use Routing to reduce unnecessary expensive calls.
- Use Traces and Replays to compare changes.