Skip to main content
DeepInfra serves open models through an inference API, priced per token or per second of compute depending on the model. CostGraph reads DeepInfra as FOCUS 1.2 records at a grain of one record per model per pricing interval per month.

​
Choose how the data reaches us

CostGraph pulls it

You supply read-only credentials and we call DeepInfra once a day. Nothing to run.

You push it

You send us FOCUS records over the API. Credentials never leave your infrastructure.

​
Before you begin

  • In the DeepInfra dashboard, open API keys and create a key.

​
Let CostGraph pull

  1. Open Settings > Integrations and pick DeepInfra.
  2. Name the connection and pick the tenant these charges belong to.
  3. Enter the values you copied. The form lists what DeepInfra needs and marks the optional ones.
  4. Select Connect.
CostGraph verifies the credentials with a short fetch before saving, so a wrong value or a missing permission fails while you are still on the form.
Credentials are encrypted at rest and used only to read billing data. Revoke them in DeepInfra at any time and the connection stops; nothing else is affected.

​
Push it yourself

Send the charges to CostGraph as FOCUS records instead. Push FOCUS data covers the connection id, the focus:write key, and the request shape.

​
Run the exporter

Rather than build that request yourself, run our exporter. It reads DeepInfra on a schedule and pushes the records for you, wherever you want to run it: a container, a Kubernetes CronJob, or a binary on a machine you already have.
Your DeepInfra credential stays where you put it, and only the finished FOCUS records reach CostGraph. Run the exporter covers the three ways to run it and the variables it reads.

​
What CostGraph does with it

Records land as raw billing rows, are normalised into line items, and roll up into daily cost. From there DeepInfra spend appears in Cost Overview and in anomaly detection alongside every other provider. DeepInfra reports spend monthly. Spend is split per model, so you can see which models drive the bill and compare them with the same work on other providers.