Skip to main content
RespanAI is an LLM gateway and observability layer, so one connection captures request spend across every model and upstream provider you route through it. Formerly KeywordsAI. CostGraph reads RespanAI as FOCUS 1.2 records at a grain of day x model x upstream provider (request spend).

​
Choose how the data reaches us

CostGraph pulls it

You supply read-only credentials and we call RespanAI once a day. Nothing to run.

You push it

You send us FOCUS records over the API. Credentials never leave your infrastructure.

​
Before you begin

  • In Respan AI, create an API key.
  • Note an organization id. The logs API returns no account id, so CostGraph uses what you enter as the billing account.

​
Let CostGraph pull

  1. Open Settings > Integrations and pick RespanAI.
  2. Name the connection and pick the tenant these charges belong to.
  3. Enter the values you copied. The form lists what RespanAI needs and marks the optional ones.
  4. Select Connect.
CostGraph verifies the credentials with a short fetch before saving, so a wrong value or a missing permission fails while you are still on the form.
Credentials are encrypted at rest and used only to read billing data. Revoke them in RespanAI at any time and the connection stops; nothing else is affected.

​
Push it yourself

Send the charges to CostGraph as FOCUS records instead. Push FOCUS data covers the connection id, the focus:write key, and the request shape.

​
Run the exporter

Rather than build that request yourself, run our exporter. It reads RespanAI on a schedule and pushes the records for you, wherever you want to run it: a container, a Kubernetes CronJob, or a binary on a machine you already have.
Your RespanAI credential stays where you put it, and only the finished FOCUS records reach CostGraph. Run the exporter covers the three ways to run it and the variables it reads.

​
What CostGraph does with it

Records land as raw billing rows, are normalised into line items, and roll up into daily cost. From there RespanAI spend appears in Cost Overview and in anomaly detection alongside every other provider.