Inferledger

Provider-agnostic inference accounting: cost, latency, reliability, energy.

API

• OpenAPI: docs/openapi.yaml
• Ingest: POST /v1/runs
• Suggest: POST /v1/route/suggest
• Health: GET /healthz
• Metrics: GET /metrics

Staging Ingest (Cloudflare)

healthz

curl -s -X POST https://inferledger-collector.sensahin.workers.dev/v1/runs \
      -H 'content-type: application/json' \
      --data '[{"tenant_id":"dev","run_id":"r-demo","ts":"2025-01-01T00:00:00Z","provider":"openai","model":"gpt-4o","tokens_in":10,"tokens_out":20,"status":"ok"}]'

Suggest (Prod)

router healthz

curl -s -X POST https://inferledger-router.sensahin.workers.dev/v1/route/suggest \
      -H 'content-type: application/json' \
      --data '{"tenant_id":"dev","optimize_for":"COST"}'

Docs

• API
• Architecture
• Security
• Price Book

Dashboards

• Grafana JSON: cost, latency, reliability