Know what your AI agents cost.
Open-source API gateway for AI providers. Logs every request with token counts and dollar costs.
Budget limits reject requests before they reach the provider, not after.
$ npx @f3d1/llmkit-cli -- python my_agent.py
$0.0215 total 3 requests 4.2s ~$18.43/hr
claude-sonnet-4-20250514 1 req $0.0156 ████████████████████
gpt-4o 2 reqs $0.0059 ███████░░░░░░░░░░░░░Works with Python, Ruby, Go, Rust - anything that calls the OpenAI or Anthropic API. One command, no code changes.
Get started
- Create an account at llmkit.sh (free while in beta)
- Create an API key in the Keys tab
- Pick a method below
CLI
Wrap any command. The CLI intercepts API calls, forwards them through the proxy, and prints a cost summary when the process exits.
npx @f3d1/llmkit-cli -- python my_agent.pyUse -v for per-request costs as they happen, --json for machine-readable output.
Python
pip install llmkit-sdkWith the proxy (budget enforcement, logging, dashboard):
from openai import OpenAI
client = OpenAI(
base_url="https://api.llmkit.sh/v1",
api_key="llmk_your_key_here",
)
response = client.chat.completions.create(
model="gpt-4o",
messages=[{"role": "user", "content": "hello"}],
)
