Skip to content

haocn-ops/agentgrid

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AgentGrid

Unified LLM routing and billing layer purpose-built for AI agents.

面向 AI Agents 的統一大模型路由與結算平台。

One-liner

  • EN: AgentGrid is a unified LLM routing and billing layer purpose-built for AI agents.
  • 中文:AgentGrid 是面向 AI Agents 的統一大模型路由與結算平台。

10-second pitch

  • EN: Integrate once with AgentGrid to access multiple LLM providers, auto-optimize for cost/latency/reliability, and get audit-ready token metering and billing.
  • 中文:接一次 AgentGrid,即可調用多家模型;自動在成本、延遲、成功率間做最優路由,並完成可對帳的 token 計量與計費。

What AgentGrid provides

  • OpenAI-compatible API gateway for agents
  • Multi-provider model routing (cheapest, fastest, balanced)
  • Automatic retry and fallback across providers/models
  • Tenant-level budget, quota, and rate limit control
  • Token metering, usage analytics, and billing ledger
  • Traceable request lifecycle for audit and debugging

Monorepo layout

agentgrid/
  apps/
    gateway/      # Unified API entry for agents
    router/       # Routing engine and policy evaluation
    metering/     # Token accounting and usage aggregation
    billing/      # Ledger and invoice pipeline
    console/      # Admin and tenant console
  packages/
    sdk-js/       # JavaScript/TypeScript SDK
    sdk-python/   # Python SDK
    shared-types/ # Cross-service schema and contracts
  docs/           # Product and architecture docs

Suggested domain and repo naming

  • Preferred domain: agentgrid.ai
  • Alternatives: agentgrid.dev, agentgrid.io, useagentgrid.com, agentgridhq.com
  • Suggested GitHub org: agentgrid

Next deliverables

  1. PostgreSQL DDL for tenant, usage, and billing ledger
  2. Router v1 scoring and fallback pseudocode
  3. OpenAI-compatible API field mapping
  4. Minimal deployable gateway prototype

Delivered in this repo

  • PostgreSQL DDL: docs/POSTGRES_DDL_V1.sql
  • Router pseudocode: docs/ROUTER_V1_PSEUDOCODE.md
  • OpenAI field mapping: docs/OPENAI_FIELD_MAPPING.md
  • Gateway prototype: apps/gateway/prototype/server.js
  • Gateway smoke test: scripts/smoke_gateway.sh
  • Gateway postgres smoke wrapper: scripts/smoke_gateway_postgres.sh

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors