Skip to content

Per-step token, cost, latency tracking #37

@highvoltag3

Description

@highvoltag3

Add tracing/logging for every LLM call and vector query. Log tokens in/out, latency, and cost estimates. Persist in events table.

Acceptance Criteria:
• Token counts recorded per step.
• Latency measured per request.
• Costs computed (based on $/token) and saved.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions