Fetch LLM Token prices programmatically

[lchoquel]

Before submitting

• I've searched open issues and found no similar request
• I'm willing to start a discussion or contribute code

Problem / motivation

Sources:
https://docs.helicone.ai/getting-started/quick-start
https://github.com/pydantic/llm-pricing

Challenge: some LLMs have non-linear pricing, e.g. Gemini according to token count > 200K

Proposed solution

No response

Alternatives considered

No response

Would you like to help implement this feature?

None

[lchoquel]

This will most certainly be done through our inference backend