-
-
Notifications
You must be signed in to change notification settings - Fork 5
Description
What problem does this solve?
Users often struggle to estimate the actual cost of their AI workflows because they ignore the 'Retry Tax'—the cost of failed outputs caused by unstructured prompts. Structured prompting is the cure, but we need a way to quantify the savings.
Proposed solution
An integration or a 'Cost Estimator' block within Flompt that calculates potential token savings when switching from prose to structured blocks (Role/Constraints/Output). I’ve built a logic for this here: ByteCalculators
Which part of flompt does this affect?
Visual editor (canvas / blocks)
Alternatives considered
Manual calculation via spreadsheets, which is slow and inaccurate for real-time prompting
Additional context
I am mapping 'Retry Tax' data from over 4,000 simulations on my site. Using Flompt’s structured approach could realistically cut costs by 20-30% by reducing malformed outputs.