Hi,
looking at the System prompt in the voice assistant settings, I can see that the "Current Date/Time" is the first thing that's written in the system promt.
Unfortunately, this breaks prompt caching. For locally running models, it will make response times much much much slower, and for cloud models, it might make usage more expensive (afaik, some providers are cheaper for cached prompts).
Is it possible to move the current date/time to the bottom of the prompt? Preferably even below the static context device list. For now I just removed time completely, but that's obviously not the best solution.
Hi,
looking at the System prompt in the voice assistant settings, I can see that the "Current Date/Time" is the first thing that's written in the system promt.
Unfortunately, this breaks prompt caching. For locally running models, it will make response times much much much slower, and for cloud models, it might make usage more expensive (afaik, some providers are cheaper for cached prompts).
Is it possible to move the current date/time to the bottom of the prompt? Preferably even below the static context device list. For now I just removed time completely, but that's obviously not the best solution.