Add other common params to ChatCompletionInferenceParams #354
Description
Priority Level
Medium (Nice to have)
Is your feature request related to a problem? Please describe.
We currently only support top_p and temperature
Describe the solution you'd like
support others:
top_k, min_p, presence_penalty, repetition_penalty
Describe alternatives you've considered
Currently there's a workaround to pass these via extra_body
Additional context
No response