FP16 #1
Description
Hi:
is the fp16 mode working? I find that the implementation of fp16 RoPE is commented out. do I need to implement it myself or can I use the templated RoPE to achieve fp16?
{{ message }}
Hi:
is the fp16 mode working? I find that the implementation of fp16 RoPE is commented out. do I need to implement it myself or can I use the templated RoPE to achieve fp16?