Add non-learned position encodings #5
Description
From #4 (comment)_
See how we might include the sin(t) terms, rather than just 'learned' encodings.
{{ message }}
From #4 (comment)_
See how we might include the sin(t) terms, rather than just 'learned' encodings.