Simd vectorized functions

[mert-kurttutan]

Hi @EricLBuehler

Is vectorized simd (activation) functions implemented for float32 for projects where it is used ?

If not, I would be open for implementing them (for CPUs as a starter).

[EricLBuehler]

Hi @mert-kurttutan ! There are no simd implementations here yet, and everything is currently done by casting through f32.

Having simd implementations would be amazing, though!

[mert-kurttutan]

Where do you suggest should I start integration (for activation functions as starters)? Here, in this project, or another crate?

[EricLBuehler]

Hey @mert-kurttutan !

I think adding the functions here would be best if possible.