Not sure where this particular issue lies: either in Spark, Breeze or Netlib. But using breeze functions in EMR doesn't load native libraries.

[dineshdharme]

I had to jump through hoops to get native libraries to load when calling breeze functions (like leastSquares) in Apache Spark.
Not sure where the exact issue is. I suppose Spark uses its own shaded breeze. Locally there was no issue. But on EMR, I got warning like

WARNING: Failed to load implementation from:dev.ludovic.netlib.blas.JNIBLAS

Here's the work around that made it work.

https://gist.github.com/dineshdharme/8bd39cdbc35a09033b9ba2cfd1bdf146