feat: add nix and nixos flake support

[longregen]

Hello there!

I love this project! It was exactly what I was looking for!

I don't know what's the appetite for this, but maybe it's useful for someone else. It almost doesn't touch any code -- only two python files to allow offline usage, so I can test that this works really offline.

Please feel free to close this pull request if it's too off-topic! I saw a flakes.nix file and thought that maybe some other nixos users would find this interesting.

[fedirz]

I've tried to test the changes, but I ran into errors with dlinfo being broken and also ctranslate2 not building. Here's the output.

NOTE: I'm using aarch64-darwin

❯ nix develop .\#speaches-cpu
warning: Git tree '/Users/fedir/code/speaches' is dirty
error: builder for '/nix/store/sscvjwljv17nq5b5g90pdhm0i9n380zl-ctranslate2-4.6.0.drv' failed with exit code 2;
       last 25 log lines:
       >                  from /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/backend.cc:1:
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/third_party/ruy/ruy/pack_arm.h:492:9: warning: multi-line comment []
       >   492 | #endif  // (RUY_PLATFORM_NEON_64 || RUY_PLATFORM_NEON_32) && \
       >       |         ^
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/primitives.cc:17:12: fatal error: Accelerate/Accelerate.h: No such file or directory
       >    17 | #  include <Accelerate/Accelerate.h>
       >       |            ^~~~~~~~~~~~~~~~~~~~~~~~~
       > compilation terminated.
       > make[2]: *** [CMakeFiles/ctranslate2.dir/build.make:205: CMakeFiles/ctranslate2.dir/src/cpu/primitives.cc.o] Error 1
       > make[2]: *** Waiting for unfinished jobs....
       > In file included from /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/kernels.cc:19:
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/vec.h: In instantiation of 'static void ctranslate2::cpu::Vec<T, ISA>::convert_and_store(float, U*, ctranslate2::dim_t) [with U = unsigned char; T = float; ctranslate2::cpu::CpuIsa ISA = ctranslate2::cpu::CpuIsa::GENERIC; ctranslate2::dim_t = long long int]':
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/kernels.cc:598:37:   required from 'float ctranslate2::cpu::quantize_s8_row(const float*, int8_t*, ctranslate2::dim_t, bool, const RoundFunc&) [with RoundFunc = float(float); int8_t = signed char; ctranslate2::dim_t = long long int]'
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/kernels.cc:634:38:   required from 'void ctranslate2::cpu::quantize_s8_batch(const float*, int8_t*, float*, ctranslate2::dim_t, ctranslate2::dim_t, bool, const RoundFunc&) [with RoundFunc = float(float); int8_t = signed char; ctranslate2::dim_t = long long int]'
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/kernels.cc:648:26:   required from here
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/vec.h:148:65: warning: unused parameter 'count' []
       >   148 |       static inline void convert_and_store(float v, U* a, dim_t count) {
       >       |                                                           ~~~~~~^~~~~
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/vec.h: In instantiation of 'static void ctranslate2::cpu::Vec<T, ISA>::convert_and_store(float, U*, ctranslate2::dim_t) [with U = signed char; T = float; ctranslate2::cpu::CpuIsa ISA = ctranslate2::cpu::CpuIsa::GENERIC; ctranslate2::dim_t = long long int]':
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/kernels.cc:609:37:   required from 'float ctranslate2::cpu::quantize_s8_row(const float*, int8_t*, ctranslate2::dim_t, bool, const RoundFunc&) [with RoundFunc = float(float); int8_t = signed char; ctranslate2::dim_t = long long int]'
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/kernels.cc:634:38:   required from 'void ctranslate2::cpu::quantize_s8_batch(const float*, int8_t*, float*, ctranslate2::dim_t, ctranslate2::dim_t, bool, const RoundFunc&) [with RoundFunc = float(float); int8_t = signed char; ctranslate2::dim_t = long long int]'
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/kernels.cc:648:26:   required from here
       > /tmp/nix-build-ctranslate2-4.6.0.drv-0/source/src/cpu/vec.h:148:65: warning: unused parameter 'count' []
       > make[1]: *** [CMakeFiles/Makefile2:358: CMakeFiles/ctranslate2.dir/all] Error 2
       > make: *** [Makefile:136: all] Error 2
       For full logs, run:
         nix log /nix/store/sscvjwljv17nq5b5g90pdhm0i9n380zl-ctranslate2-4.6.0.drv
error: 1 dependencies of derivation '/nix/store/fbq0qriglqxw21zv3jbi4wxxcf0xma1y-speaches-0.1.0-env.drv' failed to build

Applying this diff does fix nix (run|shell|develop) .#speaches-cpu. Is there a better way to address this?

diff --git a/flake.nix b/flake.nix
index 10d4902..4ad8296 100644
--- a/flake.nix
+++ b/flake.nix
@@ -24,21 +24,21 @@
           pyPackages = prev."${pythonVersion}Packages";
         in {
           # Override ctranslate2 for CUDA support
-          ctranslate2 =
-            if cudaSupport && system == "x86_64-linux"
-            then
-              prev.ctranslate2.override {
-                stdenv = prev.gcc11Stdenv;
-                withCUDA = true;
-                withCuDNN = true;
-                cudaPackages = prev.cudaPackages_12;
-              }
-            else
-              prev.ctranslate2.override {
-                stdenv = prev.gcc11Stdenv;
-                withCUDA = false;
-                withCuDNN = false;
-              };
+          # ctranslate2 =
+          #   if cudaSupport && system == "x86_64-linux"
+          #   then
+          #     prev.ctranslate2.override {
+          #       stdenv = prev.gcc11Stdenv;
+          #       withCUDA = true;
+          #       withCuDNN = true;
+          #       cudaPackages = prev.cudaPackages_12;
+          #     }
+          #   else
+          #     prev.ctranslate2.override {
+          #       stdenv = prev.gcc11Stdenv;
+          #       withCUDA = false;
+          #       withCuDNN = false;
+          #     };
 
           "${pythonVersion}Packages" =
             pyPackages
@@ -127,6 +127,7 @@
           pkgs = import nixpkgs {
             inherit system;
             config.allowUnfree = true;
+            config.allowBroken = true;
             overlays = [overlay];
           };
 
diff --git a/nix/dependencies/phonemizer-fork.nix b/nix/dependencies/phonemizer-fork.nix
index 8ae1ba5..d5cd7a3 100644
--- a/nix/dependencies/phonemizer-fork.nix
+++ b/nix/dependencies/phonemizer-fork.nix
@@ -15,7 +15,7 @@ prev.buildPythonPackage rec {
     joblib
     segments
     attrs
-    dlinfo
+    (dlinfo.overridePythonAttrs (old: { doCheck = false; }))
   ];
   
   doCheck = false;

---

I love this project! It was exactly what I was looking for!

Hey, I'm happy you're finding this project useful

I saw a flakes.nix file and thought that maybe some other nixos users would find this interesting.

I'm finding this very interesting. I've always wanted to have speaches available as a NixOS service!

I would love to merge these changes in, but I'm concerned that I won't have either the time or the skill to maintain the Nix configuration as dependencies of the project evolve. Do you think you'll be able to help with the maintenance of the Nix files? Otherwise, I worry they might become stale and cause issues for users.

---

Side note: I really like what you've done with nix-hug. I've had a similar idea of declaratively managing HF cache for some time now. Pretty cool to see someone create a project for this.

[longregen]

Hey there! I'm glad you found it useful. I could commit to maintain this; at least checking on it every month or so. Not sure if any other users would be interested though! I guess you won't like to have the PR hanging around, feel free to close it, I guess organically other nixos users might arrive at this thread.

I'll run the build on a mac build box I have somewhere and report back to you.