Could you please share working pip and conda package dependencies including versions please?

[kantasv]

Hi @mizunt1 @jithendaraa , thanks for great repo! I am trying to run the scripts and facing some jax version and other downstream dependencies compatibilty issues. Some package versions are already in the requirements.txt, but for example, jax version is not specified. If you still have your working environment, could you share jax version with us please? Thank you!

conda install jax cuda-nvcc jaxlib==0.4.4=cuda112* cudatoolkit -c conda-forge -c nvidia

Best regards,
Kanta

[jithendaraa]

I don't still have access to the environment, but could you try jax 0.4.4?

[kantasv]

For jax issues, I could resolve conda-pip jax/jaxlib discrepancies by installing all available packages via conda and explicitly set and trying to install most packages via conda.

conda install jax==0.4.4 cuda-nvcc jaxlib==0.4.4=cuda112* cudatoolkit -c conda-forge -c nvidia

However, for three packages weren't available in conda, which I had to install via pip had dependencies to scikit-learn and there are some conflicts between conda vs pip. Now we have other conflicts.

Maybe is it possible to share the working container's pip freeze and conda list please? If not, this is also understandable because it is 2 years ago and things might have changed..

Of course, I am also trying something and happy to report once I am successfully run experinments on my environment and happy to share some reports.

[mizunt1]

Hi @kantasv Apologies for late reply, I was away last week.
The virtual env I was using to run the codebase I no longer have access to I am afraid.
I can try to help you through some notes I took to setup the environment.
I was using cuda version 12.3.2, python 3.10
Then I ran the following commands:

pip install --upgrade pip
pip install --upgrade "jax[cuda12_pip]==0.4.20" -f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html
pip install -r requirements.txt
python3 -m pip install tensorflow[and-cuda]

Let me know if this was of any help.

[mizunt1]

@kantasv Also could you have a look at this script and let me know if this might give you some pointers for setting up the environment?
https://github.com/mizunt1/structure_learning/blob/main/scripts/bcd_setup.sh