Add support of python3.13

[mdmitry1]

python3.12 is the default version for the latest Ubuntu LTS (24.04).
With version I'm getting error message:
../../src/run_smlp.py
Traceback (most recent call last):
File "/home/mdmitry/github/smlp/regr_smlp/code/../../src/run_smlp.py", line 10, in
from smlp_py.smlp_flows import SmlpFlows
File "/home/mdmitry/github/smlp/src/smlp_py/smlp_flows.py", line 7, in
from smlp_py.smlp_models import SmlpModels
File "/home/mdmitry/github/smlp/src/smlp_py/smlp_models.py", line 11, in
from pycaret.regression import predict_model as caret_predict_model
File "/home/mdmitry/.local/lib/python3.12/dist-packages/pycaret/init.py", line 22, in
raise RuntimeError(
RuntimeError: ('Pycaret only supports python 3.9, 3.10, 3.11. Your actual Python version: ', sys.version_info(major=3, minor=12, micro=3, releaselevel='final', serial=0), 'Please DOWNGRADE your Python version.')

[mdmitry1]

I've tried to rebuild from scratch for python3.11, but get an error:
meson setup --wipe -Dkay-prefix=$HOME/github/kay --prefix $HOME/.local build
Program python (fractions) found: YES (/usr/bin/python) modules: fractions
Run-time dependency python found: NO (tried pkgconfig, pkgconfig and sysconfig)

src/meson.build:274:14: ERROR: Python dependency not found

[fbrausse]

I'm running SMLP with Python 3.11 locally, so I can't see what might be going wrong. Could you please post the entire output of the meson setup command you've been running? Also the build/meson-logs/meson-log.txt file might help to shed some light on the issue.

[fbrausse]

PS: @zurabksmlp Do you know what is up with pycaret not supporting 3.12? Is there a newer version or maybe a way for us to replace that dependency?

[zurabksmlp]

I don't know why pycaret does not support python 3.12. Needs to be investigated. I am using python 3.12 with pycaret 3.4.0.

[mdmitry1]

I've resolved python3.11 installation issue.
Now getting error:
import smlp
ModuleNotFoundError: No module named 'smlp'

[mdmitry1]

I've noticed that if I build with Python3.12, then libsmlp.cpython-312-x86_64-linux-gnu.so is created.
However, if I build with Python3.11, shared library is not created

[mdmitry1]

Attached are build.ninja.311.txt and build.ninja.312.txt
In build.ninja.311 rule SHSYM is missing
diff /home/mdmitry/build.ninja.311.txt /home/mdmitry/build.ninja.312.txt| grep SHSYM

rule SHSYM
build src/libsmlp.cpython-312-x86_64-linux-gnu.so.p/libsmlp.cpython-312-x86_64-linux-gnu.so.symbols: SHSYM src/libsmlp.cpython-312-x86_64-linux-gnu.so

build.ninja.311.txt
build.ninja.312.txt

[fbrausse]

I've noticed that if I build with Python3.12, then libsmlp.cpython-312-x86_64-linux-gnu.so is created. However, if I build with Python3.11, shared library is not created

Again, the meson output and meson logs would be useful. The ninja files are just generated by meson as a result of the configuration process and don't help much. That process must differ between 3.11 and 3.12. My suspicion is that meson is not finding the boost-python libs corresponding to python3.11 which is why building libsmlp-*.so and installing the smlp module is skipped.

[mdmitry1]

Thanks for your help!
I've succeeded to install boost-python for python3.11 and issue has been resolved.
Installation instructions (thanks Claude Sonnet 4.5):

cd /tmp
wget https://sourceforge.net/projects/boost/files/boost/1.83.0/boost_1_83_0.tar.gz
tar -xvf boost_1_83_0.tar.gz
cd boost_1_83_0
./bootstrap.sh --with-python=/usr/bin/python3.11 --with-libraries=python
./b2 install --prefix=$HOME/boost_py311 --with-python python=3.11
sudo cp -p $HOME/boost_py311/lib/libboost_python311.a /usr/lib/x86_64-linux-gnu
sudp cp -p $HOME/boost_py311/lib/libboost_python311.so.1.83.0 /usr/lib/x86_64-linux-gnu
sudo ln -s /usr/lib/x86_64-linux-gnu/{libboost_python311.so.1.83.0,libboost_python311.so}

Another installation tip for the latest Ubuntu (24.04.03 LTS) installation version:
Before running meson and ninja:

sudo ln -sf /usr/bin/python3.11 /usr/bin/python3
sudo ln -sf /usr/bin/python3.11 /usr/bin/python

After running meson and ninja:

sudo ln -sf /usr/bin/python3.12 /usr/bin/python3
sudo ln -sf /usr/bin/python3.12 /usr/bin/python

In all executable Python scripts replace line #!/usr/bin/env python3 by #!/usr/bin/python3.11

[fbrausse]

I'm glad it worked!

Another installation tip for the latest Ubuntu (24.04.03 LTS) installation version: Before running meson and ninja:

sudo ln -sf /usr/bin/python3.11 /usr/bin/python3
sudo ln -sf /usr/bin/python3.11 /usr/bin/python

After running meson and ninja:

sudo ln -sf /usr/bin/python3.12 /usr/bin/python3
sudo ln -sf /usr/bin/python3.12 /usr/bin/python

In all executable Python scripts replace line #!/usr/bin/env python3 by #!/usr/bin/python3.11

Oh dear, that should not be necessary and we definitely need to work on the installation procedure here. Thanks for testing it and giving instructions on how to solve the problems. I've never tried to run it with a non-default python version, so maybe switching the default, e.g., by using a Python virtualenv might be easier in this case.

[fbrausse]

Pycaret only supports python 3.9, 3.10, 3.11.

Seems to me pycaret is no longer actively maintained. Last commit to their master branch was in March 2025 and already back in Nov 2024 people noticed the dev team not working on it anymore. We need to replace this dependency of SMLP.

[mdmitry1]

Progress so far

1. Enhanced code to skip pycaret for python minor version greater than 11
2. Resolved mrmr issue - the problem has been in the change of package name.
   Correct installation command:

pip3 install mrmr-selection

3. With the help of Claude upgraded train_keras.py, as TensorFlow interface has changed.
   Now it supports newer versions of Keras and TensorFlow:

pip3 install keras==3.13.0 tensorflow==2.20.0

Remaining issues

1. Need to install mathsat
2. Some tests failed due to the following issues:

Error in Build stage: Data file does not exist
Error in Build stage: New data file does not exist

Some of those issues, but not all of them are happening for tests, which use pycaret data

3. Review changes, implemented by Claude
4. Review diffs in passing tests

Bottom line

SMLP python3.12 is ready for validation

[mdmitry1]

Created one step build script for python3.12

mkdir -p /tmp/smlp_build
cd /tmp/smlp_build
git clone ssh://git@github.com/SMLP-Systems/smlp 
cd smlp
git switch SMLP_TUTORIAL 
cd utils/poly
run_build_312