ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject

[KyuhwanYeon]

Hi all.

I just tried to train code of GenAD

But I've met

root@/Repos/GenAD# python -m torch.distributed.run --nproc_per_node=1 --master_port=2333 tools/train.py projects/configs/GenAD/GenAD_config.py --launcher pytorch --deterministic --work-dir ./train_output
projects.mmdet3d_plugin
Traceback (most recent call last):
  File "tools/train.py", line 274, in <module>
    main()
  File "tools/train.py", line 134, in main
    plg_lib = importlib.import_module(_module_path)
  File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 848, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/Repos/GenAD/projects/mmdet3d_plugin/__init__.py", line 1, in <module>
    from .core.bbox.assigners.hungarian_assigner_3d import HungarianAssigner3D
  File "/Repos/GenAD/projects/mmdet3d_plugin/core/bbox/assigners/__init__.py", line 2, in <module>
    from .map_hungarian_assigner_3d import MapHungarianAssigner3D
  File "/Repos/GenAD/projects/mmdet3d_plugin/core/bbox/assigners/map_hungarian_assigner_3d.py", line 10, in <module>
    from projects.mmdet3d_plugin.GenAD.utils.map_utils import (
  File "/Repos/GenAD/projects/mmdet3d_plugin/GenAD/__init__.py", line 5, in <module>
    from .GenAD import GenAD
  File "/Repos/GenAD/projects/mmdet3d_plugin/GenAD/GenAD.py", line 12, in <module>
    from projects.mmdet3d_plugin.GenAD.planner.metric_stp3 import PlanningMetric
  File "/Repos/GenAD/projects/mmdet3d_plugin/GenAD/planner/metric_stp3.py", line 10, in <module>
    from skimage.draw import polygon
  File "/usr/local/lib/python3.8/dist-packages/skimage/__init__.py", line 122, in <module>
    from ._shared import geometry
  File "geometry.pyx", line 1, in init skimage._shared.geometry
ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 913) of binary: /usr/bin/python
/usr/local/lib/python3.8/dist-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py:367: UserWarning:

I think there is conflict between packages.

Have you ever met this error?

or, if someone success to build Docker image, could you share Dockerfile?