Skip to content

Docker image build script#33

Merged
pminev merged 9 commits intomasterfrom
pminev/docker
May 27, 2025
Merged

Docker image build script#33
pminev merged 9 commits intomasterfrom
pminev/docker

Conversation

@pminev
Copy link
Contributor

@pminev pminev commented Mar 31, 2025

We use Nvidia's docker image for ubuntu with CUDA drivers, so we don't have to install the packages on our side. I checked that in both x86_64 and arm64 it's correctly built with CUDA support.

Build for native arch

docker build  -t <target_name> .

To build for specific architecture - x86_64 for example:

docker build --platform=linux/amd64  -t <target_name> .

To run the image:

docker run --gpus all -v <local/path/to/models>:/models -it -p 7654:7654 <target_name>

Built image for now can be downloaded from my docker hub.

I've noticed that to make it usable we should complete the following tasks:

  • Download models in the accord
    • Since acord îs not yet ready to download, users should download them before usage and mount the local directory to the docker container in order to access them.
  • Create a shared volume in the docker, so we can download or move the models there
    • This is the directory mount -v <local/path>:/<container/path>
  • Make the image smaller by leaving only the Cuda runtime in the final image, do not include dev
  • Make single image for amd64 and arm64 architectures - this should be only a command line but still do not forget

closes #32

pminev added 6 commits March 26, 2025 20:02
-- for now we replicate the folder hierarchy will and replace the libs in lib/ac-local since if we copy them directly the libraries we depend on are not found, but the original ones are fine.
-- change acord argument to listen on all interfaces
@pminev pminev requested a review from iboB March 31, 2025 12:50
endpoints.push_back({fishnets::IPv6, params.wsPort});
// TODO: Check why when IPv6 is enabled, the server does not start
// when it's started in docker
// endpoints.push_back({fishnets::IPv6, params.wsPort});
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Check this, do not merge it in this state.

@pminev pminev merged commit cde3532 into master May 27, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Packaging: docker

1 participant