Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does conda install of deepmd support Platform: linux-aarch64? #3932

Open
robinzyb opened this issue Jun 30, 2024 · 8 comments
Open

Does conda install of deepmd support Platform: linux-aarch64? #3932

robinzyb opened this issue Jun 30, 2024 · 8 comments

Comments

@robinzyb
Copy link
Contributor

Summary

no

DeePMD-kit Version

x

Backend and its version

x

Python Version, CUDA Version, GCC Version, LAMMPS Version, etc

No response

Details

I tried to install deepmd-kit using conda
conda create -n deepmd deepmd-kit lammps horovod -c conda-forge
And the message is

Channels:
 - conda-forge
 - defaults
Platform: linux-aarch64
Collecting package metadata (repodata.json): done
Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

  - lammps
  - horovod
  - deepmd-kit

Current channels:

  - https://conda.anaconda.org/conda-forge
  - defaults

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org

and use the search bar at the top of the page.

I found there is only linux-64 not linux-aarch64. I am not sure if the error is caused by the platform. if so, could we add support on linux-aarch64
Screenshot 2024-06-30 at 14 00 58

@njzjz
Copy link
Member

njzjz commented Jun 30, 2024

@njzjz njzjz added the upstream label Jun 30, 2024
@robinzyb
Copy link
Contributor Author

robinzyb commented Jun 30, 2024

thanks. This is required by newest hpc in CSCS (https://www.cscs.ch/computers/decommissioned/toedi). Looking forward to the update.
Our new project will start at this new hpc in October. The worst case would be compiling dpmd from scratch.

@njzjz njzjz added enhancement and removed wontfix labels Jul 1, 2024
@robinzyb
Copy link
Contributor Author

robinzyb commented Jul 2, 2024

Hi, aarch64 is also required by the docker image. Does the docker iamge also suffer from the problem of upstream (tensorflow)? I only found x86 docker image for tensorflow in dockerhub (https://hub.docker.com/r/tensorflow/tensorflow/tags?page=2&page_size=&ordering=&name=)

@njzjz
Copy link
Member

njzjz commented Jul 2, 2024

Hi, aarch64 is also required by the docker image. Does the docker iamge also suffer from the problem of upstream (tensorflow)? I only found x86 docker image for tensorflow in dockerhub (https://hub.docker.com/r/tensorflow/tensorflow/tags?page=2&page_size=&ordering=&name=)

Currently, we build docker images just using the offline installer, maintained at https://github.com/deepmd-kit-recipes/docker-images.

@robinzyb
Copy link
Contributor Author

robinzyb commented Jul 3, 2024

Hello, I checked the dockerfile. The offline installer only has linux x86_64.sh. How do you build the offline installer? Do we need to build an arm64 offline installer?

@njzjz
Copy link
Member

njzjz commented Jul 3, 2024

How do you build the offline installer?

The offline package is built at https://github.com/deepmd-kit-recipes/installer, which is a collection of conda packages.

@robinzyb
Copy link
Contributor Author

robinzyb commented Jul 3, 2024

Thank you. It seems everything goes back to the conda install deepmd-kit where we need the aarch64 for tensorflow. should fix the upstream problem first.

@robinzyb
Copy link
Contributor Author

memo: the containerfile for linux-aarch64 has been made by the cscs engineer, and the software performs well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants