Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Containerfile #5141

Merged
merged 6 commits into from
Jan 15, 2025
Merged

Containerfile #5141

merged 6 commits into from
Jan 15, 2025

Conversation

sinha-r
Copy link
Contributor

@sinha-r sinha-r commented Aug 15, 2024

Containerfile to run WarpX at NERSC

To Do

  • GPU-aware MPI is needed: we need to use shifter instead of podman
  • heFFTe has been disabled as of now due to compilation errors (this can be skipped for now and added in a follow-up PR later on, we do not use heFFTe extensively yet)

@ax3l ax3l self-requested a review August 15, 2024 22:11
@ax3l ax3l self-assigned this Aug 15, 2024
@ax3l ax3l added install machine / system Machine or system-specific issue labels Aug 15, 2024
python3-venv \
unzip \
vim \
libmpich-dev \
Copy link
Member

@ax3l ax3l Aug 15, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to do anything to get GPU-Aware MPI on Perlmutter to run?
Vanilla without containers, I have to set this to tell the Cray compiler wrappers to get it right:

# necessary to use CUDA-aware MPI and run a job
export CRAY_ACCEL_TARGET=nvidia80

Since we compile with GCC here, I am not sure how to do it.

Tools/machines/perlmutter-nersc/Containerfile Show resolved Hide resolved
Tools/machines/perlmutter-nersc/Containerfile Outdated Show resolved Hide resolved
@@ -0,0 +1,151 @@
# Base System and Essential Tools Installation
FROM nvidia/cuda:12.6.0-devel-ubuntu22.04 AS base
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To test: we could use -devel to build all dependencies but then copy their artifacts in the -runtime image. To check if those are much smaller or not.

@ax3l ax3l requested a review from EZoni September 27, 2024 22:09
Copy link
Member

@ax3l ax3l left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a developer container for now.

Will expand in follow-up PRs to create also a user-image from it that can be used right away without compiling WarpX inside it first.

@ax3l ax3l merged commit ce487f9 into ECP-WarpX:development Jan 15, 2025
30 of 36 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
install machine / system Machine or system-specific issue
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants