Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable CI testing on AWS and other CSPs #3080

Draft
wants to merge 7 commits into
base: develop
Choose a base branch
from
Draft

Enable CI testing on AWS and other CSPs #3080

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
5fb019d
add prep_emissions APRUN env. var
weihuang-jedi Nov 7, 2024
817d584
manualle merge #3023 code int
weihuang-jedi Nov 8, 2024
eb2c7b1
manualle merge #3023 code int
weihuang-jedi Nov 8, 2024
c71e5d3
comment use /contrib-epic part
weihuang-jedi Nov 8, 2024
02ad06f
check if /contrib-epic exist
weihuang-jedi Nov 8, 2024
3fa0ea2
add a patch to be used by CI testing
weihuang-jedi Nov 13, 2024
63ffa09
Update env/AWSPW.env
weihuang-jedi Nov 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion env/AWSPW.env
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,13 @@ export launcher="srun -l --export=ALL"
export mpmd_opt="--multi-prog --output=mpmd.%j.%t.out"

# Configure MPI environment
export OMP_STACKSIZE=2048000
#export OMP_STACKSIZE=2048000
weihuang-jedi marked this conversation as resolved.
Show resolved Hide resolved
export NTHSTACK=1024000000

export OMP_STACKSIZE=512M
export KMP_AFFINITY=scatter
export OMP_NUM_THREADS=1

ulimit -s unlimited
ulimit -a

Expand Down Expand Up @@ -59,6 +63,10 @@ elif [[ "${step}" = "post" ]]; then
[[ ${NTHREADS_DWN} -gt ${max_threads_per_task} ]] && export NTHREADS_DWN=${max_threads_per_task}
export APRUN_DWN="${launcher} -n ${ntasks_dwn}"

elif [[ "${step}" = "prep_emissions" ]]; then

export APRUN="${APRUN_default}"

elif [[ "${step}" = "atmos_products" ]]; then

export USE_CFP="YES" # Use MPMD for downstream product generation on Hera
Expand Down
Loading