Skip to content

hera update for 1.7.0 #1047

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
AlexanderRichert-NOAA merged 6 commits into from
Mar 28, 2024
Merged

hera update for 1.7.0 #1047

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
005aa67
zlib-ng~shared for hera when %intel
AlexanderRichert-NOAA Mar 28, 2024
264052b
submodule pointer
AlexanderRichert-NOAA Mar 28, 2024
8025ad4
u
AlexanderRichert-NOAA Mar 28, 2024
dc10685
openmpi/4.1.6
AlexanderRichert-NOAA Mar 28, 2024
cf2ff02
update openmpi external spec on hera
AlexanderRichert-NOAA Mar 28, 2024
3a3db94
revert submodule point to jcsda
AlexanderRichert-NOAA Mar 28, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions configs/sites/hera/compilers.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ compilers:
f77: /apps/oneapi/compiler/2022.0.2/linux/bin/intel64/ifort
fc: /apps/oneapi/compiler/2022.0.2/linux/bin/intel64/ifort
flags: {}
operating_system: centos7
operating_system: rocky8
modules:
- intel/2022.1.2
environment:
Expand All @@ -24,7 +24,7 @@ compilers:
f77: /apps/intel/parallel_studio_xe_2018.4.057/compilers_and_libraries_2018/linux/bin/intel64/ifort
fc: /apps/intel/parallel_studio_xe_2018.4.057/compilers_and_libraries_2018/linux/bin/intel64/ifort
flags: {}
operating_system: centos7
operating_system: rocky8
modules:
- intel/18.0.5.274
- compiler:
Expand All @@ -35,7 +35,7 @@ compilers:
f77: /apps/gnu/gcc-9.2.0/bin/gfortran
fc: /apps/gnu/gcc-9.2.0/bin/gfortran
flags: {}
operating_system: centos7
operating_system: rocky8
modules:
- gnu/9.2.0
environment: {}
Expand Down
11 changes: 7 additions & 4 deletions configs/sites/hera/packages.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ packages:
compiler:: [intel@2021.5.0, gcc@9.2.0]
#compiler:: [intel@18.0.5.274]
providers:
mpi:: [intel-oneapi-mpi@2021.5.1, openmpi@4.1.5]
mpi:: [intel-oneapi-mpi@2021.5.1, openmpi@4.1.6]
#mpi:: [intel-mpi@2018.0.4]
# To support hecflow01
target: [haswell]
Expand All @@ -22,11 +22,14 @@ packages:
prefix: /apps/oneapi
openmpi:
externals:
- spec: openmpi@4.1.5~cuda~cxx~cxx_exceptions~java+lustre~memchecker+pmi~static~wrapper-rpath schedulers=slurm
prefix: /scratch1/NCEPDEV/jcsda/jedipara/spack-stack/openmpi-4.1.5
- spec: openmpi@4.1.6~atomics~cuda~cxx~cxx_exceptions~gpfs~internal-hwloc~internal-libevent~internal-pmix~java+legacylaunchers~lustre~memchecker~openshmem~orterunprefix+pmi+romio+rsh~singularity+static+vt+wrapper-rpath fabrics=ucx schedulers=slurm
modules:
- gnu/9.2.0
- openmpi/4.1.5
- openmpi/4.1.6_gnu9.2.0
Copy link
Copy Markdown
Collaborator

@natalie-perlin natalie-perlin Mar 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is still with gnu/9.2.0?.. Could we push for using 12.2.0?.

Copy link
Copy Markdown
Collaborator Author

@AlexanderRichert-NOAA AlexanderRichert-NOAA Mar 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I assume you mean 13.2.0? I'd prefer not to make a last-minute change unless it's critically needed for an application. Could it wait until the 1.8.0 release?

Copy link
Copy Markdown
Collaborator

@natalie-perlin natalie-perlin Mar 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is gnu/12.2.0 version installed by Dom, under spack-stack. As I remember, there were some issues with gnu/13.2.0, which is installed system-wide on Hera.

Way to load module gnu/12.2.0:

module use /scratch1/NCEPDEV/nems/role.epic/modulefiles
module load gnu/12.2.0

Modulefile /scratch1/NCEPDEV/nems/role.epic/modulefiles/gnu/12.2.0.lua was prepared to point to Dom's installation under

/scratch1/NCEPDEV/nems/role.epic/spack-stack/gcc-12.2.0

Copy link
Copy Markdown
Collaborator Author

@AlexanderRichert-NOAA AlexanderRichert-NOAA Mar 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah okay I see, thanks. Would you be willing to update the Hera config to add the second gcc version?

Copy link
Copy Markdown
Collaborator

@natalie-perlin natalie-perlin Mar 29, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@AlexanderRichert-NOAA - I'd give it a try!

Copy link
Copy Markdown
Collaborator

@climbfuji climbfuji Apr 1, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@RatkoVasic-NOAA was also building the gnu@12.2.0 compiler and openmpi@4.1.6 with it - if his testing is successful, we should use that version.

zlib-ng:
require:
- any_of: ['~shared']
when: "%intel"

### All other external packages listed alphabetically
autoconf:
Expand Down
2 changes: 1 addition & 1 deletion spack
Open in desktop
Submodule spack updated 1 files
+21 −1 var/spack/repos/builtin/packages/zlib-ng/package.py