-
Notifications
You must be signed in to change notification settings - Fork 6
Säntis stack for Spack v1.1 #52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
stelliom
wants to merge
67
commits into
main
Choose a base branch
from
v1.1_stack_santis
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
67 commits
Select commit
Hold shift + click to select a range
d0f7cbf
Added YAML files for 26.2/gh200
stelliom 75ed935
Update config.yaml
stelliom 645f68c
Quick test
stelliom e319f84
Remove pinned libtool version
stelliom 2dcd6fd
Remove eccodes
stelliom 6056608
Readd eccodes
stelliom 4011ba0
Pin cuda@12.6.0
stelliom 6729272
Changes based on old gh200 recipe
stelliom 9ce44c3
Removed libtool pin
stelliom 3793be5
Revert "Removed libtool pin"
stelliom 2527c8c
Revert "Changes based on old gh200 recipe"
stelliom fcdb5f1
Use gcc 13
stelliom b1f168b
Revert to gcc 12.3.0
stelliom 7d0cf52
Upgrade compiler versions
stelliom 1aca090
Upgrade python and cuda versions
stelliom 488cc9f
Revert gcc version
stelliom 2377168
Upgrade commit of spack-packages to get cuda 13.1.1
stelliom 3d65787
Reverted upgraded cuda version
stelliom 709e16e
Upgrade to cuda 12.7.0
stelliom 7bddd68
Use cuda 12.6.3
stelliom e1811a1
Use cuda 12.8.0
stelliom 33834a1
Upgraded to latest versions of nvhpc, cuda and cray-mpich
stelliom dc4cf55
Try updating to Spack develop branch
stelliom 06b44eb
Revert to nvhpc 26.1
stelliom e416591
Don't pin cray-mpich
stelliom 2ffd35f
Specify compilers
stelliom e200c0e
Change unify to when_possible
stelliom 95e12e9
Removed cxx from netcdf-fortran
stelliom eb51901
Removed cxx from hdf5
stelliom a757db9
Use nvhpc 26.3
stelliom 9d322d7
Use cuda 13.1
stelliom 7dc1ba1
Update eccodes and hdf5 to latest available version
stelliom 18ef043
Revert hdf5 to 1.14.6
stelliom 1be3568
Revert eccodes to 2.36.4 for consistency with eccodes-cosmo-resources
stelliom 985d758
Remove pin for libtools
stelliom 8d0aae2
Uncomment boost, nccl and extras
stelliom e46617d
Uncomment cdo
stelliom 54ad2d2
Test gcc 14
stelliom 0b9d6b5
Pin libfabric version as a dependency of cray-mpich
stelliom 9109693
Reverted to GCC 13
stelliom 8f8e6fc
Remove activation line from reframe.yaml
stelliom d4fd454
Added additional packages to reframe tests
stelliom 0de05c1
Try unify true again
stelliom 00fd07d
Revert to when_possible and add duplicates strategy
stelliom 04b885d
Use gcc for libfabric
stelliom b2fdf33
Add empty specs for MPI
stelliom 7646fd6
Remove compiler for libfabric
stelliom 27c8125
Try overspecifying libfabric
stelliom e7c7e19
Reverted overspecification of libfabric
stelliom 49ff865
Quick test
stelliom 0ebb3fc
Add libfabric to the spec
stelliom 91aa5e2
Move libfabric to mpi specs
stelliom e9bdc9b
Remove libfabric as a dependency
stelliom a814ea6
Reverted previous commit and pinned nccl
stelliom 732d0b2
Quick test
stelliom ff1a17c
Specify compilers for all packages
stelliom 2f611b0
Reverted last two commits
stelliom 2e75d0f
Added xpmem to network specs
stelliom a6cee92
Temporarily remove aws-ofi-nccl
stelliom 5a2eb2b
Removed xpmem from specs
stelliom 3fac875
Use gcc for libfabric
stelliom e2fba2f
Readd xpmem and use nvhpc for libfabric
stelliom 933524a
Remove NCCL
stelliom 25f4b92
Readd NCCL
stelliom 4f7d9d7
Use GCC 14
stelliom 3a79933
Compile aws-ofi-nccl with nvhpc
stelliom cbef501
Revert previous commit
stelliom File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Some comments aren't visible on the classic Files Changed page.
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,4 @@ | ||
| gcc: | ||
| version: "14" | ||
| nvhpc: | ||
| version: "26.3" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,11 @@ | ||
| name: icon | ||
| store: /user-environment | ||
| spack: | ||
| repo: https://github.com/spack/spack.git | ||
| commit: releases/v1.1 | ||
| packages: | ||
| repo: https://github.com/spack/spack-packages.git | ||
| commit: develop | ||
| modules: true | ||
| description: "Compilers and libraries required to build ICON" | ||
| version: 2 | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,37 @@ | ||
| icon: | ||
| compiler: [gcc, nvhpc] | ||
| network: | ||
| mpi: cray-mpich@9.1.0 +cuda %c,cxx,fortran=nvhpc ^libfabric@2 +gdrcopy %c=nvhpc | ||
| specs: [ xpmem ] | ||
| unify: when_possible | ||
| specs: | ||
| - python@3.12 %c,cxx=gcc ^libffi %c,cxx=gcc ^expat %c=gcc ^libmd %c=gcc ^libxcrypt %c=gcc ^gettext %c,cxx=gcc | ||
|
stelliom marked this conversation as resolved.
|
||
| - cuda@13.1 | ||
| - eccodes@2.36.4 +aec+fortran~ipo~memfs~netcdf~openmp~png~pthreads+shared~tools jp2k=openjpeg %c,cxx,fortran=nvhpc | ||
| - eccodes-cosmo-resources@2.36.0.3 | ||
| - hdf5@1.14.6 ~cxx+fortran+hl~ipo~java~map+mpi+shared~subfiling+szip~threadsafe+tools api=default %c,fortran=nvhpc | ||
| - netcdf-c@4.9.3 +blosc~byterange~dap~fsync~hdf4~jna~logging+mpi~nczarr_zip+optimize~parallel-netcdf+pic+shared+szip+zstd %c,cxx=nvhpc | ||
| - netcdf-fortran@4.6.2 ~doc+pic+shared %c,fortran=nvhpc | ||
| - boost ~mpi | ||
| - openblas %c,cxx,fortran=nvhpc | ||
| # for validation | ||
| - cdo | ||
| # everything needed for nccl on SS11 | ||
| - nccl@2.29.2 | ||
| - nccl-tests | ||
| - aws-ofi-nccl@1.17.2 | ||
| # extras | ||
| - libfyaml | ||
| - zlib-ng | ||
| - cmake | ||
| - findutils | ||
| variants: | ||
| - +mpi | ||
| - +cuda | ||
| - cuda_arch=90 | ||
| views: | ||
| default: | ||
| link: roots | ||
| uenv: | ||
| prefix_paths: | ||
| LD_LIBRARY_PATH: [lib, lib64] | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,15 @@ | ||
| default: | ||
| features: | ||
| - cuda | ||
| - mpi | ||
| - cray-mpich | ||
| - nccl | ||
| - nccl-tests | ||
| - openmp | ||
| - osu-micro-benchmarks | ||
| - serial | ||
| cc: mpicc | ||
| cxx: mpic++ | ||
| ftn: mpifort | ||
| views: | ||
| - default |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,26 @@ | ||
| modules: | ||
| # Paths to check when creating modules for all module sets | ||
| prefix_inspections: | ||
| bin: | ||
| - PATH | ||
| lib: | ||
| - LD_LIBRARY_PATH | ||
| lib64: | ||
| - LD_LIBRARY_PATH | ||
|
|
||
| default: | ||
| arch_folder: false | ||
| # Where to install modules | ||
| roots: | ||
| tcl: /snap/modules | ||
| tcl: | ||
| all: | ||
| autoload: run | ||
| hash_length: 0 | ||
| hide_implicits: true | ||
| exclude: | ||
| - '%gcc@7.5.0' | ||
| - '%gcc@12' | ||
| - 'gcc %gcc@7.5.0' | ||
| projections: | ||
| all: '{name}/{version}' |
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a reminder to pin this before finalizing the uenv. We typically do
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you 🙏