Skip to content

Commit

Permalink
Docs: Update README.md in compile-notes for frontera
Browse files Browse the repository at this point in the history
  • Loading branch information
lwJi committed Nov 6, 2023
1 parent 74174b6 commit c979dda
Show file tree
Hide file tree
Showing 2 changed files with 54 additions and 18 deletions.
67 changes: 51 additions & 16 deletions Docs/compile-notes/frontera/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,12 +6,6 @@

- Compile GPU version: `idev -p rtx-dev -m 120`

* Download spack

- `git clone -c feature.manyFiles=true https://github.com/spack/spack.git`

- `git checkout relesases/v0.20`

* Download CarpetX and SpacetimeX

```bash
Expand All @@ -20,27 +14,57 @@
./GetComponents --root Cactus --parallel --no-shallow https://raw.githubusercontent.com/lwJi/SpacetimeX/main/Docs/thornlist/spacetimex.th
```

## Intel-Oneapi version (`[email protected]`)

## The Short Way

### Intel-Oneapi version (`[email protected]`)

* Load `intel/23.1.0`

- `module load intel/23.1.0`

* Setup spack
* Install SpacetimeX

- `. share/spack/setup-env.sh`

- `spack compiler find`
```bash
cd Cactus
gmake SpacetimeX-oneapi options=repos/SpacetimeX/Docs/compile-notes/frontera/configs/config_frontera_oneapi.cfg
cp repos/SpacetimeX/Docs/thornlist/spactimex.th configs/SpacetimeX-oneapi/ThornList
gmake -j24 SpacetimeX-oneapi
```

* Make `[email protected]` work with `[email protected]`
### CUDA version (`[email protected]`)

- modify `/var/spack/repos/builtin/packages/silo/package.py`:

## The Long Way

* Download spack

- `git clone -c feature.manyFiles=true https://github.com/spack/spack.git`

- use `develop` branch: (maybe `git checkout 141c7de5`)

- fix error with `krb5%oneapi` temporary:
* modify `var/spack/repos/builtin/packages/bison/package.py` line 68
```bash
- depends_on("[email protected]:1.10", when="@:4.10+hdf5")
+ depends_on("[email protected]:", when="@:4.10+hdf5")
+ conflicts(
+ "%oneapi",
+ msg="bison may have unexpected behaviours with oneapi, \
+ see https://github.com/spack/spack/issues/37172",
+ )
```

### Intel-Oneapi version (`[email protected]`)

* Load `intel/23.1.0`

- `module load intel/23.1.0`

* Setup spack

- `. share/spack/setup-env.sh`

- `spack compiler find`

* Create a dir where you want put `view` in (say `/work2/.../username/frontera/SpackView/oneapi`)

* Replace the last line of `oneapi-23.1.0/spack.yaml` with your own dir (say `/work2/.../username/frontera/SpackView/oneapi/view`)
Expand All @@ -64,8 +88,19 @@
gmake -j24 SpacetimeX-oneapi
```

* More tricks:

* Make `[email protected]` work with `[email protected]`:

modify `/var/spack/repos/builtin/packages/silo/package.py`:

```bash
- depends_on("[email protected]:1.10", when="@:4.10+hdf5")
+ depends_on("[email protected]:", when="@:4.10+hdf5")
```


## CUDA version (`[email protected]`)
### CUDA version (`[email protected]`)

* Make sure rerun `spack install [email protected] %[email protected]` again on `rtx-dev` or `rtx`

Expand Down
5 changes: 3 additions & 2 deletions Docs/compile-notes/frontera/oneapi-23.1.0/spack.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,16 +7,17 @@ spack:
- compilers:
- [email protected]
- packages:
- [email protected]
- adios2
- amrex ~fortran +hdf5 +openmp +particles
- amrex dimensions=3 ~fortran +hdf5 +openmp +particles
- boost cxxstd=17 +filesystem +mpi +system
- fftw +mpi +openmp
- hwloc @1.11.12
- nsimd
- openpmd-api @0.15.1
- ssht
- hdf5 +cxx +fortran +hl +mpi +threadsafe
- silo +hdf5 cflags="-Wno-incompatible-function-pointer-types -Wno-int-conversion"
- silo +hdf5
- yaml-cpp
- zlib
- gsl
Expand Down

0 comments on commit c979dda

Please sign in to comment.