1
Fork 0

doc(hpc): resource specifiers

This commit is contained in:
Tibo De Peuter 2026-04-05 07:58:03 +02:00
parent 24ae7a2399
commit 3db714475f
3 changed files with 32 additions and 10 deletions

View file

@ -13,13 +13,37 @@ Run **once** after cloning the repository. This script handles all modules, mirr
```bash
# Option A: Interactive (on a compute node)
module swap cluster/donphan # or joltik
qsub -I -l nodes=1:gpus=1
module swap cluster/donphan # Debug cluster (CPU only)
# OR for GPU clusters:
# module swap cluster/joltik
# module swap cluster/accelgor
# module swap cluster/litleo
qsub -I -l nodes=1:gpus=1 # Only for GPU clusters
cd "${PBS_O_WORKDIR}"
bash scripts/hpc/install.sh
# Option B: Batch (Run in background)
qsub scripts/hpc/install.sh
# NOTE: GPU clusters (joltik/accelgor/litleo) require -l gpus=1 at runtime
qsub -l gpus=1 scripts/hpc/install.sh
```
## Production vs. Debug Clusters
Our scripts are cluster-agnostic and do **not** have hardcoded GPU requirements. Instead, you must request GPUs at runtime using the `-l gpus=1` flag when submitting to a production GPU cluster.
### Debugging (Donphan)
The `donphan` cluster does not support GPUs. Simply run the scripts without extra resource flags:
```bash
module swap cluster/donphan
qsub scripts/hpc/train.pbs
```
### Production (Joltik, Accelgor, Litleo)
These clusters provide GPU acceleration and **require** a GPU request at runtime:
```bash
module swap cluster/joltik # or accelgor/litleo
qsub -l gpus=1 scripts/hpc/train.pbs
```
## Interactive Debugging

View file

@ -8,7 +8,7 @@
# qsub scripts/hpc/install.sh
#PBS -N brittlestar-install
#PBS -l walltime=01:00:00
#PBS -l walltime=00:15:00
set -euo pipefail

View file

@ -1,13 +1,11 @@
#!/bin/bash
# scripts/hpc/train.pbs
#
# Usage (from project root):
# Production training (requires GPU at runtime):
# qsub -l gpus=1 scripts/hpc/train.pbs
# Debug/CPU training:
# qsub scripts/hpc/train.pbs
#PBS -N brittlestar-ppo
#PBS -l nodes=1:ppn=8:gpus=1
#PBS -l nodes=1:ppn=8
#PBS -l walltime=24:00:00
#PBS -l mem=32gb
#PBS -o runs/brittlestar-ppo.o$PBS_JOBID
#PBS -e runs/brittlestar-ppo.e$PBS_JOBID