1
Fork 0

docs(hpc): add docs/HPC.md and simplify README

- docs/HPC.md: cluster table, setup with vsc-venv, interactive debug
  (shell + JupyterLab on donphan), PBS batch submission, dependency mgmt
- README.md: HPC section condensed to a single link to docs/HPC.md
This commit is contained in:
Tibo De Peuter 2026-04-04 18:12:33 +02:00
parent 9dce017525
commit 953e102483
2 changed files with 131 additions and 22 deletions

View file

@ -16,26 +16,6 @@ example command:
uv run src/train.py --model_name my_model --epochs 50 --batch_size 32
```
## HPC Integration
## HPC
To run training on the VSC HPC (Ghent Tier 2):
### Setup
Run the installation script once on a login node. This sets up a virtual environment in `$VSC_DATA` with the required system modules (JAX, Flax, WandB) and lightweight dependencies.
```bash
bash scripts/hpc_install.sh
```
### Smoke Test
Verify everything runs on a compute node:
```bash
python src/train.py --config configs/hpc_smoke_test.yaml
```
### Submitting Jobs
Submit long-running experiments via the provided Slurm script:
```bash
sbatch scripts/hpc_train.slurm
```
See **[docs/HPC.md](docs/HPC.md)** for the full guide, including environment setup, cluster selection, interactive debugging, and job submission.