docs(hpc): add docs/HPC.md and simplify README
- docs/HPC.md: cluster table, setup with vsc-venv, interactive debug (shell + JupyterLab on donphan), PBS batch submission, dependency mgmt - README.md: HPC section condensed to a single link to docs/HPC.md
This commit is contained in:
parent
9dce017525
commit
953e102483
2 changed files with 131 additions and 22 deletions
24
README.md
24
README.md
|
|
@ -16,26 +16,6 @@ example command:
|
|||
uv run src/train.py --model_name my_model --epochs 50 --batch_size 32
|
||||
```
|
||||
|
||||
## HPC Integration
|
||||
## HPC
|
||||
|
||||
To run training on the VSC HPC (Ghent Tier 2):
|
||||
|
||||
### Setup
|
||||
|
||||
Run the installation script once on a login node. This sets up a virtual environment in `$VSC_DATA` with the required system modules (JAX, Flax, WandB) and lightweight dependencies.
|
||||
|
||||
```bash
|
||||
bash scripts/hpc_install.sh
|
||||
```
|
||||
|
||||
### Smoke Test
|
||||
Verify everything runs on a compute node:
|
||||
```bash
|
||||
python src/train.py --config configs/hpc_smoke_test.yaml
|
||||
```
|
||||
|
||||
### Submitting Jobs
|
||||
Submit long-running experiments via the provided Slurm script:
|
||||
```bash
|
||||
sbatch scripts/hpc_train.slurm
|
||||
```
|
||||
See **[docs/HPC.md](docs/HPC.md)** for the full guide, including environment setup, cluster selection, interactive debugging, and job submission.
|
||||
|
|
|
|||
Reference in a new issue