1
Fork 0
Commit graph

20 commits

Author SHA1 Message Date
3db714475f doc(hpc): resource specifiers 2026-04-05 07:58:03 +02:00
059ac681ec fixup! fixup! fix(hpc): rework modules again 2026-04-05 00:36:11 +02:00
a02b5d5f16 fix(hpc): disk quota 2026-04-05 00:13:25 +02:00
3f9c751312 fix(hpc): pip cache 2026-04-04 23:58:32 +02:00
a705154617 fix(hpc): rework modules again 2026-04-04 23:53:51 +02:00
7e902aa8b6 fixup! fix(hpc): numpy 2026-04-04 23:20:12 +02:00
1b15932369 refactor(hpc): cleanup 2026-04-04 23:04:19 +02:00
70dd8c3161 fix(hpc): numpy 2026-04-04 22:58:47 +02:00
520d429bac fix(hpc): hardening 2026-04-04 22:48:16 +02:00
15319890a6 fix(hpc): streamlined install 2026-04-04 22:24:04 +02:00
78aa20868e feat(hpc): smart cluster modules 2026-04-04 21:53:32 +02:00
51da258feb refactor(hpc): more verbose 2026-04-04 21:40:07 +02:00
912574339e fix(hpc): package versions mismatches 2026-04-04 21:30:41 +02:00
f8e0ca277c refactor: cleanups 2026-04-04 21:25:59 +02:00
a512682edd fix(hpc): additional insights 2026-04-04 20:26:09 +02:00
4339978cc6 fix(hpc): relax unbound variables 2026-04-04 20:04:05 +02:00
34a887cd58 refactor(hpc): use explicit PIP_CACHE_DIR/UV_CACHE_DIR, drop prose comments
Match comment style from previous cleanup commit:
- No section divider bars, no echo progress lines, no prose comments
  on obvious commands
- Replace XDG_CACHE_HOME with explicit PIP_CACHE_DIR and UV_CACHE_DIR
- Drop MPLCONFIGDIR (matplotlib cache is negligible in size)
2026-04-04 18:48:06 +02:00
7bcfa66685 feat(hpc): route caches to $VSC_SCRATCH, outputs to $VSC_DATA
- Install: redirect XDG_CACHE_HOME, UV_CACHE_DIR, MPLCONFIGDIR to
  $VSC_SCRATCH before any pip/module activity ($VSC_HOME is only ~3 GB)
- train.pbs:
  - Set same cache env vars at job start
  - Write run outputs and WandB cache to $VSC_SCRATCH during the run (fast I/O)
  - Copy results to $VSC_DATA/runs/<jobid>/ on completion for persistence
  - Redirect PBS stdout/stderr to $VSC_DATA/runs/<jobid>/job.{out,err}
  - Add cd $PBS_O_WORKDIR as first step (HPC best practice)
2026-04-04 18:39:45 +02:00
08d54b73b4 refactor: comment cleanups 2026-04-04 18:30:10 +02:00
9dce017525 refactor(hpc): migrate to PBS/vsc-venv, reorganise scripts under scripts/hpc/
- Replace Slurm headers with PBS (#PBS) directives
- Replace manual module+venv logic with vsc-venv --activate
- Cluster selection via 'module swap cluster/<name>' before qsub
- MUJOCO_GL=egl retained: required for headless physics sim and video rendering
- Delete deprecated scripts/hpc_install.sh and scripts/hpc_train.slurm
2026-04-04 18:11:38 +02:00