1
Fork 0
Commit graph

24 commits

Author SHA1 Message Date
37a4b59e04
feat: configure checkpoints saving 2026-04-16 15:10:21 +02:00
b4f1e98f8c
chore: cleanup and HPC integration 2026-04-15 15:29:32 +02:00
vsc46589 vscuser
b839024e6e feat(logging): added explained variance chart 2026-04-09 23:14:52 +02:00
3c6eec2410
fix(hpc): typos, .env and pythonpath 2026-04-09 00:01:58 +02:00
cedric
c1ba3900be fix: restored propper logging 2026-04-05 10:26:39 +00:00
cedric
9920ac35aa fix: removed wandb, for logging pr ; removed pbs output directive from train.pbs, did not work. 2026-04-05 09:29:47 +00:00
3db714475f doc(hpc): resource specifiers 2026-04-05 07:58:03 +02:00
059ac681ec fixup! fixup! fix(hpc): rework modules again 2026-04-05 00:36:11 +02:00
a02b5d5f16 fix(hpc): disk quota 2026-04-05 00:13:25 +02:00
a705154617 fix(hpc): rework modules again 2026-04-04 23:53:51 +02:00
7e902aa8b6 fixup! fix(hpc): numpy 2026-04-04 23:20:12 +02:00
70dd8c3161 fix(hpc): numpy 2026-04-04 22:58:47 +02:00
520d429bac fix(hpc): hardening 2026-04-04 22:48:16 +02:00
15319890a6 fix(hpc): streamlined install 2026-04-04 22:24:04 +02:00
2d08023abb fix(hpc): modules 2026-04-04 20:38:30 +02:00
a512682edd fix(hpc): additional insights 2026-04-04 20:26:09 +02:00
74e807472b feat(hpc): update PBS script with renamed --env-config-path flag 2026-04-04 19:07:05 +02:00
798a8ee9e6 feat(hpc): correct Tyro flags in PBS submission script 2026-04-04 19:03:38 +02:00
d1ca7a0f9f feat(hpc): pass scratch directory as run_dir in PBS script 2026-04-04 19:02:26 +02:00
92de38608f chore(hpc): finalize hpc settings and scripts
- Update train.pbs to default to smoke test for safety
- Update .gitignore and ruff.toml
- Sync uv.lock (removing python 3.11 remnants)
- Refine smoke test config
2026-04-04 18:59:38 +02:00
34a887cd58 refactor(hpc): use explicit PIP_CACHE_DIR/UV_CACHE_DIR, drop prose comments
Match comment style from previous cleanup commit:
- No section divider bars, no echo progress lines, no prose comments
  on obvious commands
- Replace XDG_CACHE_HOME with explicit PIP_CACHE_DIR and UV_CACHE_DIR
- Drop MPLCONFIGDIR (matplotlib cache is negligible in size)
2026-04-04 18:48:06 +02:00
7bcfa66685 feat(hpc): route caches to $VSC_SCRATCH, outputs to $VSC_DATA
- Install: redirect XDG_CACHE_HOME, UV_CACHE_DIR, MPLCONFIGDIR to
  $VSC_SCRATCH before any pip/module activity ($VSC_HOME is only ~3 GB)
- train.pbs:
  - Set same cache env vars at job start
  - Write run outputs and WandB cache to $VSC_SCRATCH during the run (fast I/O)
  - Copy results to $VSC_DATA/runs/<jobid>/ on completion for persistence
  - Redirect PBS stdout/stderr to $VSC_DATA/runs/<jobid>/job.{out,err}
  - Add cd $PBS_O_WORKDIR as first step (HPC best practice)
2026-04-04 18:39:45 +02:00
08d54b73b4 refactor: comment cleanups 2026-04-04 18:30:10 +02:00
9dce017525 refactor(hpc): migrate to PBS/vsc-venv, reorganise scripts under scripts/hpc/
- Replace Slurm headers with PBS (#PBS) directives
- Replace manual module+venv logic with vsc-venv --activate
- Cluster selection via 'module swap cluster/<name>' before qsub
- MUJOCO_GL=egl retained: required for headless physics sim and video rendering
- Delete deprecated scripts/hpc_install.sh and scripts/hpc_train.slurm
2026-04-04 18:11:38 +02:00