1
Fork 0

feat(hpc): support run_dir staging and update docs

- Add run_dir and checkpoint_frequency to PPOArgs
- Update train.py to use run_dir for SummaryBoard, model saving, and loss plots
- Create configs/production_training.yaml for HPC production runs
- Update HPC.md with run_dir staging strategy details
This commit is contained in:
Tibo De Peuter 2026-04-04 18:59:05 +02:00
parent 34a887cd58
commit 92db8c2591
5 changed files with 42 additions and 50 deletions

View file

@ -0,0 +1,24 @@
# Full PPO training config for Brittle Star (HPC Production)
exp_name: "production_training"
seed: 1
track: true
capture_video: true
save_model: true
checkpoint_frequency: 100 # not yet implemented in train.py but here for future use
# Scaling for HPC (using A100 GPU slices)
num_envs: 128
total_timesteps: 10000000
num_steps: 128
num_minibatches: 4
update_epochs: 4
# Algorithm
learning_rate: 2.5e-4
anneal_lr: true
gamma: 0.99
gae_lambda: 0.95
clip_coef: 0.1
ent_coef: 0.01
vf_coef: 0.5
cuda: true