26 lines
768 B
Markdown
26 lines
768 B
Markdown
# neural compression
|
|
|
|
Example usage:
|
|
|
|
```shell
|
|
python main.py --debug train --dataset enwik9 --data-root ~/data/datasets/ml --method optuna --model transformer --model-save-path ~/data/ml-models/test-transformer.pt
|
|
|
|
python benchmark.py --debug train --dataset enwik9 --data-root ~/data/datasets/ml --method optuna --model cnn --model-save-path ~/data/ml-models/test-cnn.pt
|
|
```
|
|
|
|
## Running locally
|
|
|
|
```
|
|
uv sync --all-extras
|
|
```
|
|
|
|
## Running on the Ghent University HPC
|
|
|
|
See the [Infrastructure docs](https://docs.hpc.ugent.be/infrastructure/#gpu-clusters) for more information about the clusters.
|
|
|
|
```
|
|
module swap cluster/joltik # Specify the (GPU) cluster, {joltik,accelgor,litleo}
|
|
|
|
qsub job.pbs # Submit job
|
|
qstat # Check status
|
|
```
|