diff options
| author | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2023-09-03 01:13:37 +0200 |
|---|---|---|
| committer | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2023-09-03 01:13:37 +0200 |
| commit | a65d3ec18a5541cec5297769f1027422975a62bc (patch) | |
| tree | 08e5e22f76db2449d265476f5fb42c5ea64a2776 /training/conf/callbacks/lightning | |
| parent | e4d618443808f0931bbef0b9e10a2c2a215281a5 (diff) | |
Update confs and callbacks
Diffstat (limited to 'training/conf/callbacks/lightning')
| -rw-r--r-- | training/conf/callbacks/lightning/swa.yaml | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/training/conf/callbacks/lightning/swa.yaml b/training/conf/callbacks/lightning/swa.yaml new file mode 100644 index 0000000..73f8c66 --- /dev/null +++ b/training/conf/callbacks/lightning/swa.yaml @@ -0,0 +1,7 @@ +stochastic_weight_averaging: + _target_: pytorch_lightning.callbacks.StochasticWeightAveraging + swa_epoch_start: 0.8 + swa_lrs: 0.05 + annealing_epochs: 10 + annealing_strategy: cos + device: null |