diff options
| author | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-10-10 18:05:44 +0200 |
|---|---|---|
| committer | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-10-10 18:05:44 +0200 |
| commit | 9d3e158f48e3e965d67f154e05faaaf1cadbb836 (patch) | |
| tree | 57b8e1b38874e9a778671abe4eaaa841fc56049b /training/conf/callbacks/wandb/swa.yaml | |
| parent | 38f546f0b86fc0dc89863b00c5ee8c6685394ef2 (diff) | |
Update configs
Diffstat (limited to 'training/conf/callbacks/wandb/swa.yaml')
| -rw-r--r-- | training/conf/callbacks/wandb/swa.yaml | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/training/conf/callbacks/wandb/swa.yaml b/training/conf/callbacks/wandb/swa.yaml new file mode 100644 index 0000000..73f8c66 --- /dev/null +++ b/training/conf/callbacks/wandb/swa.yaml @@ -0,0 +1,7 @@ +stochastic_weight_averaging: + _target_: pytorch_lightning.callbacks.StochasticWeightAveraging + swa_epoch_start: 0.8 + swa_lrs: 0.05 + annealing_epochs: 10 + annealing_strategy: cos + device: null |