diff options
| author | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2023-09-11 22:15:26 +0200 |
|---|---|---|
| committer | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2023-09-11 22:15:26 +0200 |
| commit | 56dc112cfb649217cd624b4ff305e2db83a383b7 (patch) | |
| tree | 92555f27313f8bb4650a3d8dfa1c88ac6e1bfbf8 /training/conf/optimizer/adamw.yaml | |
| parent | bece39632a83ef3c8c0f49c753cbc6110d2f78b9 (diff) | |
Update configs
Diffstat (limited to 'training/conf/optimizer/adamw.yaml')
| -rw-r--r-- | training/conf/optimizer/adamw.yaml | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/training/conf/optimizer/adamw.yaml b/training/conf/optimizer/adamw.yaml new file mode 100644 index 0000000..568c67b --- /dev/null +++ b/training/conf/optimizer/adamw.yaml @@ -0,0 +1,5 @@ +_target_: torch.optim.AdamW +lr: 1.5e-4 +betas: [0.95, 0.98] +weight_decay: 1.0e-2 +eps: 1.0e-6 |