diff options
| author | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2022-06-19 20:58:36 +0200 |
|---|---|---|
| committer | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2022-06-19 20:58:36 +0200 |
| commit | 8689e8da65ed02a13975956d70216d7f33db1688 (patch) | |
| tree | b5ce932f0db01ec3fe1bc0b634992a6c11e05c61 /training/conf/optimizer | |
| parent | 2a6f02f22a58d281519d3827ea956af5c02a8ea2 (diff) | |
Fix lr and optim conf
Diffstat (limited to 'training/conf/optimizer')
| -rw-r--r-- | training/conf/optimizer/radam.yaml | 6 |
1 files changed, 6 insertions, 0 deletions
diff --git a/training/conf/optimizer/radam.yaml b/training/conf/optimizer/radam.yaml new file mode 100644 index 0000000..d11fcb5 --- /dev/null +++ b/training/conf/optimizer/radam.yaml @@ -0,0 +1,6 @@ +_target_: torch.optim.RAdam +lr: 1.5e-4 +betas: [0.9, 0.999] +weight_decay: 1.0e-4 +eps: 1.0e-8 +parameters: network |