diff options
| author | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-08-02 21:13:48 +0200 |
|---|---|---|
| committer | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-08-02 21:13:48 +0200 |
| commit | 75801019981492eedf9280cb352eea3d8e99b65f (patch) | |
| tree | 6521cc4134459e42591b2375f70acd348741474e /training/conf/network/decoder | |
| parent | e5eca28438cd17d436359f2c6eee0bb9e55d2a8b (diff) | |
Fix log import, fix mapping in datamodules, fix nn modules can be hashed
Diffstat (limited to 'training/conf/network/decoder')
| -rw-r--r-- | training/conf/network/decoder/transformer_decoder.yaml | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/training/conf/network/decoder/transformer_decoder.yaml b/training/conf/network/decoder/transformer_decoder.yaml index 3122de1..90b9d8a 100644 --- a/training/conf/network/decoder/transformer_decoder.yaml +++ b/training/conf/network/decoder/transformer_decoder.yaml @@ -2,12 +2,12 @@ defaults: - rotary_emb: null _target_: text_recognizer.networks.transformer.Decoder -dim: 256 +dim: 96 depth: 2 num_heads: 8 attn_fn: text_recognizer.networks.transformer.attention.Attention attn_kwargs: - dim_head: 64 + dim_head: 16 dropout_rate: 0.2 norm_fn: torch.nn.LayerNorm ff_fn: text_recognizer.networks.transformer.mlp.FeedForward |