diff options
| author | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-07-28 15:14:55 +0200 |
|---|---|---|
| committer | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-07-28 15:14:55 +0200 |
| commit | c032ffb05a7ed86f8fe5d596f94e8997c558cae8 (patch) | |
| tree | bf890ffd4c815db7d510cfb281d253b5728f70c6 /README.md | |
| parent | 524bf4351ac295bd4ff9914bb1f32eda7f7ff855 (diff) | |
Reformatting with attrs, config for encoder and decoder
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 1 |
1 files changed, 0 insertions, 1 deletions
@@ -28,7 +28,6 @@ python build-transitions --tokens iamdb_1kwp_tokens_1000.txt --lexicon iamdb_1kw ## Todo - [ ] Reimplement transformer from scratch - [x] Implement Nyström attention (for efficient attention) -- [ ] Implement Dino - [ ] Efficient-net b0 + transformer decoder - [ ] Test encoder pre-training ViT (CvT?) with Dino, then train decoder in a separate step |