diff options
| author | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-07-30 23:15:03 +0200 |
|---|---|---|
| committer | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-07-30 23:15:03 +0200 |
| commit | 7268035fb9e57342612a8cc50a1fe04e8841ca2f (patch) | |
| tree | 8d4cf3743975bd25f2c04d6a56ff3d4608a7e8d9 /README.md | |
| parent | 92fc1c7ed2f9f64552be8f71d9b8ab0d5a0a88d4 (diff) | |
attr bug fix, properly loading network
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 10 |
1 files changed, 7 insertions, 3 deletions
@@ -26,10 +26,14 @@ python build-transitions --tokens iamdb_1kwp_tokens_1000.txt --lexicon iamdb_1kw (TODO: Not working atm, needed for GTN loss function) ## Todo -- [ ] Reimplement transformer from scratch -- [x] Implement Nyström attention (for efficient attention) - [ ] Efficient-net b0 + transformer decoder -- [ ] Test encoder pre-training ViT (CvT?) with Dino, then train decoder in a separate step +- [ ] Load everything with hydra, get it to work +- [ ] Tests +- [ ] Evaluation +- [ ] Wandb artifact fetcher +- [ ] attr refactor +- [ ] Refactor once more +- [ ] fix linting ## Run Sweeps |