summaryrefslogtreecommitdiff
path: root/README.md
diff options
context:
space:
mode:
Diffstat (limited to 'README.md')
-rw-r--r--README.md1
1 files changed, 0 insertions, 1 deletions
diff --git a/README.md b/README.md
index 1c6c0ef..3fdaca5 100644
--- a/README.md
+++ b/README.md
@@ -28,7 +28,6 @@ python build-transitions --tokens iamdb_1kwp_tokens_1000.txt --lexicon iamdb_1kw
## Todo
- [ ] Reimplement transformer from scratch
- [x] Implement Nyström attention (for efficient attention)
-- [ ] Implement Dino
- [ ] Efficient-net b0 + transformer decoder
- [ ] Test encoder pre-training ViT (CvT?) with Dino, then train decoder in a separate step