summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
-rw-r--r--README.md6
1 files changed, 4 insertions, 2 deletions
diff --git a/README.md b/README.md
index 8511b83..f549cda 100644
--- a/README.md
+++ b/README.md
@@ -75,5 +75,7 @@ Ideas of mine that did not work unfortunately:
- [ ] fix linting
- [ ] Modularize the decoder
- [ ] Add kv cache
-- [ ] Fix stems
-- [ ] residual attn
+- [x] Fix stems
+- [x] residual attn
+- [x] single kv head
+- [x] fix rotary embedding