From 24f9604116ac15e200567b77f1471122886783f1 Mon Sep 17 00:00:00 2001 From: Gustaf Rydholm Date: Sun, 29 Jan 2023 21:16:49 +0100 Subject: Update readme --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 6f95001..164ee24 100644 --- a/README.md +++ b/README.md @@ -75,6 +75,7 @@ Ideas of mine that did not work unfortunately: - [ ] fix linting - [x] Modularize the decoder - [ ] Add kv cache +- [ ] Train with Laprop - [x] Fix stems - [x] residual attn - [x] single kv head -- cgit v1.2.3-70-g09d2