Age | Commit message (Collapse) | Author | |
---|---|---|---|
2023-09-11 | Add swiglu | Gustaf Rydholm | |
2023-09-11 | Remove separate ff class | Gustaf Rydholm | |
2023-09-11 | Update encoder/decoder attention and forward pass | Gustaf Rydholm | |
2023-09-11 | Update attention with rotary embedding | Gustaf Rydholm | |
2023-09-11 | Update attend | Gustaf Rydholm | |
2023-09-11 | Remove absolute embedding | Gustaf Rydholm | |
2023-09-11 | Add rotary embedding | Gustaf Rydholm | |
2023-09-03 | Update imports | Gustaf Rydholm | |
2023-08-25 | Rename and add flash atten | Gustaf Rydholm | |