Age | Commit message (Expand) | Author |
---|---|---|
2023-08-25 | Rename and add flash atten | Gustaf Rydholm |
2022-10-02 | Add comments | Gustaf Rydholm |
2022-09-30 | Make rotary pos encoding mandatory | Gustaf Rydholm |
2022-09-30 | Update transformer | Gustaf Rydholm |
2022-09-18 | Format imports | Gustaf Rydholm |
2022-09-13 | Rename hidden dim to dim | Gustaf Rydholm |
2022-09-05 | Steal lucidrains axial encoding | Gustaf Rydholm |
2022-09-05 | Add absolute pos embedding | Gustaf Rydholm |
2021-11-01 | Update rotary embedding | Gustaf Rydholm |
2021-10-28 | Update rotary embedding | Gustaf Rydholm |
2021-10-28 | Remove 2D positional embedding | Gustaf Rydholm |
2021-10-28 | Remove absolute positional embedding | Gustaf Rydholm |
2021-10-27 | Add axial embedding | Gustaf Rydholm |
2021-10-27 | Rename transformer embeddings | Gustaf Rydholm |