diff options
| author | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-04-05 23:24:20 +0200 |
|---|---|---|
| committer | Gustaf Rydholm <gustaf.rydholm@gmail.com> | 2021-04-05 23:24:20 +0200 |
| commit | dedf8deb025ac9efdad5e9baf9165ef63d6829ff (patch) | |
| tree | 56b10fcaef479d8abe9b0e6c05e07ad5e02b9ab0 /README.md | |
| parent | 532286b516b17d279c321358bf03dddc8adc8029 (diff) | |
Pre-commit fixes, optimizer loading fix
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 5 |
1 files changed, 2 insertions, 3 deletions
@@ -11,7 +11,7 @@ TBC Extract text from the iam dataset: ``` -poetry run extract-iam-text --use_words --save_text train.txt --save_tokens letters.txt +poetry run extract-iam-text --use_words --save_text train.txt --save_tokens letters.txt ``` Create word pieces from the extracted training text: @@ -32,7 +32,7 @@ poetry run build-transitions --tokens iamdb_1kwp_tokens_1000.txt --lexicon iamdb - [x] transform that encodes iam targets to wordpieces - [x] transducer loss function - [ ] Train with word pieces -- [ ] Local attention in first layer of transformer +- [ ] Local attention in first layer of transformer - [ ] Halonet encoder - [ ] Implement CPC - [ ] https://arxiv.org/pdf/1905.09272.pdf @@ -59,4 +59,3 @@ export SWEEP_ID=... wandb agent $SWEEP_ID ``` - |