![[ICO]](/icons/blank.gif){kind=icon}
![[PARENTDIR]](/icons/back.gif){kind=icon}
![[TXT]](/icons/text.gif){kind=icon}
![[ ]](/icons/unknown.gif){kind=icon}
![[DIR]](/icons/folder.gif){kind=icon}
| Name | Last modified | Size | Description |
|---|---|---|---|---|
| Parent Directory | - | ||
| __init__.py | 2026-08-16 17:27 | 2.6K | |
| __init__.pyi | 2026-08-16 17:27 | 55K | |
| __pycache__/ | 2026-08-16 17:27 | - | |
| decoders/ | 2026-08-16 17:27 | - | |
| implementations/ | 2026-08-16 17:27 | - | |
| models/ | 2026-08-16 17:27 | - | |
| normalizers/ | 2026-08-16 17:27 | - | |
| pre_tokenizers/ | 2026-08-16 17:27 | - | |
| processors/ | 2026-08-16 17:27 | - | |
| tokenizers.abi3.so | 2026-08-16 17:27 | 9.6M | |
| tokenizers.pyi | 2026-08-16 17:27 | 468 | |
| tools/ | 2026-08-16 17:27 | - | |
| trainers/ | 2026-08-16 17:27 | - | |