An experimental port of OpenAI's Tokenizer to lua
1
Version 0.1.0-1 of tiktoken_core was uploaded 2 years ago. For lua >= 5.1