This is a Java implementation of a GPT3/4 tokenizer, loosely ported from Tiktoken with the help of ChatGPT. ...that all 3.5-turbo models released after 0613 now have tokenization counts for messages ...
There was an error while loading. Please reload this page. java/coccoc-tokenizer-java/src/main/java/com/coccoc/Tokenizer.java Tokenizer.java internal/io java/coccoc ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results