tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Nobody has forked this repository yet.