COMMITS
/ tests/test-tokenizer-0.cpp October 10, 2024
D
common : use common_ prefix for common library functions (#9805)
Diego Devesa committed
September 28, 2024
Z
vocab : refactor tokenizer to reduce init overhead (#9449)
Zhenwei Jin committed
July 14, 2024
C
llama : fix pre-tokenization of non-special added tokens (#8228)
compilade committed
July 5, 2024
J
Detokenizer fixes (#8039)
jaime-m-p committed
May 4, 2024
G
tests : add test-tokenizer-0.sh + fix some tokenizers (#7036)
Georgi Gerganov committed
April 29, 2024
G
llama : fix BPE pre-tokenization (#6920)
Georgi Gerganov committed
August 27, 2023
G
llama : more tokenizer fixes (#2810)
Georgi Gerganov committed
August 26, 2023
K
Fix spm whitespaces (#2806)
klosax committed
August 22, 2023
G
llama : fix whitespace escaping in tokenizer (#2724)
goerch committed
August 21, 2023
G
gguf : new file format with flexible meta data (beta) (#2398)
Georgi Gerganov committed
July 10, 2023
E
mpi : add support for distributed inference via MPI (#2099)
Evan Miller committed
June 24, 2023
D
llama : make model stateless and context stateful (llama_state) (#1797)
Didzis Gosko committed
June 16, 2023
B
build : fix and ignore MSVC warnings (#1889)
Borislav Stanimirov committed
April 17, 2023
A
llama : well-defined static initialization of complex objects (#927)
Arik Poznanski committed
March 28, 2023
G
tests : free llama context at the end of the test
Georgi Gerganov committed
March 25, 2023
G
Overhaul the examples structure
Georgi Gerganov committed
March 22, 2023
G
Introduce C-style API (#370)
Georgi Gerganov committed
March 21, 2023
G
Add tokenizer test + revert to C++11 (#355)
Georgi Gerganov committed