lookahead : add example for lookahead decoding (#4207)
* lookahead : init * lookahead : generate and store n-grams * lookahead : use loop instead recursion to generate n-grams * lookahead : initial working implementation * lookahead : filter repeating n-grams * lookahead : use deterministic init * lookahead : add to Makefile * lookahead : fix a bug in the seq_id of the lookahead tokens * lookahead : add comments --------- Co-authored-by: slaren <slarengh@gmail.com>
G
Georgi Gerganov committed
922754a8d60080e956891f6cee1fb03aa48d57c6
Parent: 22da055
Committed by GitHub <noreply@github.com>
on 11/26/2023, 6:33:07 PM