SIGN IN SIGN UP

lookahead : add example for lookahead decoding (#4207)

* lookahead : init

* lookahead : generate and store n-grams

* lookahead : use loop instead recursion to generate n-grams

* lookahead : initial working implementation

* lookahead : filter repeating n-grams

* lookahead : use deterministic init

* lookahead : add to Makefile

* lookahead : fix a bug in the seq_id of the lookahead tokens

* lookahead : add comments

---------

Co-authored-by: slaren <slarengh@gmail.com>
G
Georgi Gerganov committed
922754a8d60080e956891f6cee1fb03aa48d57c6
Parent: 22da055
Committed by GitHub <noreply@github.com> on 11/26/2023, 6:33:07 PM