[llava][18/N] Move token generation loop to a class (#4705)
* [llava][18/N] Move token generation loop to a class As titled. This PR moves the token generation loop in llama2 runner into a new class so it can be reused.
H
Hansong committed
9293b780f475c710b737c5452e9deeff304291f0
Parent: e404e19
Committed by GitHub <noreply@github.com>
on 8/13/2024, 8:21:21 PM