0 0 0 Python

Add an option to turn on/off sdpa_with_kv_cache (#4444)

Summary:
Pull Request resolved: https://github.com/pytorch/executorch/pull/4444

As titled, need to test both options in export_llava.py.

Reviewed By: tarun292, iseeyuan

Differential Revision: D60406655

fbshipit-source-id: a423c65c6d134515e7399a8ef14ea54b76b34154

Mengwei Liu committed 2y ago

db1c4d838b021bce225ad382926c1942c3eae425

Parent: 318a178

Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com> on 7/30/2024, 1:45:01 AM