] Add python impl of sdpa_with_kv_cache (#2153)
Summary: Pull Request resolved: https://github.com/pytorch/executorch/pull/2153 This change will allow model rewrite in eager model to use sdpa_with_kv_cache. ghstack-source-id: 216744337 exported-using-ghexport validated oss ci is clean. have to by pass because ci think its needs internal linter to pass. bypass-github-export-checks Reviewed By: mergennachin Differential Revision: D54075829 fbshipit-source-id: ba1a3a89f294d9ffe860dc40d181dcd7ba01a23d
K
Kimish Patel committed
92ac8902e6691a531705554577a6fa5bfeac2ad5
Parent: 5fae05a
Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
on 2/29/2024, 5:50:29 PM