SIGN IN SIGN UP

Add more tests to sdpa_with_kv_cache for speculative decode (#4325)

Summary:
Pull Request resolved: https://github.com/pytorch/executorch/pull/4325

Simulate speculative decode with next iter larger than one token decode
bypass-github-export-checks

ghstack-source-id: 234820963

Reviewed By: manuelcandales

Differential Revision: D60045219

fbshipit-source-id: 8034fd234c7ccf648d27a3a8b57025c751ade3eb
K
Kimish Patel committed
3269e6106bad681f1ad4660b1194ed7c05747a7b
Parent: 74b0e89
Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com> on 7/23/2024, 3:27:48 PM