[llama-mm] Add export-friendly tile position embedding (#6671)
Summary: Before we make a decision on whether torchtune takes this export-friendly version of `TilePositionEmbedding`, we put it under `extension/llm` so that users can start to use it. Added unit tests to make sure the behavior is the same as the reference implementation in torchtune and export/AOTI/ET all working properly. Test Plan: Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: fe65ec6c590b6579ac68847cd2e3d4a09921b7e5 Pull Request resolved: https://github.com/pytorch/executorch/pull/6650 Co-authored-by: Mengwei Liu <larryliu@meta.com>
P
pytorchbot committed
f7e26d749eacc5717aff39ca1622d0aa849ae13f
Parent: 735e019
Committed by GitHub <noreply@github.com>
on 11/5/2024, 10:30:29 PM