SIGN IN SIGN UP

add phi-3-mini runner (#3951)

Summary:
This PR adds a basic runner for running the phi-3-mini model. It uses sentencepiece to create the tokenizer.

Commands for running the model:
```
# setup executorch per instructions in https://pytorch.org/executorch/stable/getting-started-setup.html
# install latest transformers
pip uninstall -y transformers && pip install git+https://github.com/huggingface/transformers
# export the model, will take a few minutes
cd examples/models/phi-3-mini
python export_model.py
# download the tokenizer.model
wget -O tokenizer.model https://huggingface.co/microsoft/Phi-3-mini-128k-instruct/resolve/main/tokenizer.model?download=true
# build the runner
mkdir cmake-out
cd cmake-out
cmake ..
cd ..
cmake --build cmake-out -j10
./cmake-out/phi_3_mini_runner
```

Pull Request resolved: https://github.com/pytorch/executorch/pull/3951

Reviewed By: larryliu0820

Differential Revision: D58477481

Pulled By: helunwencser

fbshipit-source-id: c5a7e6781338d4347a1b9d06b22e23613633df6b
L
Lunwen He committed
70743bbf0e3684d8f6021b2d347e16bdd0f07272
Parent: 4ed5bc7
Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com> on 6/13/2024, 10:36:05 PM