SIGN IN SIGN UP

Skeleton for GGUF conversion (#2018)

Summary:
Starting a skeleton implementation

- Only llama for now. Will add new architecture inside gguf_util/converters/
- Only fp32. Will figure out the quantization.
- Reusing the existing llama code in examples to reduce duplication. For other architectures, there won't be much duplication.

- Currently converting to PyTorch, and then going through export, to_edge, to_executorch. But that's an implementation detail.

Pull Request resolved: https://github.com/pytorch/executorch/pull/2018

Test Plan: `python extension/gguf_util/convert_main.py --gguf_file="/Users/mnachin/models_gguf/OpenHermes-2.5-Mistral-7B-fp16.gguf"`

Reviewed By: shoumikhin

Differential Revision: D53982833

Pulled By: mergennachin

fbshipit-source-id: 5402c0de3e729e434763a5d6a390448603e77429
M
Mergen Nachin committed
9283e506c822b8f388493243d32aad1234e1741c
Parent: a6d71e2
Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com> on 3/4/2024, 4:25:19 PM