Add tensor subclass to handle ggml quantized tensor (#2504)
Summary: Pull Request resolved: https://github.com/pytorch/executorch/pull/2504 Add a tensor subclass to hold ggml quantized q4_0 tensor * from_float(): quantize function from fp16 to q4_0 * to_float(): dequantize bypass-github-export-checks Reviewed By: mergennachin, digantdesai Differential Revision: D55042867 fbshipit-source-id: 1c78aa1f4039616a672847035e1d0c60b492615a
M
Mengwei Liu committed
04dc65a04affd228eef904602cf01937f4db44c0
Parent: 202bcf8
Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
on 3/20/2024, 10:10:30 PM