ggml : use full range for Q4_0 and Q4_2 quantization (#729)
* Use full range for q4_0 quantization By keeping the sign of the highest magnitude, we can make sure the highest value maps to -8, which is currently unused. This is a bit of a freebie since it is fully backwards compatible with the current format. * Update quantize_row_q4_0 for AVX/AVX2 * Update quantize_row_q4_0 for WASM Untested * Update quantize_row_q4_0 for Arm NEON * Update quantize_row_q4_0 for PowerPC Untested * Use full range for q4_2 quantization
U
unbounded committed
dd0eabc049fb1efc631cab8eb0a646808d704e18
Parent: 54bb60e
Committed by GitHub <noreply@github.com>
on 4/25/2023, 5:20:46 PM