Fix ScalarType -> C type conversion in quantize_per_tensor
Summary: The `quantize_per_tensor` implementation was using the wrong type to assert that the lower bound was correct, it was using `char` (which can be signed or unsigned depending on the platform) instead of `int8_t` which is always signed. `signed char` would also work fine, but I figured we should use the C types already declared in the macros. Reviewed By: JacobSzwejbka Differential Revision: D48415930 fbshipit-source-id: 090a1f4d2c9824daeaae7c5bb5f022bbaef77131
R
Riley Dulin committed
950ce1b835bba4e57be45bb643fc5bda9a30d03e
Parent: 3644b60
Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
on 8/17/2023, 6:15:53 PM