[ET-VK][ez] Add support for buffer backed qparams in int4 linear + add checks for physical limits when allocating (#10233)
## Context Currently, the groupwise quantized int4 linear op implementation forces the scales and zero tensor to be a `Texture3D`. However, for i.e. transformer models that have a logit linear layer, the image extents required may exceed the maximum image extents available on the device. ## Changes * Add support for the scales and zero tensor being a `Buffer` instead of a `Texture3D` * Add checks when allocating buffers or images for tensors that the requested resource fits within the physical device limits Differential Revision: [D72662176](https://our.internmc.facebook.com/intern/diff/D72662176/)
P
pytorchbot committed
5999f101dc5663c3c3c51e1fcefab08896e4ce54
Parent: 8fb9209
Committed by GitHub <noreply@github.com>
on 4/16/2025, 6:54:47 PM