Fp8 block scale quantization for fmha fwd (#3330)
* add block scale parameters to kernel * add block scale to kernel * add smoke test * format * Revert "format" This reverts commit 356c3c970664af68a04e2694da7e270b8c8338bf. * only format my code * format py * fix auto not allowd in function prototype * change instance tttt to ttff * fix structured binding issue * change s_acc elementwise op * async pipeline add block scale * add quantation P using shift exp2 * precompute (m - shift) once per row * change blk scale seqstrt ptr name * fix some name * fix for deduction guide * fix some comments * add P scale to qr_ksvs_pipeline * add comment to idx_identity * change the method of calculating descale block index * unify naming style: use block_scale_ as name prefix * unify naming style * update the CHANGELOG.md * Add FP8 block scale quantization support for FMHA forward kernel --------- Co-authored-by: Illia Silin <98187287+illsilin@users.noreply.github.com> Co-authored-by: Po Yen Chen <PoYen.Chen@amd.com>
L
ltqin committed
dd0b4294afcf188f4a9154b7eea19f8e786c9539
Parent: 4c2c18e
Committed by GitHub <noreply@github.com>
on 1/22/2026, 4:58:26 AM