SIGN IN SIGN UP

vulkan/cuda: fix topk_moe with exp_probs_b (#18071)

I updated test_topk_moe to more closely match llm_graph_context::build_moe_ffn
and added coverage for exp_probs_b and some other missing combinations. This
exposed a bug in both CUDA and Vulkan backends where they were assuming the
input to argsort and the input to get_rows are the same. I'd like to optimize
this graph in another change, but for now just get it functional.

CUDA also had a bug where it got n_experts from the wrong place, leading to
GGML_ASSERT failures in some of the new tests.
J
Jeff Bolz committed
b365c3ff010256c76fa030a621a4a96fc06a8442
Parent: cb64222
Committed by GitHub <noreply@github.com> on 12/21/2025, 9:27:34 AM