SIGN IN SIGN UP

Add support for vllm >= 0.19.0 (#1211)

* Fix vLLM 0.11 compatibility and restore hellaswag_cf

Co-authored-by: OpenAI Codex <codex@openai.com>

* Support vLLM 0.19 prompt schema

Co-authored-by: OpenAI Codex <codex@openai.com>

* Address vLLM PR review feedback

Co-authored-by: OpenAI Codex <codex@openai.com>

* Remove temporary hellaswag_cf task

Co-authored-by: OpenAI Codex <codex@openai.com>

* Clarify vLLM compatibility branches

Co-authored-by: OpenAI Codex <codex@openai.com>

* Handle tied MCQ logits in slow sample comparisons

Co-authored-by: OpenAI Codex <codex@openai.com>

* Handle flat VLM token outputs in tie checks

Co-authored-by: OpenAI Codex <codex@openai.com>

---------

Co-authored-by: OpenAI Codex <codex@openai.com>
L
lewtun committed
34889df34655caac4e0092ed040f2bd4af837447
Parent: e274b37
Committed by GitHub <noreply@github.com> on 4/13/2026, 11:47:38 AM