dhruvhead/sglang-omni - Morph

SIGN IN SIGN UP

dhruvhead / sglang-omni UNCLAIMED

0 0 0 Python

50 branches 2 tags

asr audio-generation cuda distributed-inference inference model-serving multimodal music-generation openai-api pytorch sglang speech-recognition streaming text-to-speech tts

Chenye Charlie Zhu [Qwen3-Omni Perf] Add Breakable Prefill CUDA Graph support for Thinker text/audio prefill (#1381)

748a0b4 · 1d ago · 690 Commits

	.claude
	.github
	benchmarks
	docker
	docs
	examples
	playground
	scripts
	sglang_omni
	sglang_omni_router
	tests
	.dockerignore		94 B
	.editorconfig		341 B
	.gitignore		577 B
	.isort.cfg		55 B
	.pre-commit-config.yaml		1.9 KB
	LICENSE		11.1 KB
	pyproject.toml		5.2 KB
	README.md		8.1 KB