flashinfer-ai/flashinfer - Morph

SIGN IN SIGN UP

flashinfer-ai / flashinfer UNCLAIMED

FlashInfer: Kernel Library for LLM Serving

0 0 0 Python

37 branches 233 tags

attention cuda distributed-inference gpu jit large-large-models llm-inference moe nvidia pytorch

yanqinz2 enable_pdl_and_bias_for_cudnn_backend (#2948)

e7f630c · 6h ago · 2,140 Commits

	.claude
	.devcontainer
	.github
	3rdparty
	benchmarks
	ci
	csrc
	docker
	docs
	flashinfer
	flashinfer-cubin
	flashinfer-jit-cache
	include
	licenses
	profiler
	scripts
	tests
	.clang-format		130 B
	.gitignore		3.7 KB
	.gitmodules		199 B
	.pre-commit-config.yaml		1.6 KB
	build_backend.py		5.7 KB
	build_utils.py		1.3 KB
	CLAUDE.md		21.7 KB
	CONTRIBUTING.md		6.8 KB
	Jenkinsfile		13.2 KB
	LICENSE		12.0 KB
	NOTICE		435 B
	pyproject.toml		3.0 KB
	pytest.ini		72 B
	README.md		10.0 KB
	requirements.txt		198 B
	version.txt		6 B