colossalai/inference - hpcaitech/ColossalAI - Morph

SIGN IN SIGN UP

hpcaitech / ColossalAI UNCLAIMED

Making large AI models cheaper, faster and more accessible

0 0 0 Python

	core
	executor
	kv_cache
	modeling
	server
	spec
	__init__.py	120 B
	batch_bucket.py	25.4 KB
	config.py	21.9 KB
	flash_decoding_utils.py	3.0 KB
	graph_runner.py	3.7 KB
	logit_processors.py	6.5 KB
	README.md	19.3 KB
	sampler.py	4.2 KB
	struct.py	5.4 KB
	utils.py	6.7 KB