examples/inference/benchmark_ops - hpcaitech/ColossalAI

Making large AI models cheaper, faster and more accessible

0 0 0 Python

	benchmark_context_attn_unpad.py	5.4 KB
	benchmark_decoding_attn.py	5.2 KB
	benchmark_flash_decoding_attention.py	6.2 KB
	benchmark_fused_rotary_embdding_unpad.py	5.5 KB
	benchmark_kv_cache_memcopy.py	3.7 KB
	benchmark_rmsnorm.py	2.9 KB
	benchmark_rotary_embedding.py	2.3 KB
	benchmark_xine_copy.py	1.6 KB
	test_ci.sh