COMMITS
/ examples/models/llama/static_attention.py April 4, 2025
S
Support QK norm in static attention
Shen Chen Xu committed
March 11, 2025
S
Linear to Conv2d transform for static attention
Shen Chen Xu committed
March 6, 2025
M
Add qk norm optionally before attention calculation
madhu-fb committed
February 26, 2025
S
Add mask_val option to StaticAttentionmask
Shen Chen Xu committed
February 24, 2025
J
Add qwen 2.5 (#8355)
Jack committed
February 20, 2025
S
Add smart mask style KVCache and mask
Shen Chen Xu committed
February 19, 2025
S
Support HuggingFace RoPE in static attention
Shen Chen Xu committed
February 7, 2025
S
Static attention implementation
Shen Chen Xu committed