COMMITS
/ examples/models/llama/attention.py May 13, 2025
P
[Executorch][llm] Enable leveraging ring kv cache via module swap (#10835)
pytorchbot committed
P
P
[Executorch][llm] Add support for ring kv cache and ring attention (#10832)
pytorchbot committed
April 29, 2025
J
Add Qwen3 0.6B, 1.7B, and 4B (#10539)
Jack committed
March 6, 2025
M
Add qk norm optionally before attention calculation
madhu-fb committed
February 24, 2025
J
Add qwen 2.5 (#8355)
Jack committed
February 7, 2025
S
Static attention implementation
Shen Chen Xu committed
February 6, 2025
S
Pass ForwardOptions from top level module and also return any relevant state as output
Shen Chen Xu committed
February 1, 2025
M
Single location to update optional args for all attentions
Mengtao Yuan committed
M
Add abstract base class for attention mechanisms with unified interface
Mengtao Yuan committed