大模型加速的几种attention总结
1.sageattention
https://github.com/thu-ml/SageAttentionhttps://github.com/thu-ml/SageAttention
2.sliding tile attention
https://github.com/hao-ai-lab/FastVideo
1.sageattention
https://github.com/thu-ml/SageAttentionhttps://github.com/thu-ml/SageAttention
2.sliding tile attention
https://github.com/hao-ai-lab/FastVideo