https://yiwen-cai.github.io/tags/%E6%B3%A8%E6%84%8F%E5%8A%9B%E4%BC%98%E5%8C%96/Recent content in 注意力优化 on Yiwen CaiHugo -- gohugo.iozh-cncaiyiwen.cs@foxmail.com (Yiwen Cai)caiyiwen.cs@foxmail.com (Yiwen Cai)© 2026 Yiwen CaiFri, 10 Jul 2026 21:05:59 +0800https://yiwen-cai.github.io/notes/papers/flashattention/Thu, 18 Jun 2026 00:00:00 +0000caiyiwen.cs@foxmail.com (Yiwen Cai)https://yiwen-cai.github.io/notes/papers/flashattention/通过 IO-aware 的 tiling 和重计算，在不改变 attention 数学定义的前提下大幅减少 HBM 读写，实现 2-4× 加速与 5-20× 内存节省——attention 优化的基础构件。