<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>HiCache on Yiwen Cai</title><link>https://yiwen-cai.github.io/tags/hicache/</link><description>Recent content in HiCache on Yiwen Cai</description><generator>Hugo -- gohugo.io</generator><language>zh-cn</language><managingEditor>caiyiwen.cs@foxmail.com (Yiwen Cai)</managingEditor><webMaster>caiyiwen.cs@foxmail.com (Yiwen Cai)</webMaster><copyright>© 2026 Yiwen Cai</copyright><lastBuildDate>Tue, 03 Nov 2026 16:17:09 +0800</lastBuildDate><atom:link href="https://yiwen-cai.github.io/tags/hicache/index.xml" rel="self" type="application/rss+xml"/><item><title>SGLang 架构精读（三）：DP Attention、Two-Batch Overlap、HiCache 与 Mooncake PD 分离全景</title><link>https://yiwen-cai.github.io/notes/llm-inference/sglang-distributed-and-disaggregation/</link><pubDate>Tue, 03 Nov 2026 00:00:00 +0000</pubDate><author>caiyiwen.cs@foxmail.com (Yiwen Cai)</author><guid>https://yiwen-cai.github.io/notes/llm-inference/sglang-distributed-and-disaggregation/</guid><description>结合 SGLang 核心源码完整补齐《Learning SGLang》Part IV–V 进阶与多卡解耦架构（Ch 22–29）：涵盖 W4A16 与 W8A8 (FP8) 量化的 Roofline 改写算术、MLA 遇上传统 TP 的 8 倍 KV 冗余灾难与 DP Attention + MoE EP 解耦破局、Two-Batch Overlap (TBO) 双微批计算/通信双流乒乓隐藏、HiCache 三级存储金字塔逐层流水预取、Mooncake GPUDirect RDMA 逐层零拷贝 PD 分离，以及 sgl-router 影子前缀树动态负载均衡。</description></item></channel></rss>