C. Lai | HKUST Computer Architecture Grouphttps://computer-arch-dev.hkust.edu.hk/author/c.-lai/C. LaiHugo Blox Builder (https://hugoblox.com)en-usWed, 01 Jan 2025 00:00:00 +0000https://computer-arch-dev.hkust.edu.hk/media/icon_hu_7613a4a452ac7087.pngC. Laihttps://computer-arch-dev.hkust.edu.hk/author/c.-lai/LLaMCAT: Optimizing Large Language Model Inference with Cache Arbitration and Throttlinghttps://computer-arch-dev.hkust.edu.hk/publication/icpp2025-llamcat-optimizing-large-language-model/Wed, 01 Jan 2025 00:00:00 +0000https://computer-arch-dev.hkust.edu.hk/publication/icpp2025-llamcat-optimizing-large-language-model/