IEEE

Efficient KV Cache Spillover Management on Memory-Constrained GPU for LLM Inference

Abstract: The rapid growth of model parameters presents a significant challenge when deploying large generative models on GPU. Existing LLM runtime memory management solutions tend to maximize batch ...
IEEE

A Learning Model Predictive Control Framework With Long Short-Term Memory for Energy ...

Abstract: To leverage the complementary physical characteristics (e.g., dynamic response) of fuel cells (FCs) and supercapacitors (SCs), effective energy management strategies (EMSs) need to be ...