نسخة أولية وصول مفتوح
SEIS: Self-Evolving Inference Systems
Inference systems determine how fast and how cheaply language models can be served, so making them faster has direct practical value. However, prior work focuses mostly on optimizing certain parts such as kernels or memory within the large system. In this work, we take a holistic approach and apply agentic self-evoluti …