Preprint Open access
Cooldown Landmines: Cross-Tenant Interference Attacks on LLM Gateways
LLM gateways enforce separate tenant quotas while sharing model deployments and cooldown records that temporarily exclude failing backends. However, a tenant's request failure can update these shared records and restrict other tenants' access to serviceable deployments. We identify two attacks that exploit this gap in …