Tag
The tweet identifies inference serving as a prime target for autoresearch, emphasizing end-to-end optimization with constraints on latency, quality, and throughput, covering various aspects in a unified search space and hinting at future developments.
A proposed SLA-constrained carbon-aware routing policy for geo-distributed serverless clouds achieves up to 46.8% carbon reduction while maintaining zero SLA violations, evaluated on real AWS deployments.