T-TAMER: Provably Taming Trade-offs in ML Serving
arXiv:2509.22992v1 Announce Type: new Abstract: As machine learning models continue to grow in size and complexity, efficient serving faces increasingly broad trade-offs spanning accuracy, latency, resource usage, and other objectives. Multi-model serving further complicates these trade-offs; for example, in cascaded…
