Your Transformer Is Secretly Elastic
By Walter Simoncini · Paper · cs.LG
Scaling up transformers has produced models with broad capabilities, deployed across heterogeneous hardware and fluctuating workloads. Yet, model families offer only a few fixed sizes (e.g., S, B, L), forcing users to commit to a model based on hardware and latency constraints. T
Tags: Cs.lg