Denial of Deadline: Network-Driven Accuracy Collapse in Distributed Inference Pipelines
By Jhonatan Tavori · Paper · cs.NI
Inference systems increasingly combine a fast path that returns predictions within the application's latency deadline together with a higher-accuracy slow path that runs higher-compute methods on stronger, remote hardware, so its results can be returned on time and combined with