latency-constrained

Introduces Collate, a training framework for collaborative neural network learning that handles heterogeneous edge devices with latency constraints, achieving accuracy improvements with minimal overhead.

This paper proposes a latency-oriented neural network learning method that uses zerorized batch normalization to optimize DNN architectures for edge systems under strict latency constraints. Experiments show significant latency reduction with minimal accuracy loss on NVIDIA Jetson devices.