Diloco

“DiLoCo: an approach to minimize the bandwidth needed across distributed centers.”