Preprint Open access
Budget-Constrained Multi-Consensus Decentralized Gradient Descent
We investigate decentralized gradient descent (DGD) with emphasis on efficient communication and computation resource utilization under budget constraints. As a first step toward the broader communication-computation allocation problem, we consider and analyze a \textit{multi-consensus decentralized gradient descent} ( …