Finite-Time Consensus Dual Algorithm for Distributed Optimization over Digraphs

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
Date
2023-07-01
Major/Subject
Mcode
Degree programme
Language
en
Pages
6
Series
IFAC-PapersOnLine, Volume 56, issue 2
Abstract
In this paper, we solve the convex distributed optimization problems, which include unconstrained optimization and a special constrained problem commonly known as a resource allocation problem, over a network of agents among which the communication can be represented by directed graphs (digraphs), by using the finite-time consensus-based and dual-based first-order gradient descent (GD) techniques. The key point is that a special consensus matrix is utilized for problem reformulation to make our dual-based algorithm suitable for digraphs. By the property of distributed finite-time exact (not approximate) consensus, the classical centralized optimization techniques (e.g., Nesterov accelerated GD) can be embedded into our dual-based algorithm conveniently, which means our distributed algorithm can inherit performance of classical centralized algorithms that has been proved to have optimal convergence performance. As a result, our proposed algorithm has faster convergence rate related to the optimization iteration number compared with other distributed optimization algorithms in literature. Since there are finite consensus communication steps inside each consensus process, when the time needed to communicate values between two neighbors is less than a threshold of the time needed to perform local computations, our proposed algorithm is also faster related to the time, as demonstrated in the simulations.
Description
Publisher Copyright: Copyright © 2023 The Authors. This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/)
Keywords
digraphs, Distributed optimization, dual, finite-time consensus
Other note
Citation
Jiang , W & Charalambous , T 2023 , Finite-Time Consensus Dual Algorithm for Distributed Optimization over Digraphs . in H Ishii , Y Ebihara , J Imura & M Yamakita (eds) , IFAC-PapersOnLine . 2 edn , IFAC-PapersOnLine , no. 2 , vol. 56 , Elsevier , pp. 1926-1931 , IFAC World Congress , Yokohama , Japan , 09/07/2023 . https://doi.org/10.1016/j.ifacol.2023.10.1083