Skip to main content
IEEE Transactions on Signal ProcessingVolume 71, 2023, Pages 1319-1333

Large Deviations for Products of Non-Identically Distributed Network Matrices With Applications to Communication-Efficient Distributed Learning and Inference(Article)

  Save all to author list
  • aUniversity of Novi Sad, Department of Fundamental Sciences, Faculty of Technical Sciences, Novi Sad, 21000, Serbia
  • bUniversity of Novi Sad, Department of Power, Electronics, and Communications Engineering, Faculty of Technical Sciences, Novi Sad, 21000, Serbia
  • cCarnegie Mellon University, Department of Electrical and Computer Engineering, Pittsburgh, PA 15213, United States
  • dUniversity of Novi Sad, Department of Mathematics and Informatics, Faculty of Sciences, Novi Sad, 21000, Serbia
  • eAlexa Ai, Amazon.com, Inc., Pittsburgh, PA 15232, United States

Abstract

This paper studies products of independent but non-identically distributed random network matrices that arise as weight matrices in distributed consensus-type computation and inference procedures in peer-to-peer multi-agent networks. The non-identically distributed matrices studied in this paper model various application scenarios in which the agent communication network is time-varying, either naturally or engineered to achieve communication efficiency in computational procedures. First, under broad conditions on the statistics of the network matrix sequence, the product of the sequence is shown to converge almost surely to the consensus matrix and explicit large deviations rate of convergence are obtained. Specifically, given the admissible graph of interconnections modeling the base network topology, it is shown that the large deviations rate of consensus equals the minimum limiting value of the fluctuating graph cuts, where the edge costs are assigned through the current probabilities of the inter-agent communications. Secondly, an application of the above large deviations principle is studied in the context of distributed detection in time-varying networks with sequential observations. By adopting a consensus+innovations type distributed detection algorithm, as a by-product of this result, error exponents are obtained for the performance of distributed detection. It is shown that slow starts (slow increase) of inter-agent communication probabilities yield the same asymptotic error rate - and hence the same distributed detection performance, as if the communications were at their nominal levels from the beginning. As an important special case it is shown that when all the intermittent graph cuts have a link the probability of which increases to one, the performance of distributed detection is asymptotically optimal - i.e., equivalent to a centralized setup having access to all network data at all times. © 1991-2012 IEEE.

Author keywords

consensusDistributed inferenceerror exponentsinaccuracy rateslarge deviationsstochastic matrices

Indexed keywords

Engineering controlled terms:Computational efficiencyDistributed computer systemsError detectionGraphic methodsMatrix algebraMulti agent systemsNetwork topologyPeer to peer networksSignal processingTime varying networks
Engineering uncontrolled termsConsensusConvergenceDistributed inferenceError exponentInaccuracy rateInference algorithmLarge deviationsLimitingPeer-to-peer computingSignal processing algorithmsStochastic matrices
Engineering main heading:Stochastic systems

Funding details

Funding sponsor Funding number Acronym
Horizon 2020
957337
  • 1

    The work of Nemanja Petrov\u00EDc, Dragana Bajov\u00EDc, and Du an Jakovet\u00EDc was supported in part by the European Union's Horizon 2020 Research and Innovation program under Grant Agreement 957337.

  • ISSN: 1053587X
  • CODEN: ITPRE
  • Source Type: Journal
  • Original language: English
  • DOI: 10.1109/TSP.2023.3263254
  • Document Type: Article
  • Publisher: Institute of Electrical and Electronics Engineers Inc.

  Petrovic, N.; University of Novi Sad, Department of Fundamental Sciences, Faculty of Technical Sciences, Novi Sad, Serbia;
© Copyright 2023 Elsevier B.V., All rights reserved.

Cited by 3 documents

Rao, C. , Ding, Z. , Cumanan, K.
Outage Performance of Satellite-Terrestrial Channels With Shadowed Rician Fading via Large Deviations Principle
(2024) IEEE Transactions on Vehicular Technology
Bajović, D.
Inaccuracy Rates for Distributed Inference Over Random Networks With Applications to Social Learning
(2024) IEEE Transactions on Information Theory
Cirillo, M. , Bordignon, V. , Matta, V.
Memory-Aware Social Learning under Partial Information Sharing
(2023) IEEE Transactions on Signal Processing
View details of all 3 citations
{"topic":{"name":"Multi Agent Systems; Directed Graphs; Control System","id":27,"uri":"Topic/27","prominencePercentile":98.80801,"prominencePercentileString":"98.808","overallScholarlyOutput":0},"dig":"14a25390e04334e8bbabe5f12bd952363bb8cd9565fde43cd8dca59a300d5255"}

SciVal Topic Prominence

Topic:
Prominence percentile: