Skip to main content
MathematicsVolume 9, Issue 9, 1 May 2021, Article number 957

Measure of similarity between gmms by embedding of the parameter space that preserves kl divergence(Article)(Open Access)

  Save all to author list
  • aFaculty of Technical Sciences, University of Novi Sad, Obradovića 6, Novi Sad, 21000, Serbia
  • bDepartment of Machining, Faculty of Mechanical Engineering, VSB-Technical University of Ostrava, Assembly and Engineering Metrology, 17. listopadu 2172/15, Ostrava Poruba, 708 00, Czech Republic
  • cInstitute of Mathematics, Serbian Academy of Sciences and Arts, Kneza Mihaila 36, Belgrade, 11000, Serbia

Abstract

In this work, we deliver a novel measure of similarity between Gaussian mixture models (GMMs) by neighborhood preserving embedding (NPE) of the parameter space, that projects components of GMMs, which by our assumption lie close to lower dimensional manifold. By doing so, we obtain a transformation from the original high-dimensional parameter space, into a much lower-dimensional resulting parameter space. Therefore, resolving the distance between two GMMs is reduced to (taking the account of the corresponding weights) calculating the distance between sets of lower-dimensional Euclidean vectors. Much better trade-off between the recognition accuracy and the computational complexity is achieved in comparison to measures utilizing distances between Gaussian components evaluated in the original parameter space. The proposed measure is much more efficient in machine learning tasks that operate on large data sets, as in such tasks, the required number of overall Gaussian components is always large. Artificial, as well as real-world experiments are conducted, showing much better trade-off between recognition accuracy and computational complexity of the proposed measure, in comparison to all baseline measures of similarity between GMMs tested in this paper. © 2021 by the authors. Licensee MDPI, Basel, Switzerland.

Author keywords

Dimensionality reductionGaussian mixture modelsKL-divergenceSimilarity measures

Funding details

Funding sponsor Funding number Acronym
Ministarstvo Prosvete, Nauke i Tehnološkog Razvoja451 03-68/2020-14/200156MPNTR
Science Fund of the Republic of Serbia6524560
  • 1

    Funding: This research was funded by Science Fund of the Republic of Serbia grant number #6524560, and Serbian Ministry of Education, Science and Technological Development grant number 45103-68/2020-14/200156.

  • 2

    Acknowledgments: This research was supported by the Science Fund of the Republic of Serbia, #6524560, AI-S-ADAPT, and by the Serbian Ministry of Education, Science and Technological Development through the project no. 451 03-68/2020-14/200156: “Innovative Scientific and Artistic Research from the Faculty of Technical Sciences Activity Domain”.

  • ISSN: 22277390
  • Source Type: Journal
  • Original language: English
  • DOI: 10.3390/math9090957
  • Document Type: Article
  • Publisher: MDPI AG

  Krstanović, L.; Faculty of Technical Sciences, University of Novi Sad, Obradovića 6, Novi Sad, Serbia;
© Copyright 2021 Elsevier B.V., All rights reserved.

Cited by 3 documents

Wang, J. , Wang, S. , Fong, M.C.-M.
What Can Complex Systems Theory Tell Us About Understanding in the Human-AI Communication System?
(2024) 2024 6th International Conference on Natural Language Processing, ICNLP 2024
Kalušev, V. , Popović, B. , Janev, M.
Measure of Similarity between GMMs Based on Autoencoder-Generated Gaussian Component Representations
(2023) Axioms
Popović, B. , Janev, M. , Krstanović, L.
Measure of Similarity between GMMs Based on Geometry-Aware Dimensionality Reduction
(2023) Mathematics
View details of all 3 citations
{"topic":{"name":"Face Recognition; Positive Definite Matrix; Manifold","id":22355,"uri":"Topic/22355","prominencePercentile":78.425125,"prominencePercentileString":"78.425","overallScholarlyOutput":0},"dig":"ce1c30ae9ab21c133a36305f61a62636774ab8ba351073daff37bc251ca879e3"}

SciVal Topic Prominence

Topic:
Prominence percentile: