Skip to main content
MathematicsVolume 11, Issue 1, January 2023, Article number 175

Measure of Similarity between GMMs Based on Geometry-Aware Dimensionality Reduction(Article)(Open Access)

  Save all to author list
  • aFaculty of Technical Sciences, University of Novi Sad, Trg Dositeja Obradovića 6, Novi Sad, 21000, Serbia
  • bInstitute of Mathematics, Serbian Academy of Sciences and Arts, Kneza Mihaila 36, Belgrade, 11000, Serbia

Abstract

Gaussian Mixture Models (GMMs) are used in many traditional expert systems and modern artificial intelligence tasks such as automatic speech recognition, image recognition and retrieval, pattern recognition, speaker recognition and verification, financial forecasting applications and others, as simple statistical representations of underlying data. Those representations typically require many high-dimensional GMM components that consume large computing resources and increase computation time. On the other hand, real-time applications require computationally efficient algorithms and for that reason, various GMM similarity measures and dimensionality reduction techniques have been examined to reduce the computational complexity. In this paper, a novel GMM similarity measure is proposed. The measure is based on a recently presented nonlinear geometry-aware dimensionality reduction algorithm for the manifold of Symmetric Positive Definite (SPD) matrices. The algorithm is applied over SPD representations of the original data. The local neighborhood information from the original high-dimensional parameter space is preserved by preserving distance to the local mean. Instead of dealing with high-dimensional parameter space, the method operates on much lower-dimensional space of transformed parameters. Resolving the distance between such representations is reduced to calculating the distance among lower-dimensional matrices. The method was tested within a texture recognition task where superior state-of-the-art performance in terms of the trade-off between recognition accuracy and computational complexity has been achieved in comparison with all baseline GMM similarity measures. © 2022 by the authors.

Author keywords

dimensionality reductionGaussian Mixture Modelssimilarity measurestexture recognition

Funding details

Funding sponsor Funding number Acronym
Ministarstvo Prosvete, Nauke i Tehnološkog Razvoja45103-68/2020-14/200156MPNTR
Science Fund of the Republic of Serbia6524560
  • 1

    This research was supported by the Science Fund of the Republic of Serbia, #6524560, AI-S-ADAPT, and by the Serbian Ministry of Education, Science and Technological Development through the project no. 45103-68/2020-14/200156: “Innovative Scientific and Artistic Research from the Faculty of Technical Sciences Activity Domain”.

  • ISSN: 22277390
  • Source Type: Journal
  • Original language: English
  • DOI: 10.3390/math11010175
  • Document Type: Article
  • Publisher: MDPI

  Popović, B.; Faculty of Technical Sciences, University of Novi Sad, Trg Dositeja Obradovića 6, Novi Sad, Serbia;
© Copyright 2023 Elsevier B.V., All rights reserved.

Cited by 4 documents

Kanchana, R. , Fernandez, F.M.H.
Enhancing Gaussian Mixture Model Efficiency Through Covariance Matrix Optimization, Singular Value Decomposition, and Block Toeplitz Matrices
(2024) Proceedings of the 9th International Conference on Communication and Electronics Systems, ICCES 2024
Kalušev, V. , Popović, B. , Janev, M.
Measure of Similarity between GMMs Based on Autoencoder-Generated Gaussian Component Representations
(2023) Axioms
Nielsen, F.
A Simple Approximation Method for the Fisher–Rao Distance between Multivariate Normal Distributions
(2023) Entropy
View details of all 4 citations
{"topic":{"name":"Dimensionality Reduction; Clustering Algorithm; Manifold","id":1573,"uri":"Topic/1573","prominencePercentile":90.24307,"prominencePercentileString":"90.243","overallScholarlyOutput":0},"dig":"1234e69f38257c5c6023e0d118a8eeee0cd82f8f8803b2d2f2c508e2998901b6"}

SciVal Topic Prominence

Topic:
Prominence percentile: