Skip to main content
Electronics (Switzerland)Volume 11, Issue 8, April-2 2022, Article number 1178

Universal Reconfigurable Hardware Accelerator for Sparse Machine Learning Predictive Models(Article)(Open Access)

  Save all to author list
  • Faculty of Technical Sciences, University of Novi Sad, Novi Sad, 21000, Serbia

Abstract

This study presents a universal reconfigurable hardware accelerator for efficient processing of sparse decision trees, artificial neural networks and support vector machines. The main idea is to develop a hardware accelerator that will be able to directly process sparse machine learning models, resulting in shorter inference times and lower power consumption compared to existing solutions. To the author’s best knowledge, this is the first hardware accelerator of this type. Additionally, this is the first accelerator that is capable of processing sparse machine learning models of different types. Besides the hardware accelerator itself, algorithms for induction of sparse decision trees, pruning of support vector machines and artificial neural networks are presented. Such sparse machine learning classifiers are attractive since they require significantly less memory resources for storing model parameters. This results in reduced data movement between the accelerator and the DRAM memory, as well as a reduced number of operations required to process input instances, leading to faster and more energy-efficient processing. This could be of a significant interest in edge-based applications, with severely constrained memory, computation resources and power consumption. The performance of algorithms and the developed hardware accelerator are demonstrated using standard benchmark datasets from the UCI Machine Learning Repository database. The results of the experimental study reveal that the proposed algorithms and presented hardware accelerator are superior when compared to some of the existing solutions. Throughput is increased up to 2 times for decision trees, 2.3 times for support vector machines and 38 times for artificial neural networks. When the processing latency is considered, maximum performance improvement is even higher: up to a 4.4 times reduction for decision trees, a 84.1 times reduction for support vector machines and a 22.2 times reduction for artificial neural networks. Finally, since it is capable of supporting sparse classifiers, the usage of the proposed hardware accelerator leads to a significant reduction in energy spent on DRAM data transfers and a reduction of 50.16% for decision trees, 93.65% for support vector machines and as much as 93.75% for artificial neural networks, respectively. © 2022 by the authors. Licensee MDPI, Basel, Switzerland.

Author keywords

artificial neural networksdecision treesedge computinghardware accelerator architecturessparse predictive modelssupport vector machines

Funding details

Funding sponsor Funding number Acronym
Horizon 2020 Framework Programme
See opportunities by H2020
856967H2020
451-03-68/2022-14/ 200156,200156
  • 1

    Funding: This work received funding from the European Union\u2019s Horizon 2020 research and innovation programme under Grant Agreement number 856967 and has been supported by the Ministry of Education, Science and Technological Development through project No. 451-03-68/2022-14/ 200156 \u201CInnovative scientific and artistic research from the FTS (activity) domain\u201D.

  • ISSN: 20799292
  • Source Type: Journal
  • Original language: English
  • DOI: 10.3390/electronics11081178
  • Document Type: Article
  • Publisher: MDPI

  Teodorovic, P.; Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Serbia;
© Copyright 2022 Elsevier B.V., All rights reserved.

Cited by 2 documents

Kumar, S.S. , Dev, R. , Singh, B.K.
FPGA-based Automatic Pill Dispenser using Decision Tree Classifier
(2024) 2024 International Conference on Electrical, Electronics and Computing Technologies, ICEECT 2024
Ali, D. , Rehman, A.U. , Khan, F.H.
Hardware Accelerators And Accelerators For Machine Learning
(2022) 2022 International Conference on IT and Industrial Technologies, ICIT 2022
View details of all 2 citations
{"topic":{"name":"Support Vector Machine; Field Programmable Gate Arrays; Classifier","id":58406,"uri":"Topic/58406","prominencePercentile":55.63382,"prominencePercentileString":"55.634","overallScholarlyOutput":0},"dig":"a1b185d87a575f57faca14b2e6fbe71620c0a5536091232c3d792198d6c30ca8"}

SciVal Topic Prominence

Topic:
Prominence percentile: