DIESEL: A novel deep learning-based tool for SpMV computations and solving sparse linear equation systems

Loading...
Thumbnail Image
Access rights
openAccess
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
Date
2021-06
Major/Subject
Mcode
Degree programme
Language
en
Pages
43
6313–6355
Series
JOURNAL OF SUPERCOMPUTING, Volume 77, issue 6
Abstract
Sparse linear algebra is central to many areas of engineering, science, and business. The community has done considerable work on proposing new methods for sparse matrix-vector multiplication (SpMV) computations and iterative sparse solvers on graphical processing units (GPUs). Due to vast variations in matrix features, no single method performs well across all sparse matrices. A few tools on automatic prediction of best-performing SpMV kernels have emerged recently and require many more efforts to fully utilize their potential. The utilization of a GPU by the existing SpMV kernels is far from its full capacity. Moreover, the development and performance analysis of SpMV techniques on GPUs have not been studied in sufficient depth. This paper proposes DIESEL, a deep learning-based tool that predicts and executes the best performing SpMV kernel for a given matrix using a feature set carefully devised by us through rigorous empirical and mathematical instruments. The dataset comprises 1056 matrices from 26 different real-life application domains including computational fluid dynamics, materials, electromagnetics, economics, and more. We propose a range of new metrics and methods for performance analysis, visualization, and comparison of SpMV tools. DIESEL provides better performance with its accuracy 88.2%, workload accuracy 91.96%, and average relative loss 4.4%, compared to 85.9%, 85.31%, and 7.65% by the next best performing artificial intelligence (AI)-based SpMV tool. The extensive results and analyses presented in this paper provide several key insights into the performance of the SpMV tools and how these relate to the matrix datasets and the performance metrics, allowing the community to further improve and compare basic and AI-based SpMV tools in the future.
Description
Keywords
Sparse linear algebra, Sparse linear equation systems, Sparse matrix vector product (SpMV), Graphics processing units (GPUs), Deep Learning, artificial intelligence (AI), Iterative solvers
Other note
Citation
Mohammed, T, Albeshri, A, Katib, I & Mehmood, R 2021, ' DIESEL: A novel deep learning-based tool for SpMV computations and solving sparse linear equation systems ', JOURNAL OF SUPERCOMPUTING, vol. 77, no. 6, pp. 6313–6355 . https://doi.org/10.1007/s11227-020-03489-3