Computing, Volume (102), No (9), Year (2020-9) , Pages (2099-2116)

Title : ( Comparison of analytical and ML-based models for predicting CPU–GPU data transfer time )

Authors: Ali Riahi , Abdorreza Savadi , Mahmoud Naghibzadeh ,

Access to full-text not allowed by authors

Citation: BibTeX | EndNote

Abstract

The overhead of data transfer to the GPU poses a bottleneck for the performance of CUDA programs. The accurate prediction of data transfer time is quite effective in improving the performance of GPU analytical modeling, the prediction accuracy of kernel performance, and the composition of the CPU with the GPU for solving computational problems. For estimating the data transfer time between the CPU and the GPU, the current study employs three machine learning-based models and a new analytical model called λ-Model. These models run on four GPUs from different NVIDIA architectures and their performance is compared. The practical results show that the λ-Model is able to anticipate the transmission of large-sized data with a maximum error of 1.643%, which offers better performance than that of machine learning methods. As for the transmission of small-sized data, machine learning-based methods provide better performance and a predicted data transfer timewith amaximum error of 4.52%. Consequently, the current study recommends a hybrid model, that is, the λ-Model for large-sized data and machine learning tools for small-sized data.

Keywords

, GPU, CUDA, Data transfer time prediction, Analytical and ML-based models
برای دانلود از شناسه و رمز عبور پرتال پویا استفاده کنید.

@article{paperid:1078038,
author = {Riahi, Ali and Savadi, Abdorreza and Naghibzadeh, Mahmoud},
title = {Comparison of analytical and ML-based models for predicting CPU–GPU data transfer time},
journal = {Computing},
year = {2020},
volume = {102},
number = {9},
month = {September},
issn = {0010-485X},
pages = {2099--2116},
numpages = {17},
keywords = {GPU; CUDA; Data transfer time prediction;Analytical and ML-based models},
}

[Download]

%0 Journal Article
%T Comparison of analytical and ML-based models for predicting CPU–GPU data transfer time
%A Riahi, Ali
%A Savadi, Abdorreza
%A Naghibzadeh, Mahmoud
%J Computing
%@ 0010-485X
%D 2020

[Download]