Information Sciences, ( ISI ), Volume (642), No (1), Year (2023-9) , Pages (119109-119127)

Title : ( Management of the optimizer's curse concept in single-task diffusion networks )

Authors: Atieh Gharib , Hadi Sadoghi Yazdi , Amir Hossein Taherinia ,

Access to full-text not allowed by authors

Citation: BibTeX | EndNote


In most optimization problems, loss functions assign the minimum cost to the excellent/ideal sample with a minimum error magnitude. However, this sample may have been mistakenly deemed excellent due to noise. This can lead to an anomaly known as the “optimizer\\\\\\\\\\\\\\\'s curse”. Our goal is to manage this anomaly in single-task diffusion networks by giving almost the same importance to a set of good samples instead of just the excellent/ideal one. For this purpose, we introduce a novel loss function and propose a “robust diffusion smooth σ-insensitive correntropy” algorithm for distributed estimation. The proposed convex and smooth loss function is somehow related to the ϵ-insensitive loss family and also inherits some beneficial properties of the correntropy loss function to handle very small and very large errors at once. Accordingly, it provides high resistance to various types of Gaussian, Uniform, and impulsive non-Gaussian noises. Moreover, there are theoretical discussions of the convergence and stability of the proposed method, its steady-state and transient behavior, its computational complexity, and an explanation of the parameter values. Simulation results show the superior performance of the presented algorithm in both stationary and non-stationary environments compared to some recent diffusion-based methods in the literature.


, Adaptive networks Single, task Diffusion Robust Optimizer’s curse Robust smooth ????, insensitive correntropy
برای دانلود از شناسه و رمز عبور پرتال پویا استفاده کنید.

author = {Gharib, Atieh and Sadoghi Yazdi, Hadi and Taherinia, Amir Hossein},
title = {Management of the optimizer's curse concept in single-task diffusion networks},
journal = {Information Sciences},
year = {2023},
volume = {642},
number = {1},
month = {September},
issn = {0020-0255},
pages = {119109--119127},
numpages = {18},
keywords = {Adaptive networks Single-task Diffusion Robust Optimizer’s curse Robust smooth ????-insensitive correntropy},


%0 Journal Article
%T Management of the optimizer's curse concept in single-task diffusion networks
%A Gharib, Atieh
%A Sadoghi Yazdi, Hadi
%A Taherinia, Amir Hossein
%J Information Sciences
%@ 0020-0255
%D 2023