Title : ( Renyi entropy in continuous case is not the limit of discrete case )
Authors: manije sanei , Gholam Reza Mohtashami Borzadaran , Mohammad Amini ,
دانلود فایل برای اعضای دانشگاهAccess to full-text not allowed by authors
Abstract
Shannon entropy is the creation of Shannon (1948) based on the experiences in Bell System Company during and after the Second World War. Then, Renyi (1961) generalized it for one parameter families of entropies. This entropy for discrete random variables is non-negative but it can be negative in continuous case. In this paper, we show that Renyi entropy for continuous random variables is not equal to the limit of it for discrete random variables. Also, some notes are derived in view of the variate versions of entropy criteria.
Keywords
, Shannon entropy, Renyi entropy, Continuous random variable, Riemann integrable, Information Theory
@article{paperid:1056664,
author = {Sanei, Manije and Mohtashami Borzadaran, Gholam Reza and Amini, Mohammad},
title = {Renyi entropy in continuous case is not the limit of discrete case},
journal = {Mathematical Sciences and Applications E-Notes},
year = {2016},
volume = {4},
number = {1},
month = {April},
issn = {2147-6268},
pages = {113--117},
numpages = {4},
keywords = {Shannon entropy; Renyi entropy; Continuous random variable; Riemann integrable; Information Theory},
}
%0 Journal Article
%T Renyi entropy in continuous case is not the limit of discrete case
%A Sanei, Manije
%A Mohtashami Borzadaran, Gholam Reza
%A Amini, Mohammad
%J Mathematical Sciences and Applications E-Notes
%@ 2147-6268
%D 2016
