Title : ( Renyi entropy in Continuous case is not the limit of discrete case )
Authors: manije sanei , Gholam Reza Mohtashami Borzadaran , Mohammad Amini ,Access to full-text not allowed by authors
Abstract
Shannon entropy is the creation of Shannon (1948) based on the experiences in Bell System Company during and after the Second World War. Then, Renyi (1961) generalized it for one parameter families of entropy. This entropy for discrete random variables is non-negative but it can be negative in continuous case. In this paper, we show that Renyi entropy for continuous random variables is not equal to the limit of it for discrete random variables. Also, some notes are derived in view of variant versions of entropy criteria.
Keywords
, Shannon entropy, Renyi entropy, continuous random variable, Riemann integrable, Information theory@inproceedings{paperid:1032831,
author = {Sanei, Manije and Mohtashami Borzadaran, Gholam Reza and Amini, Mohammad},
title = {Renyi entropy in Continuous case is not the limit of discrete case},
booktitle = {یازده همین کنفرانس آمار ایران},
year = {2012},
location = {تهران, IRAN},
keywords = {Shannon entropy; Renyi entropy; continuous random variable; Riemann integrable; Information theory},
}
%0 Conference Proceedings
%T Renyi entropy in Continuous case is not the limit of discrete case
%A Sanei, Manije
%A Mohtashami Borzadaran, Gholam Reza
%A Amini, Mohammad
%J یازده همین کنفرانس آمار ایران
%D 2012