Title : ( Difference and similarity between differential entropy and discrete entropy )
Authors: Gholam Reza Mohtashami Borzadaran ,
Full TextAbstract
Shannon\\\'s discovery of the fundamental laws of data compression and transmission marks the birth of Information Theory. Classically, Shannon entropy was formalized over discrete probability distributions. This discrete idea extended to continuous case. So, is Shannon entropy and dierential entropy are connected to each other or not is a question that will discuss here. Various entropies, Phidivergence, AEP and maximum entropy will discuss in two cases, and answer to the question is continuous cases not the limit of discrete cases?
Keywords
, Shannon entropy, Dierential entropy, Maximum entropy, asymptotic equipartition property (AEP), Phi-divergence, Kullback Leibler information.
@inproceedings{paperid:1077376,
author = {Mohtashami Borzadaran, Gholam Reza},
title = {Difference and similarity between differential entropy and discrete entropy},
booktitle = {دوازدهمین سمینار احتمال و فرایندهای تصادفی},
year = {2019},
location = {سمنان, IRAN},
keywords = {Shannon entropy; Dierential entropy; Maximum entropy; asymptotic
equipartition property (AEP); Phi-divergence; Kullback Leibler information.},
}
%0 Conference Proceedings
%T Difference and similarity between differential entropy and discrete entropy
%A Mohtashami Borzadaran, Gholam Reza
%J دوازدهمین سمینار احتمال و فرایندهای تصادفی
%D 2019
