TY - JOUR
ID - 46669
TI - New Bounds for Entropy of Information Sources
JO - Wavelet and Linear Algebra
JA - WALA
LA - en
SN - 2383-1936
AU - Sayyari, Yamin
AD - Department of Mathematics, Sirjan University Of Technology, Sirjan, Islamic Republic of Iran.
Y1 - 2020
PY - 2020
VL - 7
IS - 2
SP - 1
EP - 9
KW - Entropy
KW - Shannon's entropy
KW - Information source
KW - convex function
KW - random variable
DO - 10.22072/wala.2020.111881.1240
N2 - Shannon's entropy plays an important role in information theory, dynamical systems and thermodynamics. In this paper we applying Jensen's inequality in information theory and we obtain some results for the Shannon's entropy of random variables and Shannon's entropy of stochastic process. Also we obtain upper bound and lower bound for Shannon's entropy of information sources.
UR - http://wala.vru.ac.ir/article_46669.html
L1 - http://wala.vru.ac.ir/article_46669_8c805aad6947b42252be16405f2e6554.pdf
ER -