Zhang YunPeng
College of electric power,North China University of Water Resources and Electric Power, 450011, Zhengzhou, China
ABSTRACT
Rate-distortion function is the basic information theory which provides the theoretical foundations for lossy data compression; it addresses the problem of the minimal number of bits per symbol given a random variable source and a certain distortion measure. Its calculation is a complex problem. Traditional calculation method is to use the expression parameters. But it is very difficult to calculate by using the expression parameters and especially, the inequality constraints are the biggest obstacle. In general, the analytical expression is difficult to obtain. This study presents a novel method to calculate the rate-distortion function of the binary source under the condition of Hamming distortion based on the nature of rate-distortion function and extremes of conditional entropy. This method avoids the complex calculations, greatly simplifies the derivation and obtains the analytical expressions for the rate-distortion function of binary symbols.
PDF References Citation
How to cite this article
Zhang YunPeng, 2013. Calculating Method of Rate Distortion Function for Binary Source. Information Technology Journal, 12: 5541-5546.
DOI: 10.3923/itj.2013.5541.5546
URL: https://scialert.net/abstract/?doi=itj.2013.5541.5546
DOI: 10.3923/itj.2013.5541.5546
URL: https://scialert.net/abstract/?doi=itj.2013.5541.5546
REFERENCES
- Haghighat, M.B.A., A. Aghagolzadeh and H. Seyedarabi, 2011. A non-reference image fusion metric based on mutual information of image features. Comput. Electric. Eng., 37: 744-756.
CrossRefDirect Link - Muramatsu, J. and F. Kanaya, 1994. Distortion-complexity and rate-distortion function. Proceedings of the IEEE International Symposium on Information Theory, Jun 27-July 1, 1994, Trondheim, pp: 1224-1229.
CrossRefDirect Link - Peng, H., F. Long and C. Ding, 2005. Feature selection based on mutual information criteria of max-dependency, max-relevance and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell., 27: 1226-1238.
CrossRefDirect Link - Shannon, C.E., 1948. A mathematical theory of communication. Bell Syst. Tech. J., 27: 379-423.
Direct Link - Sow, D.M. and A. Eleftheriadis, 2003. Complexity distortion theory. IEEE Trans. Inform. Theory, 49: 604-608.
CrossRefDirect Link - Yang, E.H. and S.Y. Shen, 1993. Distortion program-size complexity with respect to a fidelity criterion and rate-distortion function. IEEE Trans. Inform. Theory, 39: 288-292.
CrossRefDirect Link - Ziv, J., 1980. Distortion-rate theory for individual sequences. IEEE Trans. Inform. Theory, 26: 137-143.
CrossRefDirect Link