The Journal of the Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회논문지)

The Institute of Internet, Broadcasting and Communication (한국인터넷방송통신학회)
권호 표지
DOI QR코드

DOI QR Code

Uncertainty Measurement of Incomplete Information System based on Conditional Information Entropy

조건부 정보엔트로피에 의한 불완전 정보시스템의 불확실성 측정

  • Park, Inkyoo (Dept. of Computer Science, Joongbu University)
  • 박인규 (중부대학교 컴퓨터학과)
  • Received : 2014.02.26
  • Accepted : 2014.04.11
  • Published : 2014.04.28
Download PDF
⟨ Previous Next ⟩

Abstract

The derivation of optimal information from decision table is based on the concept of indiscernibility relation and approximation space in rough set. Because decision table is more likely to be susceptible to the superposition or inconsistency in decision table, the reduction of attributes is a important concept in knowledge representation. While complete subsets of the attribute's domain is considered in algebraic definition, incomplete subsets of the attribute's domain is considered in information-theoretic definition. Therefore there is a marked difference between algebraic and information-theoretic definition. This paper proposes a conditional entropy using rough set as information theoretical measures in order to deduct the optimal information which may contain condition attributes and decision attribute of information system and shows its effectiveness.

러프집합에서 식별불능의 관계와 근사공간의 개념을 이용해서 의사결정표로부터 최적화된 정보를 유도하게 된다. 그러나 일반적으로 결정표에서 데이터의 중복이나 비일관성은 피할 수 없기 때문에 속성의 중요성은 지식의 감축에서 매우 중요한 개념이다. 속성의 중요성에 대한 대수학적인 정의는 도메인중의 완전한 부분집합에 대한 해당 속성이 주는 영향을 고려하는 것이고, 정보이론적인 정의는 도메인 중의 불완전한 부분집합에 대한 해당 속성이 주는 영향을 고려하는 것이다. 따라서 속성 중요성은 정보이론적인 관점의 정의와 대수학인 관점의 정의가 분명하게 차이가 있다. 본 논문에서는 정보시스템의 조건속성과 결정속성에 포함될 수 있는 정보를 최적화하기 위한 정보이론적인 척도로써 러프집합을 이용한 조건부 정보엔트로피를 제안하고 그 효용성을 보인다.

Keywords

References

  1. Kryszkieqicz, M., "Rules in incomplete information systems". Information Science, Vol. 113, No. 3-4, pp. 271-292, 1998.
  2. Lin, T. Y. ,and Cercone, N.(eds), "Rough sets and data mining-analysis of imperfect data", Boston:Klumer Academic Publishers, 1997
  3. Slowinski, R. and Stefanoqski, J., "Rough classification in incomplete information systems", Mathematical and Compute, Modeling, Vol. 12,, No. 10-11, pp.1347-1357, 1989 https://doi.org/10.1016/0895-7177(89)90373-7
  4. Shannon, C., L., "The mathematical theory of communication", Bell System Technical Journal, Vol. 27, 1948
  5. Beaubouef, T., Petry, F. E. and Arora, G.,, "Information-theoretic measures of uncertainty for rough sets and rough relational databases", Information Science, Vol. 109, No. 1-4, pp. 185-195, 1998. https://doi.org/10.1016/S0020-0255(98)00019-X
  6. Grzymala-Busse, J., "Knowledge Acquisition under Uncertainty-a Rough Set Approach. Journal of Intelligent and Robotic Systems, Vol. 1, pp.3-16, 1988 https://doi.org/10.1007/BF00437317
  7. KukBoh Kim, GuBeom Jeong and KyungOk Park, "The Study on Information-Theoretic Measures of Incomplete based on Rough Sets", Institute of Korean Multimedia Society, Vol. 3 No. 5, pp. 550-556, 2000
  8. Lin Sun, "Decision Table Reduction Method Based on New Conditional Entropy for Rough Set Theory", International Workshop on Intelligent Systems and Applications, pp. 23-24, May 2009
  9. J. Y. Kim, S S. Jo, K.K. Kim, S. H. Choi, Development of Localization and Three-dimensional hull map creation S/W for Underwater robot, Journal of Korean Institute of Information Technology, Vol.8 No.6 ,35-40, June 2010
  10. J. E. Chung, J. K. Ahn, A Study of Robust Design of FCM Gasket Using Taguchi Method, Journal of the Korea Academia-Industrial cooperation Society, v.14, no.7, 3177-3183, July 2013 https://doi.org/10.5762/KAIS.2013.14.7.3177

Cited by

  1. Uncertainty Improvement of Incomplete Decision System using Bayesian Conditional Information Entropy vol.14, pp.6, 2014, https://doi.org/10.7236/JIIBC.2014.14.6.47