Abstract
We present a project for probabilistic reasoning based on the concept of maximum entropy and the induction of probabilistic knowledge from data. The basic knowledge source is a database of 15000 patient records which we use to compute probabilistic rules. These rules are combined with explicit probabilistic rules from medical experts which cover cases not represented in the database. Based on this set of rules the inference engine PIT (Probability Induction Tool), which uses the well-known principle of Maximum Entropy [5], provides a unique probability model while keeping the necessary additional assumptions as minimal and clear as possible. PIT is used in the medical diagnosis project Lexmed [4] for the identification of acute appendicitis. Based on the probability distribution computed by PIT, the expert system proposes treatments with minimal average cost. First clinical performance results are very encouraging.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
De Dombal: Diagnosis of Acute Abdominal Pain. Churchill Livingstone (1991)
Hontschik, B.: Theorie und Praxis der Appendektomie. Mabuse Verlag (1994)
Jaynes, E.T.: Concentration of distributions at entropy maxima. In: Rosenkrantz (ed.) Papers on Probability, Statistics and statistical Physics. D. Reidel Publishing Company (1982)
Homepage of lexmed (1999), http://lexmed.fh-weingarten.de
Paris, J.B., Vencovska, A.: A Note on the Inevitability of Maximum Entropy. International lournal of Approximate Reasoning 3, 183–223 (1990)
Pearl, J.: Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann, San Francisco (1988)
Quinlan, J.R.: C4-5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, CA (1993), C5.0, online available at http://www.rulequest.com
Schramm, M., Ertel, W.: Reasoning with Probabilities and Maximum Entropy: The System PIT and its Application in LEXMED. Accepted at Symposium on Operations Research 1999 (1999)
Whittaker, J.: Graphical Models in applied multivariate Statistics. John Wiley, Chichester (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ertel, W., Schramm, M. (1999). Combining Data and Knowledge by MaxEnt-Optimization of Probability Distributions. In: Żytkow, J.M., Rauch, J. (eds) Principles of Data Mining and Knowledge Discovery. PKDD 1999. Lecture Notes in Computer Science(), vol 1704. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-48247-5_37
Download citation
DOI: https://doi.org/10.1007/978-3-540-48247-5_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66490-1
Online ISBN: 978-3-540-48247-5
eBook Packages: Springer Book Archive