research-article

Free access

A few useful things to know about machine learning

Author:

Pedro DomingosAuthors Info & Claims

Communications of the ACM, Volume 55, Issue 10

Pages 78 - 87

https://doi.org/10.1145/2347736.2347755

Published: 01 October 2012 Publication History

All formats PDF

Abstract

Tapping into the "folk knowledge" needed to advance machine learning applications.

References

[1]

Bauer, E. and Kohavi, R. An empirical comparison of voting classification algorithms: Bagging, boosting and variants. Machine Learning 36 (1999), 105--142.

Digital Library

Google Scholar

[2]

Bengio, Y. Learning deep architectures for AI. Foundations and Trends in Machine Learning 2, 1 (2009), 1--127.

Digital Library

Google Scholar

[3]

Benjamini, Y. and Hochberg, Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57 (1995), 289--300.

Crossref

Google Scholar

[4]

Bernardo, J.M. and Smith, A.F.M. Bayesian Theory. Wiley, NY, 1994.

Crossref

Google Scholar

[5]

Blumer, A., Ehrenfeucht, A., Haussler, D. and Warmuth, M.K. Occam's razor. Information Processing Letters 24 (1987), 377--380.

Digital Library

Google Scholar

[6]

Cohen, W.W. Grammatically biased learning: Learning logic programs using an explicit antecedent description language. Artificial Intelligence 68 (1994), 303--366.

Digital Library

Google Scholar

[7]

Domingos, P. The role of Occam's razor in knowledge discovery. Data Mining and Knowledge Discovery 3 (1999), 409--425.

Digital Library

Google Scholar

[8]

Domingos, P. Bayesian averaging of classifiers and the overfitting problem. In Proceedings of the 17 ^th International Conference on Machine Learning (Stanford, CA, 2000), Morgan Kaufmann, San Mateo, CA, 223--230.

Digital Library

Google Scholar

[9]

Domingos, P. A unified bias-variance decomposition and its applications. In Proceedings of the 17 ^th International Conference on Machine Learning (Stanford, CA, 2000), Morgan Kaufmann, San Mateo, CA, 231--238.

Digital Library

Google Scholar

[10]

Domingos, P. and Pazzani, M. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning 29 (1997), 103--130.

Digital Library

Google Scholar

[11]

Hulten, G. and Domingos, P. Mining complex models from arbitrarily large databases in constant time. In Proceedings of the 8 ^th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Edmonton, Canada, 2002). ACM Press, NY, 525--531.

Digital Library

Google Scholar

[12]

Kibler, D. and Langley, P. Machine learning as an experimental science. In Proceedings of the 3 ^rd European Working Session on Learning (London, UK, 1988). Pitman.

Google Scholar

[13]

Klockars, A.J. and Sax, G. Multiple Comparisons. Sage, Beverly Hills, CA, 1986.

Google Scholar

[14]

Kohavi, R., Longbotham, R., Sommerfield, D. and Henne, R. Controlled experiments on the Web: Survey and practical guide. Data Mining and Knowledge Discovery 18 (2009), 140--181.

Digital Library

Google Scholar

[15]

Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C. and Byers, A. Big data: The next frontier for innovation, competition, and productivity. Technical report, McKinsey Global Institute, 2011.

Google Scholar

[16]

Mitchell, T.M. Machine Learning. McGraw-Hill, NY, 1997.

Digital Library

Google Scholar

[17]

Ng, A.Y. Preventing "overfitting" of cross-validation data. In Proceedings of the 14 ^th International Conference on Machine Learning (Nashville, TN, 1997). Morgan Kaufmann, San Mateo, CA, 245--253.

Digital Library

Google Scholar

[18]

Pearl, J. On the connection between the complexity and credibility of inferred models. International Journal of General Systems 4 (1978), 255--264.

Crossref

Google Scholar

[19]

Pearl, J. Causality: Models, Reasoning, and Inference. Cambridge University Press, Cambridge, UK, 2000.

Digital Library

Google Scholar

[20]

Quinlan, J.R. C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, CA, 1993.

Digital Library

Google Scholar

[21]

Richardson, M. and P. Domingos. Markov logic networks. Machine Learning 62 (2006), 107--136.

Digital Library

Google Scholar

[22]

Tenenbaum, J., Silva, V. and Langford, J. A global geometric framework for nonlinear dimensionality reduction. Science 290 (2000), 2319--2323.

Crossref

Google Scholar

[23]

Vapnik, V.N. The Nature of Statistical Learning Theory. Springer, NY, 1995.

Crossref

Google Scholar

[24]

Witten, I., Frank, E. and Hall, M. Data Mining: Practical Machine Learning Tools and Techniques, 3rd Edition. Morgan Kaufmann, San Mateo, CA, 2011.

Digital Library

Google Scholar

[25]

Wolpert, D. The lack of a priori distinctions between learning algorithms. Neural Computation 8 (1996), 1341--1390.

Digital Library

Google Scholar

Cited By

View all

Romeo MDallio MNapolitano CBasile CDi Nardo FVaia PIodice PFederico A(2025)Clinical Applications of Artificial Intelligence (AI) in Human Cancer: Is It Time to Update the Diagnostic and Predictive Models in Managing Hepatocellular Carcinoma (HCC)?Diagnostics10.3390/diagnostics1503025215:3(252)Online publication date: 22-Jan-2025
https://doi.org/10.3390/diagnostics15030252
Çınar YEkinci A(2025)Yapay Zekâ Tabanlı Uygulamaların Dini Soruları Cevaplama Yetenekleri: ChatGPT ve Din İşleri Yüksek Kurulu Fetvaları Bağlamında Bir KarşılaştırmaKafkas Üniversitesi İlahiyat Fakültesi Dergisi10.17050/kafkasilahiyat.156853612:23(62-97)Online publication date: 3-Jan-2025
https://doi.org/10.17050/kafkasilahiyat.1568536
Oneto LChicco D(2025)Eight quick tips for biologically and medically informed machine learningPLOS Computational Biology10.1371/journal.pcbi.101271121:1(e1012711)Online publication date: 9-Jan-2025
https://doi.org/10.1371/journal.pcbi.1012711
Show More Cited By

Index Terms

A few useful things to know about machine learning
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
  2. Machine learning

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Communications of the ACM Volume 55, Issue 10

October 2012

101 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/2347736

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2012

Published in CACM Volume 55, Issue 10

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,979
Total Citations
View Citations
53,876
Total Downloads

Downloads (Last 12 months)14,600
Downloads (Last 6 weeks)1,144

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Romeo MDallio MNapolitano CBasile CDi Nardo FVaia PIodice PFederico A(2025)Clinical Applications of Artificial Intelligence (AI) in Human Cancer: Is It Time to Update the Diagnostic and Predictive Models in Managing Hepatocellular Carcinoma (HCC)?Diagnostics10.3390/diagnostics1503025215:3(252)Online publication date: 22-Jan-2025
https://doi.org/10.3390/diagnostics15030252
Çınar YEkinci A(2025)Yapay Zekâ Tabanlı Uygulamaların Dini Soruları Cevaplama Yetenekleri: ChatGPT ve Din İşleri Yüksek Kurulu Fetvaları Bağlamında Bir KarşılaştırmaKafkas Üniversitesi İlahiyat Fakültesi Dergisi10.17050/kafkasilahiyat.156853612:23(62-97)Online publication date: 3-Jan-2025
https://doi.org/10.17050/kafkasilahiyat.1568536
Oneto LChicco D(2025)Eight quick tips for biologically and medically informed machine learningPLOS Computational Biology10.1371/journal.pcbi.101271121:1(e1012711)Online publication date: 9-Jan-2025
https://doi.org/10.1371/journal.pcbi.1012711
Shahbazi AIrandoost FMahdavian RShojaeilangari SAllahvardi ANaderi-Manesh H(2025)A multi-stage weakly supervised design for spheroid segmentation to explore mesenchymal stem cell differentiation dynamicsBMC Bioinformatics10.1186/s12859-024-06031-x26:1Online publication date: 17-Jan-2025
https://doi.org/10.1186/s12859-024-06031-x
Wallimann HEmmenegger SPouly MWegelin P(2025)Where is the Limit? Assessing the Potential of Algorithm-Based Cartel DetectionJournal of Competition Law & Economics10.1093/joclec/nhae023Online publication date: 20-Jan-2025
https://doi.org/10.1093/joclec/nhae023
Ghosh KTodorović MVehtari ARinke P(2025)Active learning of molecular data for task-specific objectivesThe Journal of Chemical Physics10.1063/5.0229834162:1Online publication date: 2-Jan-2025
https://doi.org/10.1063/5.0229834
Huang TYin XJiang E(2025)Decision-making in clinical diagnostic for brain tumor detection based on advanced machine ‎learning algorithm‎International Journal for Simulation and Multidisciplinary Design Optimization10.1051/smdo/202402116(1)Online publication date: 7-Jan-2025
https://doi.org/10.1051/smdo/2024021
Tang WChen JChen D(2025)Predicting EV battery state of health using long short term degradation feature extraction and FEA TimeMixerScientific Reports10.1038/s41598-025-85492-315:1Online publication date: 16-Jan-2025
https://doi.org/10.1038/s41598-025-85492-3
Valença GAzevedo CMoura FMorais de Sá A(2025)Creating visualizations using generative AI to guide decision-making in street designs: A viewpointJournal of Urban Mobility10.1016/j.urbmob.2025.1001047(100104)Online publication date: Jun-2025
https://doi.org/10.1016/j.urbmob.2025.100104
Schaks MStaudinger IHomeister LDi Biase BSteinkraus BSpiess A(2025)Local microbial yield-associating signatures largely extend to global differences in plant growthScience of The Total Environment10.1016/j.scitotenv.2024.177946958(177946)Online publication date: Jan-2025
https://doi.org/10.1016/j.scitotenv.2024.177946
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Lifelong Machine Learning

100 Things Every Designer Needs to Know About People

Lifelong Machine Learning