[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3038912.3052681acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

When Confidence and Competence Collide: Effects on Online Decision-Making Discussions

Published: 03 April 2017 Publication History

Abstract

Group discussions are a way for individuals to exchange ideas and arguments in order to reach better decisions than they could on their own. One of the premises of productive discussions is that better solutions will prevail, and that the idea selection process is mediated by the (relative) competence of the individuals involved. However, since people may not know their actual competence on a new task, their behavior is influenced by their self-estimated competence -- that is, their confidence -- which can be misaligned with their actual competence.
Our goal in this work is to understand the effects of confidence-competence misalignment on the dynamics and outcomes of discussions. To this end, we design a large-scale natural setting, in the form of an online team-based geography game, that allows usto disentangle confidence from competence and thus separate their effects.
We find that in task-oriented discussions, the more-confident individuals have a larger impact on the group's decisions even when these individuals are at the same level of competence as their teammates. Furthermore, this unjustified role of confidence in the decision-making process often leads teams to under-perform. We explore this phenomenon by investigating the effects of confidence on conversational dynamics. For example, we take up the question: do more-confident people introduce more ideas than the less-confident, or do they introduce the same number of ideas but their ideas get more uptake? Moreover, we show that the language people use is more predictive of a person's confidence level than their actual competence. This also suggests potential practical applications, given that in many settings, true competence cannot be assessed before the task is completed, whereas the conversation can be tracked during the course of the problem-solving process.

References

[1]
M. D. Alicke. Global self-evaluation as determined by the desirability and controllability of trait adjectives. Journal of Personality and Social Psychology, 49(6):1621, 1985.
[2]
D. Bang, R. Fusaroli, K. Tylén, K. Olsen, P. E. Latham, J. Y. Lau, A. Roepstorff, G. Rees, C. D. Frith, and B. Bahrami. Does interaction matter? Testing whether a confidence heuristic can replace interaction in collective decision-making. Consciousness and Cognition, 26:13--23, 2014.
[3]
L. Barnsley, P. M. Lyon, S. J. Ralston, E. J. Hibbert, I. Cunningham, F. C. Gordon, and M. J. Field. Clinical skills in junior medical officers: A comparison of self-reported confidence and observed competence. Medical Education, 38(4):358--367, 2004.
[4]
R. K. Bothwell, K. A. Deffenbacher, and J. C. Brigham. Correlation of eyewitness accuracy and confidence: Optimality hypothesis revisited. Journal of Applied Psychology, 72(4):691, 1987.
[5]
D. Boud and N. Falchikov. Quantitative studies of student self-assessment in higher education: A critical analysis of findings. Higher Education, 18(5):529--549, 1989.
[6]
R. Buehler, D. Griffin, and M. Ross. Exploring the" planning fallacy": Why people underestimate their task completion times. Journal of Personality and Social Psychology, 67(3):366, 1994.
[7]
J. Cassell, D. Huffaker, D. Tversky, and K. Ferriman. The language of online leadership: Gender and youth engagement on the internet. Developmental Psychology, 42(3):436, 2006.
[8]
D. E. Clayson. Performance overconfidence: Metacognitive effects or misplaced student expectations? Journal of Marketing Education, 27(2):122--129, 2005.
[9]
D. Coetzee, S. Lim, A. Fox, B. Hartmann, and M. A. Hearst. Structuring interactions for large-scale synchronous peer learning. In Proceedings of CSCW, 2015.
[10]
B. Collins and H. Guetzkow. A social psychology of group processes for decision-making. Wiley, 1964.
[11]
D. Dunning, K. Johnson, J. Ehrlinger, and J. Kruger. Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3):83--87, 2003.
[12]
I. Erev, T. S. Wallsten, and D. V. Budescu. Simultaneous over- and underconfidence: The role of error in judgment processes. Psychological Review, 101(3):519--527, 1994.
[13]
R. Farkas, V. Vincze, G. Móra, J. Csirik, and G. Szarvas. The CoNLL-2010 shared task: Learning to detect hedges and their scope in natural language text. In Proceedings of CoNLL: Shared Task, 2010.
[14]
H. Friedberg, D. Litman, and S. B. F. Paletz. Lexical entrainment and success in student engineering groups. In Proceedings of the IEEE Spoken Language Technology Workshop, 2012.
[15]
D. Griffin and A. Tversky. The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24(3):411--435, 1992.
[16]
D. A. Hanauer, Y. Liu, Q. Mei, F. J. Manion, U. J. Balis, and K. Zheng. Hedging their mets: The use of uncertainty terms in clinical documents and its potential implications when sharing the documents with patients. In Proceedings of the AMIA Annual Symposium, 2012.
[17]
H. Horowitz. The relationship of confidence to competence and imitation behavior. Journal of Psychology, 63(2):235--247, 1966.
[18]
K. Hyland. Hedging in scientific research articles. Pragmatics and Beyond New Series. John Benjamins Publishing, 1998.
[19]
M. H. Jackson and M. S. Poole. Idea-generation in naturally occurring contexts. Human Communication Research, 29(4):560--591, 2003.
[20]
B. Johnstone. 'He says ... so I said': Verb tense alternation and narrative depictions of authority in American English. Linguistics, 25(1):33--52, 1987.
[21]
E. Kacewicz, J. W. Pennebaker, M. Davis, M. Jeon, and A. C. Graesser. Pronoun use reflects standings in social hierarchies. Journal of Language and Social Psychology, 33(2):125--143, 2014.
[22]
A. Koriat, S. Lichtenstein, and B. Fischhoff. Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6(2):107--118, 1980.
[23]
J. Kruger and D. Dunning. Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6):1121, 1999.
[24]
G. Lakoff. Hedges: A study in meaning criteria and the logic of fuzzy concepts. Journal of Philosophical Logic, 2, 1975.
[25]
R. P. Larrick, K. A. Burson, and J. B. Soll. Social comparison and confidence: When thinking you're better than average predicts overconfidence (and when it does not). Organizational Behavior and Human Decision Processes, 102(1):76--94, 2007.
[26]
P. R. Laughlin, E. C. Hatch, J. S. Silver, and L. Boh. Groups perform better than the best individuals on letters-to-numbers problems: effects of group size. Journal of Personality and social Psychology, 90(4):644, 2006.
[27]
S. Lichtenstein and B. Fischhoff. Do those who know more also know more about how much they know? Organizational Behavior and Human Performance, 20(2):159--183, 1977.
[28]
D. A. Moore and P. J. Healy. The trouble with overconfidence. Psychological Review, 115(2):502--517, 2008.
[29]
M. Moussaïd, J. E. K\"ammer, P. P. Analytis, and H. Neth. Social Influence and the Collective Dynamics of Opinion Formation. PLOS One, 8(11):e78433, 2013.
[30]
M. A. Neale and M. H. Bazerman. The effects of framing and negotiator overconfidence on bargaining behaviors and outcomes. Academy of Management Journal, 28(1):34--49, 1985.
[31]
V. Niculae and C. Danescu-Niculescu-Mizil. Conversational markers of constructive discussions. In Proceedings of NAACL-HLT, 2016.
[32]
V. Prabhakaran, A. Arora, and O. Rambow. Power of confidence: How poll scores impact topic dynamics in political debates. In Proceedings of the ACL Joint Workshop on Social Dynamics and Personal Attributes, 2014.
[33]
J. P. Schuldt, C. F. Chabris, A. W. Woolley, and J. R. Hackman. Confidence in dyadic decision making: The role of individual differences. Journal of Behavioral Decision Making, 2015.
[34]
J. A. Sniezek and R. A. Henry. Accuracy and confidence in group judgment. Organizational Behavior and Human Decision Processes, 43(1):1--28, 1989.
[35]
I. Steiner. Group Processes and Productivity. Social Psychology. Academic Press, 1972.
[36]
F. Sumner. Marks as estimated by students. Education, 32:429, 1932.
[37]
C. Tan and L. Lee. Talk it up or play it down? (Un)expected correlations between (de-)emphasis and recurrence of discussion points in consequential U.S. economic policy meetings. Presented in Text as Data, 2016.
[38]
C. Tan, V. Niculae, C. Danescu-Niculescu-Mizil, and L. Lee. Winning arguments: Interaction dynamics and persuasion strategies in good-faith online discussions. In Proceedings of WWW, 2016.
[39]
J. S. Valacich, A. R. Dennis, and J. F. Nunamaker. Group size and anonymity effects on computer-mediated idea generation. Small Group Research, 23(1):49--73, 1992.
[40]
A. W. Woolley, C. F. Chabris, A. Pentland, N. Hashmi, and T. W. Malone. Evidence for a collective intelligence factor in the performance of human groups. Science, 330(6004):686--688, 2010.
[41]
P. Zarnoth and J. A. Sniezek. The social influence of confidence in group decision making. Journal of Experimental Social Psychology, 33(4):345--366, 1997.
[42]
J. Zhang, R. Kumar, S. Ravi, and C. Danescu-Niculescu-Mizil. Conversational flow in Oxford-style debates. In Proceedings of NAACL, 2016.

Cited By

View all

Index Terms

  1. When Confidence and Competence Collide: Effects on Online Decision-Making Discussions

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      WWW '17: Proceedings of the 26th International Conference on World Wide Web
      April 2017
      1678 pages
      ISBN:9781450349130

      Sponsors

      • IW3C2: International World Wide Web Conference Committee

      In-Cooperation

      Publisher

      International World Wide Web Conferences Steering Committee

      Republic and Canton of Geneva, Switzerland

      Publication History

      Published: 03 April 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. collaboration
      2. confidence
      3. conversations
      4. decision-making
      5. group dynamics
      6. ideas
      7. linguistic
      8. overconfidence
      9. synergy
      10. teams

      Qualifiers

      • Research-article

      Funding Sources

      • Office of the Vice Provost for Research at Cornell

      Conference

      WWW '17
      Sponsor:
      • IW3C2

      Acceptance Rates

      WWW '17 Paper Acceptance Rate 164 of 966 submissions, 17%;
      Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)43
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 09 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Cross-sectional study of perceptions of competence and confidence in feline handlingThe Veterinary Nurse10.12968/vetn.2024.15.2.7815:2(78-86)Online publication date: 2-Mar-2024
      • (2020)Effectiveness of Leadership Decision-Making in Complex SystemsSystems10.3390/systems80100058:1(5)Online publication date: 12-Feb-2020
      • (2020)Ten Social Dimensions of Conversations and RelationshipsProceedings of The Web Conference 202010.1145/3366423.3380224(1514-1525)Online publication date: 20-Apr-2020
      • (undefined)The Devil in the Detail: Mitigating the Constitutional & Rule of Law Risks Associated with the use of Artificial Intelligence in the Legal DomainSSRN Electronic Journal10.2139/ssrn.3426337

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media