Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing

• Agarwal, P. K., Karpicke, J. D., Kang, S. H. K., Roediger, H. L., III & McDermott, K. B. (in press). Examining the testing effect with open- and closed-book tests. Applied Cognitive Psychology.

• American Psychological Association (2002). Ethical priniciples of psychologists and code of conduct. Retrieved June 1, 2003, from www .apa.org/ethics/code2002.html.

• Angell, G. W. (1949). The effect of immediate knowledge of quiz results on final examination scores in freshman chemistry. Journal of Educational Research, 42, 391–394.

  Google Scholar 

• Bangert-Drowns, R. L., Kulik, C. C., Kulik, J. A., & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61, 213–238.

  Google Scholar 

• Bangert-Drowns, R. L., Kulik, J. A., & Kulik, C. C. (1991). Effects of frequent classroom testing. Journal of Educational Research, 85, 89–99.

  Google Scholar 

• Bourne, L. E., Jr. (1957). Effect of information feedback and task complexity on the identification of concepts. Journal of Experimental Psychology, 54, 201–207.

  Article  PubMed  Google Scholar 

• Brackbill, Y., Bravos, A., & Starr, R. H. (1962). Delay-improved retention of a difficult task. Journal of Comparative & Physiological Psychology, 55, 947–952.

  Article  Google Scholar 

• Brown, A. S. (1988). Experiencing misspellings and spelling performance: Why wrong isn’t right. Journal of Educational Psychology, 80, 488–494.

  Article  Google Scholar 

• Brown, A. S., Schilling, H. E. H., & Hockensmith, M. L. (1999). The negative suggestion effect: Pondering incorrect alternative may be hazardous to your knowledge. Journal of Educational Psychology, 91, 756–764.

  Article  Google Scholar 

• Butler, A. C., Karpicke, J. D., & Roediger, H. L., III (2007). The effect of type and timing of feedback on learning from multiple-choice tests. Journal of Experimental Psychology: Applied, 13, 273–281.

  Article  PubMed  Google Scholar 

• Butler, A. C., Karpicke, J. D., & Roediger, H. L., III (in press). Correcting a metacognitive error: Feedback enhances retention of low confidence correct responses. Journal of Experimental Psychology: Learning, Memory, & Cognition.

• Butler, A. C., Marsh, E. J., Goode, M. K., & Roediger, H. L., III (2006). When additional multiple-choice lures aid versus hinder later memory. Applied Cognitive Psychology, 20, 941–956.

  Article  Google Scholar 

• Butler, A. C., & Roediger, H. L., III (2007). Testing improves longterm retention in a simulated classroom setting. European Journal of Cognitive Psychology, 19, 514–527.

  Article  Google Scholar 

• Butterfield, B., & Metcalfe, J. (2001). Errors committed with high confidence are hypercorrected. Journal of Experimental Psychology: Learning, Memory, & Cognition, 27, 1491–1494.

  Article  Google Scholar 

• Carrier, M., & Pashler, H. (1992). The influence of retrieval on retention. Memory & Cognition, 20, 633–642.

  Article  Google Scholar 

• Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132, 354–380.

  Article  PubMed  Google Scholar 

• Dempster, F. N. (1989). Spacing effects and their implications for theory and practice. Educational Psychology Review, 1, 309–330.

  Article  Google Scholar 

• Duchastel, P. C., & Nungester, R. J. (1982). Testing effects measured with alternate test forms. Journal of Educational Research, 75, 309–313.

  Google Scholar 

• Foos, P. W., & Fisher, R. P. (1988). Using tests as learning opportunities. Journal of Educational Psychology, 80, 179–183.

  Article  Google Scholar 

• Frederiksen, N. (1984). The real test bias: Influences of testing on teaching and learning. American Psychologist, 39, 193–202.

  Article  Google Scholar 

• Geisser, S., & Greenhouse, S. W. (1958). An extension of Box’s results on the use of F distribution in multivariate analysis. Annals of Mathematical Statistics, 29, 885–891.

  Article  Google Scholar 

• Gilman, D. A. (1969). Comparison of several feedback methods for correcting errors by computer-assisted instruction. Journal of Educational Psychology, 60, 503–508.

  Article  Google Scholar 

• Glover, J. A. (1989). The “testing” phenomenon: Not gone but nearly forgotten. Journal of Educational Psychology, 81, 392–399.

  Article  Google Scholar 

• Huelser, B. J., & Marsh, E. J. (2006, November). Does guessing on a multiple-choice test affect later cued recall? Poster session presented at the annual meeting of the Psychonomic Society, Houston, TX.

• Jacoby, L. L., & Hollingshead, A. (1990). Reading student essays may be hazardous to your spelling: Effects of reading incorrectly and correctly spelled words. Canadian Journal of Psychology, 44, 345–358.

  Article  Google Scholar 

• Jones, H. E. (1923–1924). The effects of examination on the performance of learning. Archives of Psychology, 10, 1–70.

  Google Scholar 

• Killeen, P. R. (2005). An alternative to null-hypothesis significance tests. Psychological Science, 16, 345–353.

  Article  PubMed  Google Scholar 

• Koriat, A., & Goldsmith, M. (1994). Memory in naturalistic and laboratory contexts: Distinguishing the accuracy-oriented and quantityoriented approaches to memory assessment. Journal of Experimental Psychology: General, 123, 297–315.

  Article  Google Scholar 

• Koriat, A., & Goldsmith, M. (1996). Monitoring and control processes in strategic regulation of memory accuracy. Psychological Review, 103, 490–517.

  Article  PubMed  Google Scholar 

• Kulhavy, R. W. (1977). Feedback in written instruction. Review of Educational Research, 47, 211–232.

  Google Scholar 

• Kulhavy, R. W., & Anderson, R. C. (1972). Delay-retention effect with multiple-choice tests. Journal of Educational Psychology, 63, 505–512.

  Article  Google Scholar 

• Kulhavy, R. W., & Stock, W. A. (1989). Feedback in written instruction: The place of response certitude. Educational Psychology Review, 1, 279–308.

  Article  Google Scholar 

• Kulik, J. A., & Kulik, C. C. (1988). Timing of feedback and verbal learning. Review of Educational Research, 58, 79–97.

  Google Scholar 

• Loftus, E. F., Miller, D. G., & Burns, H. J. (1978). Semantic integration of verbal material into a visual memory. Journal of Experimental Psychology: Human Learning & Memory, 4, 19–31.

  Article  Google Scholar 

• Marsh, E. J., Meade, M. L., & Roediger, H. L., III (2003). Learning facts from fiction. Journal of Memory & Language, 49, 519–536.

  Article  Google Scholar 

• Marsh, E. J., Roediger, H. L., III, Bjork, R. A., & Bjork, E. L. (2007). The memorial consequences of multiple-choice testing. Psychonomic Bulletin & Review, 14, 194–199.

  Article  Google Scholar 

• McConnell, M. D., Hunt, R. R., & Smith, R. E. (2006, May). Differential effects of immediate and delayed feedback on test performance. Paper presented at the annual meeting of the Midwestern Psychological Society, Chicago, IL.

• McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007). Testing the testing effect in the classroom. European Journal of Cognitive Psychology, 19, 494–513.

  Article  Google Scholar 

• McDaniel, M. A., & Fisher, R. P. (1991). Test and test feedback as learning sources. Contemporary Educational Psychology, 16, 192–201.

  Article  Google Scholar 

• McDaniel, M. A., & Masson, M. E. J. (1985). Altering memory representations through retrieval. Journal of Experimental Psychology: Learning, Memory, & Cognition, 11, 371–385.

  Article  Google Scholar 

• McGeoch, J. A. (1932). Forgetting and the law of disuse. Psychological Review, 39, 352–370.

  Article  Google Scholar 

• McKeachie, W. J. (1999).Teaching tips: Strategies, research, and theory for college and university teachers (10th ed.). Boston: Houghton Mifflin.

  Google Scholar 

• Paige, D. D. (1966). Learning while testing. Journal of Educational Research, 59, 276–277.

  Google Scholar 

• Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005). When does feedback facilitate learning of words? Journal of Experimental Psychology: Learning, Memory, & Cognition, 31, 3–8.

  Article  Google Scholar 

• Roediger, H. L., III, Jacoby, J. D., & McDermott, K. B. (1996). Misinformation effects in recall: Creating false memories through repeated retrieval. Journal of Memory & Language, 35, 300–318.

  Article  Google Scholar 

• Roediger, H. L., III, & Karpicke, J. D. (2006a). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181–210.

  Article  Google Scholar 

• Roediger, H. L., III, & Karpicke, J. D. (2006b). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17, 249–255.

  Article  PubMed  Google Scholar 

• Roediger, H. L., III, & Marsh, E. J. (2005). The positive and negative consequences of multiple-choice testing. Journal of Experimental Psychology: Learning, Memory, & Cognition, 31, 1155–1159.

  Article  Google Scholar 

• Roediger, H. L., III, & Payne, D. G. (1985). Recall criterion does not affect recall level or hypermnesia: A puzzle for generate/recognize theories. Memory & Cognition, 13, 1–7.

  Article  Google Scholar 

• Roediger, H. L., III, Wheeler, M. A., & Rajaram, S. (1993). Remembering, knowing and reconstructing the past. In D. L. Medin (Ed.), The psychology of learning and motivation: Advances in research and Theory (Vol. 30, pp. 97–134). New York: Academic Press.

  Google Scholar 

• Schneider, W., Eschman, A., & Zuccolotto, A. (2002). E-Prime reference guide. Pittsburgh: Psychology Software Tools, Inc.

  Google Scholar 

• Schooler, J. W., Foster, R. A., & Loftus, E. F. (1988). Some deleterious consequences of the act of recollection. Memory & Cognition, 16, 243–251.

  Article  Google Scholar 

• Schroth, M. L. (1977). Effects of informative feedback and active training upon concept attainment. Psychological Reports, 40, 647–653.

  Google Scholar 

• Skinner, B. F. (1954). The science of learning and the art of teaching. Harvard Educational Review, 24, 86–97.

  Google Scholar 

• Sturges, P. T. (1969). Verbal retention as a function of the informativeness and delay of informative feedback. Journal of Educational Psychology, 60, 11–14.

  Article  Google Scholar 

• Sullivan, H. J., Schutz, R. E., & Baker, R. L. (1971). Effects of re-inforcement contingencies. American Educational Research Journal, 8, 135–141.

  Google Scholar 

• Surber, J. R., & Anderson, R. C. (1975). Delay-retention effect in natural classroom settings. Journal of Educational Psychology, 67, 170–173.

  Article  Google Scholar 

• Tait, K., Hartley, J. R., & Anderson, R. C. (1973). Feedback procedures in computer-assisted arithmetic instruction. British Journal of Educational Psychology, 43, 161–171.

  Google Scholar 

• Toppino, T. C., & Luipersbeck, S. M. (1993). Generality of the negative suggestion effect in objective tests. Journal of Educational Psychology, 86, 357–362.

  Google Scholar 

• Tulving, E. (1967). The effects of presentation and recall of material in free-recall learning. Journal of Verbal Learning & Verbal Behavior, 6, 175–184.

  Article  Google Scholar 

• Wheeler, M. A., & Roediger, H. L., III. (1992). Disparate effects of repeated testing: Reconciling Ballarďs (1913) and Bartletťs (1932) results. Psychological Science, 3, 240–245.

  Article  Google Scholar 

• Whitten, W. B., & Leonard, J. M. (1980). Learning from tests: Facilitation of delayed recall by initial recognition alternatives. Journal of Experimental Psychology: Human Learning & Memory, 6, 127–134.

  Article  Google Scholar 

• Wildman, K., & McDaniel, M. A. (2007, August). Test-enhanced learning for facts and concepts. Poster session presented at the annual meeting of the American Psychological Association, San Francisco.

Download references