A design-based approach to experimental design: investigating hypotheses about how framing influences transfer
Pages 224 - 231
Abstract
In this paper we present an approach to experimental design that is heavily influenced by practices from design-based research, illustrating it with our ongoing work to investigate hypotheses about how framing influences the transfer-of-learning. When one is interested in designing experiments that do not just test hypotheses about causal effects but also develop hypotheses about new kinds of causal mechanisms, we claim that it is particularly valuable to use the design-based research practices of iteratively designing new learning ecologies in particular contexts and creating explanatory accounts that coordinate multiple measures. Also, experimentally-inspired practices of comparing theoretically contrasting interventions in parallel and systematically streamlining designs to distinguish between critical and less critical design elements have promise for being usefully adapted within design-based research studies themselves.
References
[1]
Bransford, J.D., and Schwartz, D.L. (1999). Rethinking transfer: A simple proposal with multiple implications. Review of Research in Education, 24, 61-100.
[2]
Brown, A. L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. The Journal of Learning Sciences, 2(2), 141-178.
[3]
Brown, A. L. & Campione, J. C. (1994). Guided discovery in a community of learners. In K. McGilly (Ed.), Classroom lessons: Integrating cognitive theory and classroom practice (pp. 229-270). Cambridge, MA: MIT Press.
[4]
Chi, M. T. H. (2000). Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. In R. Glaser (Ed.), Advances in instructional psychology (pp. 161-238). Mahwah, NJ: Erlbaum.
[5]
Chi, M. T. H., Siler, S., Jeong, H., Yamauchi, T., Hausmann, R. G. (2001). Learning from human tutoring. Cognitive Science, 25, 471-533.
[6]
Cobb, P., Confrey, J., diSessa, A., Lesh, R. & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9-13.
[7]
Collins, A., Joseph, D. & Bielaczyc, K. (2004). Design research: Theoretical and methodological issues. The Journal of the Learning Sciences, 13(1), 15-42.
[8]
Cook, T. D. (2007). Randomized experiments in education: Assessing the objects to doing them. Economics of Innovation and New Technology, 16(5), 331-355.
[9]
Cook, T. & Sinha, V. (2005). Randomized experiments in educational research. In J. L Green, Camilli, G. and P. B. Elmore (Eds.), Handbook of complementary methods in education research (pp. 551-566). Mahwah, NJ: Erlbaum.
[10]
Davis, A. & Rose, D. (2000). The experimental method in psychology. In G. M. Breakwell, S. Hammond & C. Fife-Schaw (Eds.), Research methods in psychology (pp. 42-58). 2nd Edition. London: Sage Publications.
[11]
Design-Based Research Collective (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5-9.
[12]
diSessa, A. A. & Cobb, P. (2004). Ontological innovation and the role of theory in design experiments. Journal of the Learning Sciences, 13(1), 77-103.
[13]
Engle, R. A. (2006). Framing interactions to foster generative learning: A situative account of transfer in a community of learners classroom. Journal of the Learning Sciences, 15(4), 451-498.
[14]
Erickson, F. & Gutierrez, K. (2002). Culture, rigor, and science in educational research. Educational Researcher, 31(8), 21-24.
[15]
Greeno, J. G., Smith, D. R., & Moore, J. L. (1993). Transfer of situated learning. In D. K. Detterman & R. J. Sternberg (Eds.), Transfer on trial (pp. 99-127). Norwood, NJ: Ablex.
[16]
Hmelo-Silver, C. E. & Pfeffer, M. G. (2004). Comparing expert and novice understanding of a complex system from the perspective of structures, behaviors, and functions. Cognitive Science, 28, 127-138.
[17]
Kelly, A. E. (2004). Design research in education: Yes, but is it methodological? Journal of the Learning Sciences, 13(1), 115-128.
[18]
Laboratory of Comparative Human Cognition. (1983). Culture and cognitive development. In P. H. Mussen (Ed.), Handbook of child psychology: Volume 1. History, theory and methods (pp. 295-356). New York: Wiley.
[19]
Leach, J. (1991). Running applied psychology experiments. Milton Keynes, UK: Open University Press.
[20]
Maxwell, J. A. (2004). Causal explanation, qualitative research, and scientific inquiry in education. Educational Researcher, 33(2), 3-11.
[21]
McCandliss, B. D., Kalchman, M. & Bryant, P. (2003). Design experiments and laboratory approaches to learning: Steps towards collaborative exchange. Educational Researcher, 32(1), 14-16.
[22]
National Research Council (2002). Scientific research in education. Washington DC: National Academies Press.
[23]
Olson, D. R. (2004). The triumph of hope over experience in the search for "what works": A response to Slavin. Educational Researcher, 33(1), 24-26.
[24]
Pea, R. D. (1987). Socializing the knowledge transfer problem. International Journal of Educational Research, 11, 639-663.
[25]
Roschelle, J., Tatar, D. & Kaput, J (in press). Getting to scale with innovations that deeply restructure how students come to know mathematics. In A. E. Kelly & R. Lesh (Eds.), Handbook of innovative design research in science, technology, engineering, mathematics education. Hillsdale, NJ: Erlbaum.
[26]
Shadish, W. R., Cook, T. D. & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin.
[27]
Slavin, R. E. (2002). Evidence-based education policies: Transforming educational practice and research. Educational Researcher, 31(7), 15-21.
[28]
Whitehurst, G. R. (2003, April). The Institute of Education Sciences: New wine, new bottles. Talk presented at AERA. Available at: http://ies.ed.gov/director/speeches2003/04_22/2003_04_22.asp.
Index Terms
- A design-based approach to experimental design: investigating hypotheses about how framing influences transfer
Recommendations
Generating implications for design through design research
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsA central tenet of HCI is that technology should be user-centric, with designs being based around social science findings about users. Nevertheless a repeated but critical challenge in design is translating empirical findings into actionable ideas that ...
Bridging Work Practice and System Design: Integrating Systemic Analysis, Appreciative Intervention and Practitioner Participation
This article discusses the integration of work practice and system design. By scrutinising the unfolding discourse of workshop participants the co-construction of work practice issues as relevant design considerations is described. Through a mutual ...
Implications for design
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsAlthough ethnography has become a common approach in HCI research and design, considerable confusion still attends both ethnographic practice and the criteria by which it should be evaluated in HCI. Often, ethnography is seen as an approach to field ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2008
484 pages
Publisher
International Society of the Learning Sciences
Publication History
Published: 24 June 2008
Qualifiers
- Article
Acceptance Rates
Overall Acceptance Rate 307 of 307 submissions, 100%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 115Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 04 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in