More Web Proxy on the site http://driver.im/

research-article

Crowd-based design activities: helping students connect with users online

Authors:

Elizabeth M. Gerber,

Steven P. DowAuthors Info & Claims

DIS '14: Proceedings of the 2014 conference on Designing interactive systems

Pages 875 - 884

https://doi.org/10.1145/2598510.2598538

Published: 21 June 2014 Publication History

Abstract

By definition, human-centered design relies on interaction with users. While interacting with users within industry can be challenging, fostering these interactions in a classroom setting can be even more difficult. This qualitative study explores the use of crowd-based design activities as a way to support student-user interactions online. We motivate these online methods through a survey of 27 design instructors, who identified common challenges of conducting student-user interactions in physical settings, including coordination constraints and geographical barriers to meeting in person. We then describe our research through design to create and test 10 activities in a classroom setting, including using Twitter for needfinding and using Reddit to brainstorm ideas with experts. Finally, we present an emergent framework outlining the design space for crowd-based design activities where students learn to use input from online crowds to inform their design work. We discuss plans to refine and expand the current set of activities for open access to instructors.

References

[1]

Baym, N.K. and boyd, danah. Socially Mediated Publicness: An Introduction. Journal of Broadcasting & Electronic Media 56, 3 (2012), 320--329.

[2]

Beyer, H. and Holtzblatt, K. Contextual Design: Defining Customer-Centered Systems. Morgan Kaufmann, 1997.

Digital Library

[3]

Brown, P. and Levinson, S.C. Politeness: Some universals in language usage. Cambridge University Press, 1987.

[4]

Buxton, B. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann, San Francisco, 2007.

Digital Library

[5]

Courage, C. and Baxter, K. Understanding your users: A practical guide to user requirements methods, tools, and techniques. Morgan Kaufmann, 2005.

Digital Library

[6]

Daft, R.L. and Lengel, R.H. Information richness: a new approach to managerial behavior and organizational design. Texas A&M University, 1983.

[7]

Dell, N., Vaidyanathan, V., Medhi, I., Cutrell, E., and Thies, W. "Yours is better!": Participant response bias in HCI. Proc. of CHI '12, 1321--1330.

Digital Library

[8]

Donath, J.S. Identity and deception in the virtual community. In Communities in Cyberspace. Routledge, 1999, 29--59.

[9]

Dow, S., Gerber, E., and Wong, A. A pilot study of using crowds in the classroom. Proc. of CHI '13, 227--236.

Digital Library

[10]

Dow, S., Kulkarni, A., Klemmer, S., and Hartmann, B. Shepherding the crowd yields better work. Proc. of CSCW '12, 1013--1022.

Digital Library

[11]

Dym, C.L., Agogino, A.M., Eris, O., Frey, D.D., and Leifer, L.J. Engineering Design Thinking, Teaching, and Learning. Journal of Engineering Education 94, 1 (2005), 103--120.

[12]

Easterday, M., Rees Lewis, D., and Gerber, E. DesignBased Research Process: Problems, Phases, and Applications. Proc. of International Conference of Learning Sciences '14.

[13]

Easterday, M.W., Rees Lewis, D., Fitzpatrick, C., and Gerber, E.M. Computer Supported Novice Group Critique. Proc. of DIS '14.

Digital Library

[14]

Faste, H., Rachmel, N., Essary, R., and Sheehan, E. Brainstorm, Chainstorm, Cheatstorm, Tweetstorm: New Ideation Strategies for Distributed HCI Design. Proc. of CHI '13, 1343--1352.

Digital Library

[15]

Fixson, S.K. Teaching Innovation through Interdisciplinary Courses and Programmes in Product Design and Development: An Analysis at 16 US Schools. Creativity and Innovation Management 18, 3 (2009), 199--208.

[16]

Gaver, B., Dunne, T., and Pacenti. Design: Cultural Probes. Interactions 6, 1 (1999), 21--29.

Digital Library

[17]

Gerber, E.M. and Carroll, M. The Psychological Experience of Prototyping. Design Studies 33, 1 (2012), 64--84.

[18]

Gerber, E.M. and Hui, J.S. Crowdfunding: Motivations and Deterrents for Participation. TOCHI (in preparation),.

Digital Library

[19]

Gerber, E.M., Marie Olson, J., and Komarek, R.L.D. Extracurricular Design-Based Learning: Preparing Students for Careers in Innovation. International Journal of Engineering Education 28, 2 (2012), 317.

[20]

Grudin, J. and Poltrock, S.E. Computer-supported cooperative work and groupware. Advances in Computers 45, (1997), 269--320.

[21]

Hanington, B. Universal Methods of Design: 100 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions. Rockport Publishers, 2012.

[22]

Hargittai, E. Digital Na(t)ives? Variation in Internet Skills and Uses among Members of the "Net Generation." Sociological Inquiry 80, 1 (2010), 92--113.

[23]

Herring, S.R., Poon, C.M., Balasi, G.A., and Bailey, B.P. Tweetspiration: leveraging social media for design inspiration. Proc. of CHI EA '11, 2311--2316.

Digital Library

[24]

Von Hippel, E. Democratizing Innovation. MIT Press, Cambridge, MA, 2005.

[25]

Jung, Y., Gray, R., Lampe, C., and Ellison, N.B. Favors from Facebook Friends: Unpacking Dimensions of Social Capital. Proc. of CHI '13, 11--20.

Digital Library

[26]

Khan, V.J. T23: Harvesting crowdsourcing for user & design research. International Conference on HCI, 2014. http://www.hcii2014.org/t23.

[27]

Kittur, N., Nickerson, J., Bernstein, M., et al. The Future of Crowd Work. Proc. of CSCW '13, 1301--1318.

Digital Library

[28]

Kolodner, J.L., Camp, P.J., Crismond, D., et al. Problem-Based Learning Meets Case-Based Reasoning in the Middle-School Science Classroom: Putting Learning by Design(tm) Into Practice. Journal of Learning Sciences 12, 4 (2003), 495--547.

[29]

Kulkarni, A., Gutheim, P., Narula, P., Rolnitzky, D., Parikh, T., and Hartmann, B. MobileWorks: Designing for Quality in a Managed Crowdsourcing Architecture. IEEE Internet Computing 16, 5 (2012), 28--35.

Digital Library

[30]

Lai, J., Honda, T., and Yang, M.C. A study of the role of user-centered design methods in design team projects. Artificial Intelligence for Engineering Design, Analysis and Manufacturing 24, 3 (2010), 303--316.

Digital Library

[31]

Lazer, D., Pentland, A.S., Adamic, L., et al. Computational Social Science. Science 323, 5915 (2009), 721--723.

[32]

Litt, E., Spottswood, E., Birnholtz, J., Hancock, J., Smith, M.E., and Reynolds, L. Awkward Encounters of an "Other" Kind: Collective Self-Presentation and Face Threat on Facebook. Proc. of CSCW '14, 449--460.

Digital Library

[33]

Lur\aas, S. and Mainsah, H. Reaching hard-to-reach users using online media to get a glimpse of work in marine contexts. Interactions 20, 6 (2013), 32--35.

Digital Library

[34]

Millen, D.R. Rapid Ethnography: Time Deepening Strategies for HCI Field Research. Proc. of DIS '00, 280--286.

Digital Library

[35]

Norman, D. The Design of Everyday Things. Doubleday, New York, NY, 1988.

[36]

Odom, W., Zimmerman, J., Davidoff, S., Forlizzi, J., Dey, A.K., and Lee, M.K. A fieldwork of the future with user enactments. Proc. of DIS '12, 338--347.

Digital Library

[37]

Olsen, G.M. and Olsen, J.S. Distance Matters. HumanComputer Interaction 15, (2000), 139--178.

Digital Library

[38]

Quinn, A. and Bederson, B. Human Computation: A Survey and Taxonomy of a Growing Field. Proc. of CHI '11, 1403--1412.

Digital Library

[39]

Robinson, L. and Schulz, J. New Avenues for Sociological Inquiry Evolving Forms of Ethnographic Practice. Sociology 43, 4 (2009), 685--698.

[40]

Ryan, R.M. and Deci, E.L. Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. Contemporary Education Psychology 25, (2000), 54-- 67.

[41]

Sanders, E.B.-N. and Stappers, P.J. Co-creation and the new landscapes of design. Co-design 4, 1 (2008), 5--18.

[42]

Sproull, L.S. and Kiesler, S. Connections: New ways of working in the networked organization. The MIT Press, 1992.

Digital Library

[43]

Strauss, A. and Corbin, J. Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Sage Publications, London, 1990.

[44]

Zimmerman, J., Forlizzi, J., and Evenson, S. Research through design as a method for interaction design research. Proc. of CHI '07, 493--502.

Digital Library

[45]

UsabilityHub. https://usabilityhub.com/.

[46]

Mural.ly. https://mural.ly/pricing.

[47]

NoteBox. http://www.noteboxapp.com/.

[48]

Five Second Test. UsabilityHub. http://fivesecondtest.com/.

[49]

The Best Design Schools in the World. Bloomberg Businessweek. http://images.businessweek.com/ss/07/10/1005_dschoo ls/index_01.htm?chan=rss_topSlideShows_ssi_5.

[50]

Rediquette. Reddit. http://www.reddit.com/wiki/reddiquette.

Cited By

Seaborn KSawa YWatanabe M(2024)Coimagining the Future of Voice Assistants with Cultural SensitivityHuman Behavior and Emerging Technologies10.1155/2024/32387372024(1-21)Online publication date: 25-Mar-2024
https://doi.org/10.1155/2024/3238737
Peng ZChen QShen ZMa XOulasvirta A(2024)DesignQuizzer: A Community-Powered Conversational Agent for Learning Visual DesignProceedings of the ACM on Human-Computer Interaction10.1145/36373218:CSCW1(1-40)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637321
Walzer D(2024)Considering leadership pedagogy in creative arts educationJournal of Leadership Education10.1108/JOLE-01-2024-002423:1(91-107)Online publication date: 1-Mar-2024
https://doi.org/10.1108/JOLE-01-2024-0024
Show More Cited By

Index Terms

Crowd-based design activities: helping students connect with users online
1. Human-centered computing
  1. Collaborative and social computing

Recommendations

A pilot study of using crowds in the classroom
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Industry relies on higher education to prepare students for careers in innovation. Fulfilling this obligation is especially difficult in classroom settings, which often lack authentic interaction with the outside world. Online crowdsourcing has the ...
The role of design fiction in participatory design processes
NordiCHI '18: Proceedings of the 10th Nordic Conference on Human-Computer Interaction

Participatory design is in essence very malleable as any design technique could lend itself to it, as long as users and stakeholders are involved. Design fictions however, have more often been used as either a vehicle for critical designs, or as a sheer ...
Crowd vs. crowd: large-scale cooperative design through open team competition
CSCW '13: Proceedings of the 2013 conference on Computer supported cooperative work

Following the recent remarkable successes of crowdsourcing, there have been attempts to apply it to design. However a design problem is often too complex and difficult to break down into simpler, distributable tasks as required by the conventional ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '14: Proceedings of the 2014 conference on Designing interactive systems

June 2014

1102 pages

ISBN:9781450329026

DOI:10.1145/2598510

General Chairs:
Ron Wakkary
Simon Fraser University
,
Steve Harrison
Virginia Tech
,
Program Chairs:
Carman Neustaedter
Simon Fraser University
,
Shaowen Bardzell
Indiana University
,
Eric Paulos
UC Berkeley

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Division of Information and Intelligent Systems

Conference

DIS '14

Sponsor:

SIGCHI

DIS '14: Designing Interactive Systems Conference 2014

June 21 - 25, 2014

BC, Vancouver, Canada

Acceptance Rates

DIS '14 Paper Acceptance Rate 107 of 402 submissions, 27%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
374
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Seaborn KSawa YWatanabe M(2024)Coimagining the Future of Voice Assistants with Cultural SensitivityHuman Behavior and Emerging Technologies10.1155/2024/32387372024(1-21)Online publication date: 25-Mar-2024
https://doi.org/10.1155/2024/3238737
Peng ZChen QShen ZMa XOulasvirta A(2024)DesignQuizzer: A Community-Powered Conversational Agent for Learning Visual DesignProceedings of the ACM on Human-Computer Interaction10.1145/36373218:CSCW1(1-40)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637321
Walzer D(2024)Considering leadership pedagogy in creative arts educationJournal of Leadership Education10.1108/JOLE-01-2024-002423:1(91-107)Online publication date: 1-Mar-2024
https://doi.org/10.1108/JOLE-01-2024-0024
Mohedas IDaly SLoweth RSienko K(2023)Changes to stakeholder engagement approaches throughout a capstone engineering design courseInternational Journal of Technology and Design Education10.1007/s10798-023-09833-x34:2(759-781)Online publication date: 29-Jul-2023
https://doi.org/10.1007/s10798-023-09833-x
Hatipoğlu ÇDelibegović Džanić NGajek EMiloshevska L(2022)Crowdsourcing and language learning habits and practices in Turkey, Bosnia and Herzegovina, the Republic of North Macedonia and Poland in the pre-pandemic and pandemic periodsSlovenščina 2.0: empirical, applied and interdisciplinary research10.4312/slo2.0.2022.2.132-18310:2(132-183)Online publication date: 29-Dec-2022
https://doi.org/10.4312/slo2.0.2022.2.132-183
Kornfield RMohr DRanney RLattie EMeyerhoff JWilliams JReddy M(2022)Involving Crowdworkers with Lived Experience in Content-Development for Push-Based Digital Mental Health Tools: Lessons Learned from Crowdsourcing Mental Health MessagesProceedings of the ACM on Human-Computer Interaction10.1145/35129466:CSCW1(1-30)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512946
Zhang CHuang WLiang L(2022)Application of Crowdsourcing to the Design of Behavior Change Technologies2022 15th International Symposium on Computational Intelligence and Design (ISCID)10.1109/ISCID56505.2022.00058(232-235)Online publication date: Dec-2022
https://doi.org/10.1109/ISCID56505.2022.00058
Krishna Kumaran SShi WBailey BSas CMaiden N(2021)Am I Ready to Get Feedback? A Taxonomy of Factors Creators Consider Before Seeking Feedback on In-Progress Creative WorkProceedings of the 13th Conference on Creativity and Cognition10.1145/3450741.3465255(1-10)Online publication date: 22-Jun-2021
https://dl.acm.org/doi/10.1145/3450741.3465255
Krishna Kumaran SYin YBailey B(2021)Plan Early, Revise MoreProceedings of the ACM on Human-Computer Interaction10.1145/34490985:CSCW1(1-22)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449098
Kotturi YBlaising AFox SKulkarni C(2021)The Unique Challenges for Creative Small Businesses Seeking Feedback on Social MediaProceedings of the ACM on Human-Computer Interaction10.1145/34490895:CSCW1(1-27)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449089
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents