[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3213586.3225247acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
research-article

Increasing Response Rates to Email Surveys in MOOCs

Published: 02 July 2018 Publication History

Abstract

Email is an important and widely used communication medium. However, email is increasingly unreliable as people become unlikely to respond to the growing influx of information they receive. Low response rate to email becomes a problem in situations where closing the feedback loop is critical, such as in education, marketing or research. To investigate ways of increasing email response rate, we designed experiments that manipulated the textual elements of the emails. We conducted experiments in a MOOC setting, with email surveys sent out to over 3,000 learners. The emails were sent to elicit responses as to why learners were not engaging with the course. We found that response rates were significantly increased by varying how closely emails were framed as pertaining to a learner's personal situation, such as by changing introductory message, and the format in which links to a survey were presented. Our results yield useful implications to educational and marketing context.

References

[1]
Melissa Campanelli. 2005. DMA Report: Integrations Success Varies by Sector. (June 2005). Retrieved March 4, 2018 from http://www.dmnews.com/marketing-strategy/dma-report-integrations-success-varies-by-sector/article/88003/
[2]
Saleh, A., and Bista, K. 2017. Examining Factors Impacting Online Survey Response Rates in Educational Research: Perceptions of Graduate Students. Journal of MultiDisciplinary Evaluation, 13, 29 (2017), 63--74.
[3]
Ascend2. 2017. Email Marketing Strategy: Survey Summary Report. Retrieved from: http://ascend2.com/wp-content/uploads/2017/01/Ascend2-Email-Marketing-Strategy-Survey-Summary-Report-160908.pdf.
[4]
Experian Marketing Services. 2014. The 2014 Digital Marketer: Benchmark and Trend Report. Retrieved from https://www.experianplc.com/media/news/2014/experian-marketing-services-releases-sixth-annual-digital-marketer-report-with-results/.
[5]
Xi (Alan) Zhang, V. Kumar, and Koray Cosguner. 2017. Dynamically Managing a Profitable Email Marketing Program. Journal of Marketing Research 54, 6 (2017), 851--866.
[6]
Navdeep S. Sahni, Dan Zou, and Pradeep K. Chintagunta. 2017. Do Targeted Discount Offers Serve as Advertising? Evidence from 70 Field Experiments. Management Science 63, 8 (2017), 2688--2705.
[7]
V. Kumar, Xi (Alan) Zhang, and Anita Luo. 2014. Modeling Customer Opt-In and Opt-Out in a Permission-Based Marketing Context. Journal of Marketing Research 51, 4 (2014), 403--419.
[8]
Anita Luo and V. Kumar. 2013. Recovering Hidden Buyer--Seller Relationship States to Measure the Return on Marketing Investment in Business-to-Business Markets. Journal of Marketing Research 50, 1 (2013), 143--160.
[9]
Bluehornet.2013. 2013 Consumer Views Of Email Marketing. Retrieved from: http://info.digitalriver.com/rs/digitalriver/images/Report_Consumer-Views-of-Email-Marketing_2013_web_(2).pdf
[10]
Fiona Ellis-Chadwick and Neil F. Doherty. 2012. Web advertising: The role of e-mail marketing. Journal of Business Research 65, 6 (2012), 843--848.
[11]
Dale T. Miller and Deborah A. Prentice. 2016. Changing Norms to Change Behavior. Annual Review of Psychology 67, 1 (April 2016), 339--361.
[12]
Judith De Groot, Wokje Abrahamse, and Kayleigh Jones. 2013. Persuasive Normative Messages: The Influence of Injunctive and Personal Norms on Using Free Plastic Bags. Sustainability 5, 12 (2013), 1829--1844.
[13]
René F. Kizilcec, Emily Schneider, Geoffrey L. Cohen and Daniel A. McFarland. 2014. Encouraging Forum Participation in Online Courses with Collectivist, Individualist and Neutral Motivational Framings.
[14]
Jacob Whitehill, Joseph Jay Williams, Glenn Lopez, Cody Coleman and Justin Reich. 2015. Beyond Prediction: First Steps Toward Automatic Intervention in MOOC Student Stopout. In Educational Data Mining (8th, Madrid, Spain, Jun 26--29, 2015).
[15]
Stephen D. O'Connell and Guido Lang. 2018. Can Personalized Nudges Improve Learning in Hybrid Classes? Experimental Evidence From an Introductory Undergraduate Course. Journal of Research on Technology in Education (April 2018), 1--15.
[16]
OnTask. 2018. OnTask Learning. Retrieved from https://www.ontasklearning.org/
[17]
René F. Kizilcec and Christopher Brooks. 2017. Chapter 18: Diverse Big Data and Randomized Field Experiments in MOOCs. In Handbook of Learning Analytics. Society for Learning Analytics Research, 211--222.
[18]
John C. Stamper, Derek Lomas, Dixie Ching, Steve Ritter, Kenneth R. Koedinger, and Jonathan Steinhart. 2012. The Rise of the Super Experiment. In Educational Data Mining, June 2012.

Cited By

View all
  • (2024)Online capacity building for the health workforce: the case of the Integrated Disease Surveillance and Response (IDSR) for the African regionJournal of Public Health in Africa10.4081/jphia.2023.2478Online publication date: 26-Jan-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
UMAP '18: Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization
July 2018
349 pages
ISBN:9781450357845
DOI:10.1145/3213586
  • General Chairs:
  • Tanja Mitrovic,
  • Jie Zhang,
  • Program Chairs:
  • Li Chen,
  • David Chin
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 July 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. MOOCs
  2. email surveys
  3. field experiments
  4. response rate

Qualifiers

  • Research-article

Conference

UMAP '18
Sponsor:

Acceptance Rates

UMAP '18 Paper Acceptance Rate 26 of 93 submissions, 28%;
Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)1
Reflects downloads up to 26 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Online capacity building for the health workforce: the case of the Integrated Disease Surveillance and Response (IDSR) for the African regionJournal of Public Health in Africa10.4081/jphia.2023.2478Online publication date: 26-Jan-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media