Abstract
Nowadays, working from home (WFH) has become a popular work arrangement due to its many potential benefits for both companies and employees (e.g., increasing job satisfaction and retention of employees). Many previous studies have investigated the impact of WFH on the productivity of employees. However, most of these studies usually use a qualitative analysis method such as surveys and interviews, and the studied participants do not work from home for a long continuing time. Due to the outbreak of coronavirus disease 2019 (COVID-19), a large number of companies asked their employees to work from home, which provides us an opportunity to investigate whether WFH affects their productivity. In this study, to investigate the difference in developer productivity between WFH and working onsite, we conduct a quantitative analysis based on a dataset of developers’ daily activities from Baidu Inc., one of the largest IT companies in China. In total, we collected approximately four thousand records of 139 developers’ activities of 138 working days. Out of these records, 1103 records are submitted when developers work from home due to the COVID-19 pandemic. We find that WFH has both positive and negative impacts on developer productivity in terms of different metrics, e.g., the number of builds/commits/code reviews. We also notice that WFH has different impacts on projects with different characteristics including programming language, project type/age/size. For example, WFH has a negative impact on developer productivity for large projects. Additionally, we find that productivity varies for different developers. Based on these findings, we get some feedback from developers of Baidu and understand some reasons why WFH has different impacts on developer productivity. We also conclude several implications for both companies and developers.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Shin B, El Sawy O A, Sheng O R L, et al. Telework: existing research and future directions. J Organ Comput Electron Commer, 2000, 10: 85–101
Spark R. Accessibility to work from home for the disabled: the need for a shift in management style. In: Proceedings of the 14th Web for All Conference on the Future of Accessible Work, 2017. 1–4
Hill E J, Ferris M, Märtinson V. Does it matter where you work? A comparison of how three work venues (traditional office, virtual office, and home office) influence aspects of work and personal/family life. J Vocat Behav, 2003, 63: 220–241
Meyer A N, Barton L E, Murphy G C, et al. The work life of developers: activities, switches and perceived productivity. IIEEE Trans Softw Eng, 2017, 43: 1178–1193
Wolf T, Schroter A, Damian D, et al. Predicting build failures using social network analysis on developer communication. In: Proceedings of the 31st International Conference on Software Engineering, 2009. 1–11
Neufeld D J, Fang Y. Predicting telecommuter productivity. In: Proceedings of the 37th Annual Hawaii International Conference on System Sciences, 2004
Neufeld D J, Fang Y. Individual, social and situational determinants of telecommuter productivity. Inf Manage, 2005, 42: 1037–1049
Baker E, Avery G C, Crawford J. Satisfaction and perceived productivity when professionals work from home. Res Practice Human Resour Manag, 2007, 15: 37–62
Laihonen H, Jääskeläinen A, Lönnqvist A, et al. Measuring the productivity impacts of new ways of working. J Facil Manage, 2012, 10: 102–113
Campbell K M. Flexible work schedules, virtual work programs, and employee productivity. Dissertation for Ph.D. Degree. Minneapolis: Walden University, 2015
Kamei Y, Shihab E, Adams B, et al. A large-scale empirical study of just-in-time quality assurance. IEEE Trans Softw Eng, 2013, 39: 757–773
Walston C E, Felix C P. A method of programming measurement and estimation. IBM Syst J, 1977, 16: 54–73
Devanbu P, Karstu S, Melo W, et al. Analytical and empirical evaluation of software reuse metrics. In: Proceedings of the 18th International Conference on Software Engineering, 1996. 189–199
Nguyen V, Huang L, Boehm B. An analysis of trends in productivity and cost drivers over years. In: Proceedings of the 7th International Conference on Predictive Models in Software Engineering, 2011. 1–10
Xia X, Bao L F, Lo D, et al. Measuring program comprehension: a large-scale field study with professionals. IEEE Trans Softw Eng, 2018, 44: 951–976
von Krogh G, Spaeth S, Lakhani K R. Community, joining, and specialization in open source software innovation: a case study. Res Policy, 2003, 32: 1217–1241
Bao L F, Xia X, Lo D, et al. A large scale study of long-time contributor prediction for GitHub projects. IEEE Trans Softw Eng, 2021, 47: 1277–1298
Melo C, Cruzes D S, Kon F, et al. Agile team perceptions of productivity factors. In: Proceedings of AGILE Conference, 2011. 57–66
Meyer A N, Fritz T, Murphy G C, et al. Software developers’ perceptions of productivity. In: Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2014. 19–29
Paiva E, Barbosa D, Lima R, et al. Factors that influence the productivity of software developers in a developer view. In: Proceedings of Innovations in Computing Sciences and Software Engineering, 2010. 99–104
Zhou Y M, Leung H, Xu B W. Examining the potentially confounding effect of class size on the associations between object-oriented metrics and change-proneness. IEEE Trans Softw Eng, 2009, 35: 607–623
Wilcoxon F. Individual comparisons by ranking methods. Biometrics Bull, 1945, 1: 80–83
Cliff N. Ordinal Methods for Behavioral Data Analysis. London: Psychology Press, 2014
Coenen M, Kok R A W. Workplace flexibility and new product development performance: the role of telework and flexible work schedules. Eur Manage J, 2014, 32: 564–576
Kazekami S. Mechanisms to improve labor productivity by performing telework. TeleCommun Policy, 2020, 44: 101868
Yan M, Xia X, Lo D, et al. Characterizing and identifying reverted commits. Empir Softw Eng, 2019, 24: 2171–2208
Nilles J M. Making Telecommuting Happen: A Guide for Telemanagers and Telecommuters. New York: van Nostrand Reinhold, 1994
Kurkland N B, Bailey D E. The advantages and challenges of working here, there anywhere, and anytime. Organ Dyn, 1999, 28: 53–68
Pérez M P, Sánchez A M, de Luis Carnicer M P. Benefits and barriers of telework: perception differences of human resources managers according to company’s operations strategy. Technovation, 2002, 22: 775–783
Felstead A, Henseke G. Assessing the growth of remote working and its consequences for effort, well-being and work-life balance. New Tech Work Employ, 2017, 32: 195–212
Aguilera A, Lethiais V, Rallet A, et al. Home-based telework in France: characteristics, barriers and perspectives. Transpation Res Part A-Policy Practice, 2016, 92: 1–11
Ford D, Milewicz R, Serebrenik A. How remote work can foster a more inclusive environment for transgender developers. In: Proceedings of the 2nd International Workshop on Gender Equality in Software Engineering (GE), 2019. 9–12
Perry D E, Staudenmayer N A, Votta L G. People, organizations, and process improvement. IEEE Softw, 1994, 11: 36–45
Bailey B P, Konstan J A, Carlis J V. The effects of interruptions on task performance, annoyance, and anxiety in the user interface. In: Proceedings of INTERACT, 2001. 593–601
Chong J, Siino R. Interruptions on software teams: a comparison of paired and solo programmers. In: Proceedings of the 20th Anniversary Conference on Computer Supported Cooperative Work, 2006. 29–38
Czerwinski M, Horvitz E, Wilhite S. A diary study of task switching and interruptions. In: Proceedings of SIGCHI Conference on Human Factors in Computing Systems, 2004. 175–182
Horvitz E C M C E. Notification, disruption, and memory: effects of messaging interruptions on memory and performance. In: Proceedings of Human-Computer Interaction: INTERACT, 2001
Parnin C, DeLine R. Evaluating cues for resuming interrupted programming tasks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2010. 93–102
van Solingen R, Berghout E, van Latum F. Interrupts: just a minute never is. IEEE Softw, 1998, 15: 97–103
Sanchez H, Robbes R, Gonzalez V M. An empirical study of work fragmentation in software evolution tasks. In: Proceedings of the 22nd International Conference on Software Analysis, Evolution, and Reengineering (SANER), 2015. 251–260
Albrecht A J. Measuring application development productivity. In: Proceedings of IBM Applications Development Joint SHARE/GUIDE Symposium, 1979
Minelli R, Mocci A, Lanza M. I know what you did last summer-an investigation of how developers spend their time. In: Proceedings of the 23rd International Conference on Program Comprehension, 2015. 25–35
Cataldo M, Herbsleb J D, Carley K M. Socio-technical congruence: a framework for assessing the impact of technical and work dependencies on software development productivity. In: Proceedings of the 2nd ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, 2008. 2–11
DeMarco T, Lister T. Programmer performance and the effects of the workplace. In: Proceedings of the 8th International Conference on Software Engineering, 1985. 268–272
Boehm B W. Improving software productivity. Computer, 1987, 20: 43–57
Vasilescu B, Blincoe K, Xuan Q, et al. The sky is not the limit: multitasking across github projects. In: Proceedings of the 38th International Conference on Software Engineering, 2016. 994–1005
Khan I A, Brinkman W P, Hierons R M. Do moods affect programmers’ debug performance? Cogn Technol Work, 2011, 13: 245–258
Meyer A N, Zimmermann T, Fritz T. Characterizing software developers by perceptions of productivity. In: Proceedings of ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), 2017. 105–110
Ralph P, Baltes S, Adisaputri G, et al. Pandemic programming: how COVID-19 affects software developers and how their organizations can help. 2020. ArXiv:2005.01127
Acknowledgements
This work was partially supported by National Key Research and Development Program of China (Grant No. 2018YFB1003904), National Natural Science Foundation of China (Grant Nos. U20A20173, 61902344), and Natural Science Foundation of Zhejiang Province (Grant No. LY21F020011).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bao, L., Li, T., Xia, X. et al. How does working from home affect developer productivity? — A case study of Baidu during the COVID-19 pandemic. Sci. China Inf. Sci. 65, 142102 (2022). https://doi.org/10.1007/s11432-020-3278-4
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11432-020-3278-4