Measuring the Relative Outputs of Computational Researchers in Higher Education

Amy Apon, Stanley Ahalt, Vijay Dantuluri, Constantin Gurdgiev, Moez Limayem, Linh Ngo, and Michael Stealey. 2010. High Performance Computing Instrumentation and Research Productivity in U.S. Universities. Journal of Information Technology Impact10 (2010), 87–98.

Amy W. Apon, Linh B. Ngo, Michael E. Payne, and Paul W. Wilson. 2015. Assessing the effect of high performance computing capabilities on academic research output. Empirical Economics 48, 1 (feb 2015), 283–312. https://doi.org/10.1007/s00181-014-0833-7

Nicholas Berente, James Howison, John L. King, Joel Cutcher-Gershenfeld, and Robert Pennington. 2014. Leading Cyberinfrastructure Enterprise: Value Propositions, Stakeholders, and Measurement. SSRN Electronic Journal (apr 2014). https://doi.org/10.2139/ssrn.2416247

Sharon Broude Geva, Alan Chalker, Curt Hillegas, Donald Petravick, Alan Sill, and Craig Stewart. 2021. Results from a Second Longitudinal Survey of Academic Research Computing and Data Center Usage: Expenditures, Utilization Patterns, and Approaches to Return on Investment. In Practice and Experience in Advanced Research Computing(PEARC ’21). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3437359.3465589

Alan Chalker, Curtis W. Hillegas, Alan Sill, Sharon Broude Geva, and Craig A. Stewart. 2020. Cloud and On-Premises Data Center Usage, Expenditures, and Approaches to Return on Investment: A Survey of Academic Research Computing Organizations. In Practice and Experience in Advanced Research Computing (Portland, OR, USA) (PEARC ’20). Association for Computing Machinery, New York, NY, USA, 26–33. https://doi.org/10.1145/3311790.3396642

Scopus Database. [n. d.]. Data | Curated. Connected. Complete.https://www.elsevier.com/solutions/scopus

David D. Dill and Frans A. van Vught. 2010. National Innovation and the Academic Research Enterprise: Public Policy in Global Perspective. Johns Hopkins University Press, United States.

J. E. Hirsch. 2005. An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences 102, 46(2005), 16569–16572. https://doi.org/10.1073/pnas.0507655102 arXiv:https://www.pnas.org/doi/pdf/10.1073/pnas.0507655102

Gerry McCartney, Thomas Hacker, and Baijin Yang. 2014. Empowering Faculty: A Campus Cyberinfrastructure Strategy for Research Communities. Educause Review (2014).

Patrick E McKnight and Julius Najab. 2010. Mann-Whitney U Test. https://doi.org/10.1002/9780470479216.corpsy0524

Greg Newby, Amy Apon, Nick Berente, Rudolph Eigenmann, Susan Fratkin, David Lifka, and Craig Stewart. 2014. Return on Investment from Academic Supercomputing: SC14 Panel. Technical Report.

Preston Smith and Stephen Lien Harrell. 2021. Research Computing on Campus - Application of a Production Function to the Value of Academic High-Performance Computing. In Practice and Experience in Advanced Research Computing(PEARC ’21). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3437359.3465564

Craig A. Stewart, Amy Apon, Ron Payne, Shawn D. Slavin, David Y. Hancock, Julie Wernert, Thomas Furlani, David Lifka, Alan Sill, Nicholas Berente, Donald F. McMullen, and Thomas Cheatham. 2019. Assessment of financial returns on investments in cyberinfrastructure facilities. In Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning) - PEARC ’19. ACM Press, New York, New York, USA, 1–8. https://doi.org/10.1145/3332186.3332228

Craig A. Stewart, David Y. Hancock, Julie Wernert, Matthew R. Link, Nancy Wilkins-Diehr, Therese Miller, Kelly Gaither, and Winona Snapp-Childs. 2018. Return on Investment for Three Cyberinfrastructure Facilities: A Local Campus Supercomputer, the NSF-Funded Jetstream Cloud System, and XSEDE (the eXtreme Science and Engineering Discovery Environment). In 2018 IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC). 223–236. https://doi.org/10.1109/UCC.2018.00031

Student. 1908. The Probable Error of a Mean. Biometrika 6, 1 (dec 1908), 1–25. https://doi.org/10.2307/2331554

B L Welch. 1947. The Generalization of ‘Student’s’ Problem when Several Different Population Variances are Involved. Biometrika 34, 1/2 (dec 1947), 28–35. https://doi.org/10.2307/2332510