Developing Brain-Computer Interfaces with Everyone
Pages 113 - 119
Abstract
Throughout its history, the field of brain-computer interfaces (BCIs) has offered people with severe motor disabilities the opportunity to engage with their environments using brain activity alone. Contemporary solutions, however, lack support for reliable evaluation by researchers, independent use by patients and their caregivers, or creative extension by students, artists, and software developers at home. This paper provides preliminary guidance on the integration of research engagement activities into BCI research to enable use at home. Alongside key principles for enabling Research Engagement Always And With Everyone, we present the initial specification for a standardized software ecosystem that could enable the rapid development of high-performance BCI applications on the Open Web. By integrating Open Web technologies alongside engagement activities in current research programs, we argue that participation in the development of a new generation of at-home BCI systems can be widened.
References
[1]
David Abramson and Manish Parashar. 2019. Translational Research in Computer Science. Computer 52, 9 (2019), 16–23. https://doi.org/10.1109/MC.2019.2925650
[2]
DANDI Archive. 2022. Dandi Archive. https://gui.dandiarchive.org/#/ [Online; accessed 2022-11-03].
[3]
Michael Bensch, Ahmed A. Karim, Jürgen Mellinger, Thilo Hinterberger, Michael Tangermann, Martin Bogdan, Wolfgang Rosenstiel, and Niels Birbaumer. 2007. Nessi: An EEG-controlled web browser for severely paralyzed patients. Computational Intelligence and Neuroscience 2007 (2007). https://doi.org/10.1155/2007/71863
[4]
Benjamin Blankertz, Michael Tangermann, and Klaus-Robert Müller. 2012. BCI Applications for the General Population. In Brain–Computer Interfaces: Principles and Practice. https://doi.org/10.1093/acprof:oso/9780195388855.003.0023 Abstract
[5]
Brains@Play. 2021. Competition. https://brainsatplay.com/competition/
[6]
Brains@Play. 2021. Platform. https://github.com/brainsatplay/platform [Online; accessed 2022-04-17].
[7]
Spike Brehm. 2013. Isomorphic JavaScript: The Future of Web Apps. https://medium.com/airbnb-engineering/isomorphic-javascript-the-future-of-web-apps-10882b7a2ebc [Online; accessed 2022-03-09].
[8]
Marie Aurélie Bruno, Caroline Schnakers, François Damas, Frédéric Pellas, Isabelle Lutte, Jan Bernheim, Steve Majerus, Gustave Moonen, Serge Goldman, and Steven Laureys. 2009. Locked-In Syndrome in Children: Report of Five Cases and Review of the Literature. Pediatric Neurology 41, 4 (2009), 237–246. https://doi.org/10.1016/j.pediatrneurol.2009.05.001
[9]
Matteo Cantarelli, Boris Marin, Adrian Quintana, Matt Earnshaw, Robert Court, Padraig Gleeson, Salvador Dura-Bernal, R. Angus Silver, and Giovanni Idili. 2018. Geppetto: A reusable modular open platform for exploring neuroscience data and models. Philosophical Transactions of the Royal Society B: Biological Sciences 373, 1758 (2018). https://doi.org/10.1098/rstb.2017.0380
[10]
Chris S. Crawford and Juan E. Gilbert. 2019. Brains and blocks: Introducing novice programmers to brain-computer interface application development. ACM Transactions on Computing Education 19, 4 (2019). https://doi.org/10.1145/3335815
[11]
William Dempsey, Ian Foster, Scott Fraser, and Carl Kesselman. 2022. Sharing Begins at Home. arXiv (2022). https://doi.org/10.48550/arXiv.2201.06564
[12]
Katie Ellis and Kai-Ti Kao. 2019. Who Gets to Play? Disability, Open Literacy, Gaming. Cultural Science Journal 11, 1 (2019), 111–125. https://doi.org/10.5334/csci.128
[13]
Ian Foster and Carl Kesselman. 2004. The Grid in a Nutshell. (2004), 3–13. https://doi.org/10.1007/978-1-4615-0509-9_1
[14]
Ian Foster and Carl Kesselman. 2021. Translating the grid: How a translational approach shaped the development of grid computing. Journal of Computational Science 52 (2021), 1–12. https://doi.org/10.1016/j.jocs.2020.101214
[15]
BCI Games. 2021. BCI Game Jam. https://bcigamejam.com/ [Online; accessed 2022-04-17].
[16]
Susan Gasson and Michelle Purcelle. 2018. A Participation Architecture to Support User Peripheral Participation in a Hybrid FOSS Community. ACM Transactions on Social Computing 1, 4 (2018), 1–46. https://doi.org/10.1145/3290837
[17]
Krzysztof J. Gorgolewski, Tibor Auer, Vince D. Calhoun, R. Cameron Craddock, Samir Das, Eugene P. Duff, Guillaume Flandin, Satrajit S. Ghosh, Tristan Glatard, Yaroslav O. Halchenko, Daniel A. Handwerker, Michael Hanke, David Keator, Xiangrui Li, Zachary Michael, Camille Maumet, B. Nolan Nichols, Thomas E. Nichols, John Pellman, Jean-Baptiste Poline, Ariel Rokem, Gunnar Schaefer, Vanessa Sochat, William Triplett, Jessica A. Turner, Gaël Varoquaux, and Russell A. Poldrack. 2016. The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments. Nature Scientific Data (2016). https://doi.org/10.1007/978-1-4020-6754-9_1720
[18]
Marientina Gotsis and Maryalice Jordan-Marsh. 2018. Calling HCI professionals into health research: Patient safety and health equity at stake. ACM International Conference Proceeding Series (2018), 213–218. https://doi.org/10.1145/3291533.3291562
[19]
James D. Harrison, Andrew D. Auerbach, Wendy Anderson, Maureen Fagan, Martha Carnie, Catherine Hanson, Jim Banta, Gina Symczak, Edmondo Robinson, Jeffrey Schnipper, Celene Wong, and Rachel Weiss. 2019. Patient stakeholder engagement in research: A narrative review to describe foundational principles and best practice activities. Health Expectations 22, 3 (2019), 307–316. https://doi.org/10.1111/hex.12873
[20]
Wataru Hashiguchi, Junya Morita, Takatugu Hirayama, Kenji Mase, Kazunori Yamada, and Mayu Yokoya. 2016. Multimodal biofeedback system integrating low-cost easy sensing devices. ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction (2016), 410–411. https://doi.org/10.1145/2993148.2998519
[21]
Andrea Heckert, Laura P. Forsythe, Kristin L. Carman, Lori Frank, Rachel Hemphill, Emily A. Elstad, Laura Esmail, and Julie Kennedy Lesch. 2020. Researchers, patients, and other stakeholders’ perspectives on challenges to and strategies for engagement. Research Involvement and Engagement 6, 1 (2020), 1–18. https://doi.org/10.1186/s40900-020-00227-0
[22]
Bryan Hernandez-Cuevas, William Egbert, Andre Denham, Ajay Mehul, and Chris S. Crawford. 2020. Changing minds: Exploring brain-computer interface experiences with high school students. Conference on Human Factors in Computing Systems - Proceedings (2020), 1–10. https://doi.org/10.1145/3334480.3382981
[23]
Janet E. Jull, Laurie Davidson, Rachel Dungan, Tram Nguyen, Krista P. Woodward, and Ian D. Graham. 2019. A review and synthesis of frameworks for engagement in health research to identify concepts of knowledge user engagement. BMC Medical Research Methodology 19, 1 (2019), 1–13. https://doi.org/10.1186/s12874-019-0838-1
[24]
D. Kelly, Z. Jadavji, E. Zewdie, E. Mitchell, K. Summerfield, A. Kirton, and E. Kinney-Lang. 2020. A Child’s Right to Play: Results from the Brain-Computer Interface Game Jam 2019 (Calgary Competition). Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS 2020-July (2020), 6099–6102. https://doi.org/10.1109/EMBC44109.2020.9176272
[25]
Eli Kinney-Lang, Dion Kelly, Erica D. Floreani, Zeanna Jadavji, Danette Rowley, Ephrem Takele Zewdie, Javad R. Anaraki, Hosein Bahari, Kim Beckers, Karen Castelane, Lindsey Crawford, Sarah House, Chelsea A. Rauh, Amber Michaud, Matheus Mussi, Jessica Silver, Corinne Tuck, Kim Adams, John Andersen, Tom Chau, and Adam Kirton. 2020. Advancing Brain-Computer Interface Applications for Severely Disabled Children Through a Multidisciplinary National Network: Summary of the Inaugural Pediatric BCI Canada Meeting. Frontiers in Human Neuroscience 14, December (2020), 1–11. https://doi.org/10.3389/fnhum.2020.593883
[26]
Kapil Kumar, Joy Bose, and Samarth Tripathi. 2017. A unified web interface for the internet of things. 2016 IEEE Annual India Conference, INDICON 2016 (2017), 1–6. https://doi.org/10.1109/INDICON.2016.7839142
[27]
Andrea Kübler. 2017. Quo vadis P300 Bel? Building on results for the benefit of BCI end-users. 5th International Winter Conference on Brain-Computer Interface, BCI 2017 11 (2017), 36–39. https://doi.org/10.1109/IWW-BCI.2017.7858151
[28]
Andrea Kübler, Elisa M. Holz, Angela Riccio, Claudia Zickler, Tobias Kaufmann, Sonja C. Kleih, Pit Staiger-Sälzer, Lorenzo Desideri, Evert Jan Hoogerwerf, and Donatella Mattia. 2014. The user-centered design as novel perspective for evaluating the usability of BCI-controlled applications. PLoS ONE 9, 12 (2014). https://doi.org/10.1371/journal.pone.0112392
[29]
Andrea Kübler, Femke Nijboer, and Sonja Kleih. 2020. Hearing the needs of clinical users. Handbook of Clinical Neurology 168 (2020), 353–368. https://doi.org/10.1016/B978-0-444-63934-9.00026-3
[30]
Xinyuan Lin, Wasim Q. Malik, and Shaomin Zhang. 2019. A Novel hybrid bci web browser based on ssvep and eye-Tracking. BioCAS 2019 - Biomedical Circuits and Systems Conference, Proceedings31627802 (2019), 2019–2022. https://doi.org/10.1109/BIOCAS.2019.8919087
[31]
Elizabeth Manafo, Lisa Petermann, Ping Mason-Lai, and Virgnia Vandall-Walker. 2018. Patient engagement in Canada: A scoping review of the ’how’ and ’what’ of patient engagement in health research. Health Research Policy and Systems 16, 1 (2018), 1–11. https://doi.org/10.1186/s12961-018-0282-4
[32]
Victor Martinez-Cagigal, Javier Gomez-Pilar, Daniel Alvarez, and Roberto Hornero. 2017. An Asynchronous P300-Based Brain-Computer Interface Web Browser for Severely Disabled People. IEEE Transactions on Neural Systems and Rehabilitation Engineering (2017). https://doi.org/10.1109/TNSRE.2016.2623381
[33]
Kyle E Mathewson, Kory Mathewson, and Keyfer Mathewson. 2020. EEGEdu. https://eegedu.com/
[34]
Griffin Milsap, Max Collard, Christopher Coogan, and Nathan E. Crone. 2019. BCI2000Web and WebFM: Browser-based tools for brain computer interfaces and functional brain mapping. Frontiers in Neuroscience (2019). https://doi.org/10.3389/fnins.2018.01030
[35]
V Patrick Mole. 2020. Progressive Web Apps: A Novel Way for Cross-Platform Development. September (2020).
[36]
Emily M. Mugler, Carolin A. Ruf, Sebastian Halder, Michael Bensch, and Andrea Kübler. 2010. Design and implementation of a P300-based brain-computer interface for controlling an internet browser. IEEE Transactions on Neural Systems and Rehabilitation Engineering 18, 6 (2010), 599–609. https://doi.org/10.1109/TNSRE.2010.2068059
[37]
Michael Muller and Allison Druin. 2003. Participatory Design: the Third Space in HCI. The Human-Computer Interaction Handbook 4235 (2003), 1051–1068. https://doi.org/10.1201/9781410615862-68
[38]
Neuromore. 2022. Neuromore.
[39]
Michael Philip Orenda, Lalit Garg, and Gaurav Garg. 2017. Exploring the Feasibility to Authenticate Users of Web and Cloud Services Using a Brain-Computer Interface (BCI). Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10590 LNCS (2017), 353–363. https://doi.org/10.1007/978-3-319-70742-6_33
[40]
Alexandra Papoutsaki, Nediyana Daskalova, Patsorn Sangkloy, Jeff Huang, James Laskey, and James Hays. 2016. WebGazer: Scalable webcam eye tracking using user interactions. IJCAI International Joint Conference on Artificial Intelligence 2016-Janua (2016), 3839–3845.
[41]
Evan M. Peck, Daniel Afergan, and Robert J.K. Jacob. 2013. Investigation of fNIRS brain sensing as input to information filtering systems. ACM International Conference Proceeding Series (2013), 142–149. https://doi.org/10.1145/2459236.2459261
[42]
Giuseppe Placidi, Andrea Petracca, Matteo Spezialetti, and Daniela Iacoviello. 2016. A modular framework for EEG web based binary brain computer interfaces to recover communication abilities in impaired people. Journal of Medical Systems 40, 1 (2016). https://doi.org/10.1007/s10916-015-0402-4
[43]
Jean Baptiste Poline, David N. Kennedy, Friedrich T. Sommer, Giorgio A. Ascoli, David C. Van Essen, Adam R. Ferguson, Jeffrey S. Grethe, Michael J. Hawrylycz, Paul M. Thompson, Russell A. Poldrack, Satrajit S. Ghosh, David B. Keator, Thomas L. Athey, Joshua T. Vogelstein, Helen S. Mayberg, and Maryann E. Martone. 2022. Is Neuroscience FAIR? A Call for Collaborative Standardisation of Neuroscience Data. Neuroinformatics0123456789 (2022), 3–8. https://doi.org/10.1007/s12021-021-09557-0
[44]
Casey Reas and Ben Fry. 2006. Processing: Programming for the media arts. AI and Society 20, 4 (2006), 526–538. https://doi.org/10.1007/s00146-006-0050-9
[45]
Yann Renard, Fabien Lotte, Guillaume Gibert, Marco Congedo, Emmanuel Maby, Vincent Delannoy, Olivier Bertrand, and Anatole Lécuyer. 2010. OpenViBE: An open-source software platform to design, test, and use brain-computer interfaces in real and virtual environments. Presence: Teleoperators and Virtual Environments 19, 1 (2010), 35–53. https://doi.org/10.1162/pres.19.1.35
[46]
Oliver Rübel, Andrew Tritt, Ryan Ly, Benjamin K Dichter, Satrajit Ghosh, Lawrence Niu, Ivan Soltesz, Karel Svoboda, Loren Frank, and Kristofer E Bouchard. 2021. The Neurodata Without Borders ecosystem for neurophysiological data science. bioRxiv (2021), 2021.03.13.435173.
[47]
Abdul Saboor, Mihaly Benda, Felix Gembler, and Ivan Volosyak B. 2019. Word Prediction Support Model for SSVEP-Based BCI Web Speller. Springer International Publishing. https://doi.org/10.1007/978-3-030-20521-8
[48]
Abdul Saboor, Felix Gembler, Mihaly Benda, Piotr Stawicki, Aya Rezeika, Roland Grichnik, and Ivan Volosyak. 2018. A Browser-Driven SSVEP-Based BCI Web Speller. Proceedings - 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018 (2018), 625–630. https://doi.org/10.1109/SMC.2018.00115
[49]
Gerwin Schalk, Dennis J Mcfarland, Thilo Hinterberger, Niels Birbaumer, Jonathan R Wolpaw, and A Brain-computer Interface B C I Technology. 2004. BCI2000 : A General-Purpose Brain-Computer Interface (BCI) System. 51, 6 (2004), 1034–1043.
[50]
SlashData. 2021. State of the Developer Nation 21st Edition. Technical Report.
[51]
Peter Slattery, Alexander K. Saeri, and Peter Bragge. 2020. Research co-design in health: A rapid overview of reviews. Health Research Policy and Systems 18, 1 (2020), 1–13. https://doi.org/10.1186/s12961-020-0528-9
[52]
Bernd Carsten Stahl, Kutoma Wakunuma, Stephen Rainey, and Christian Hansen. 2017. Improving brain computer interface research through user involvement - The transformative potential of integrating civil society organisations in research projects.PloS one 12, 2 (2017), e0171818. https://doi.org/10.1371/journal.pone.0171818
[53]
Pierce Stegman, Chris Crawford, and Jeff Gray. 2018. WebBCI: An electroencephalography toolkit built on modern web technologies. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). https://doi.org/10.1007/978-3-319-91470-1_18
[54]
Pierce Stegman, Chris S. Crawford, Marvin Andujar, Anton Nijholt, and Juan E. Gilbert. 2020. Brain-computer interface software: A review and discussion. IEEE Transactions on Human-Machine Systems 50, 2 (2020), 101–115. https://doi.org/10.1109/THMS.2020.2968411
[55]
Antero Taivalsaari and Tommi Mikkonen. 2017. The Web as a software platform: Ten years later. WEBIST 2017 - Proceedings of the 13th International Conference on Web Information Systems and TechnologiesWebist (2017), 41–50. https://doi.org/10.5220/0006234800410050
[56]
Antero Taivalsaari, Tommi Mikkonen, Cesare Pautasso, and Kari Systä. 2017. Comparing the Built-In Application Architecture Models in the Web Browser. Proceedings - 2017 IEEE International Conference on Software Architecture, ICSA 2017 (2017), 51–54. https://doi.org/10.1109/ICSA.2017.23
[57]
USC Visions and Voices. 2021. Livewire: A Stimulating Night of Neurotechnology. https://youtu.be/Jd4vZ9PKdYg [Online; accessed 2022-04-17].
[58]
Joshua T Vogelstein, Eric Perlman, Benjamin Falk, Alex Baden, William Gray Roncal, Vikram Chandrashekhar, Forrest Collman, Sharmishtaa Seshamani, Jesse L. Patsolic, Kunal Lillaney, Michael Kazhdan, Robert Hider Jr., Derek Pryor, Jordan Matelsky, Timothy Gion, Priya Manavalan, Brock Wester, Mark Chevillet, Eric T. Trautman, Khaled Khairy, Eric Bridgeford, Dean M. Kleissas, Daniel J. Tward, Ailey K. Crow, Brian Hsueh, Matthew A. Wright, Michael I. Miller, Stephen J. Smith, R. Jacob Vogelstein, Karl Deisseroth, and Randal Burns. 2018. A community-developed open-source computational ecosystem for big neuro data. 15, November (2018), 846–847. https://doi.org/10.1038/s41592-018-0181-1
[59]
Nikolas S. Williams, Genevieve M. McArthur, and Nicholas A. Badcock. 2020. 10 years of EPOC: A scoping review of Emotiv’s portable EEG device. bioRxiv (2020). https://doi.org/10.1101/2020.07.14.202085
[60]
Jonathan R. Wolpaw, Birbaumer Niels, Dennis J. McFarland, Gert Pfurtscheller, and Theresa M Vaughan. 2011. Brain-computer interfaces for communication and control. Commun. ACM 54, 5 (2011), 60–66. https://doi.org/10.1145/1941487.1941506
[61]
Jonathan R. Wolpaw and Elizabeth W. Wolpaw. 2012. The Future of BCIs: Meeting the Expectations. In Brain–Computer Interfaces: Principles and Practice. https://doi.org/10.1093/acprof:oso/9780195388855.003.0025 Abstract
[62]
Yue Zhao, Christoph Lofi, and Claudia Hauff. 2017. Scalable mind-wandering detection for MOOCs: A webcam-based approach. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10474 LNCS (2017), 330–344. https://doi.org/10.1007/978-3-319-66610-5_24
Index Terms
- Developing Brain-Computer Interfaces with Everyone
Recommendations
Towards ambulatory brain-computer interfaces: a pilot study with P300 signals
ACE '09: Proceedings of the International Conference on Advances in Computer Entertainment TechnologyBrain-Computer Interfaces (BCI) are communication systems that enable users to interact with computers using only brain activity. This activity is generally measured by ElectroEncephaloGraphy (EEG). A major limitation of BCI is the electrical ...
Feature Analysis of EEG Based Brain-Computer Interfaces to Detect Motor Imagery
Brain InformaticsAbstractBrain-Computer Interfaces (BCI) is one of the alluring breakthroughs for mankind as it provides a new way of communication for the patients of neuro-muscular disorders. Electroencephalography (EEG) signals are the most studied type of signals to ...
Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces
A Brain-Computer Interface (BCI) is a specific type of human-computer interface that enables the direct communication between human and computers by analyzing brain measurements. Oddball paradigms are used in BCI to generate event-related potentials (...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2023
797 pages
ISBN:9798400700699
DOI:10.1145/3594806
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 10 August 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
PETRA '23
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 489Total Downloads
- Downloads (Last 12 months)348
- Downloads (Last 6 weeks)54
Reflects downloads up to 10 Dec 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in