[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3385959.3418450acmconferencesArticle/Chapter ViewAbstractPublication PagessuiConference Proceedingsconference-collections
research-article

Hand with Sensing Sphere: Body-Centered Spatial Interactions with a Hand-Worn Spherical Camera

Published: 30 October 2020 Publication History

Abstract

We propose a novel body-centered interaction system making use of a spherical camera attached to a hand. Its broad and unique field of view enables an all-in-one approach to sensing multiple pieces of contextual information in hand-based spatial interactions: (i) hand location on the body surface, (ii) hand posture, (iii) hand keypoints in certain postures, and (iv) the near-hand environment. The proposed system makes use of a deep-learning approach to perform hand location and posture recognition. The proposed system is capable of achieving high hand location and posture recognition accuracy, 85.0 % and 88.9 % respectively, after collecting sufficient data and training. Our result and example demonstrations show the potential of utilizing 360° cameras for vision-based sensing in context-aware body-centered spatial interactions.

Supplementary Material

MP4 File (a1-arakawa-supplement.mp4)

References

[1]
Mark S. Ackerman and Scott D. Mainwaring. 2005. Privacy Issues and Human-Computer Interaction. In Security and usability: designing secure systems that people can use, Lorrie Faith Cranor and Simson Garfinkel (Eds.). O’Reilly Media, Cambridge, MA, 381–400.
[2]
Karan Ahuja, Chris Harrison, Mayank Goel, and Robert Xiao. 2019. MeCap: Whole-Body Digitization for Low-Cost VR/AR Headsets. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM. https://doi.org/10.1145/3332165.3347889
[3]
Riku Arakawa and Hiromu Yakura. 2019. REsCUE: A framework for REal-time feedback on behavioral CUEs using multimodal anomaly detection. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. ACM Press. https://doi.org/10.1145/3290605.3300802
[4]
Gilles Bailly, Jörg Müller, Michael Rohs, Daniel Wigdor, and Sven Kratz. 2012. ShoeSense: a new perspective on gestural interaction and wearable applications. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12. ACM Press. https://doi.org/10.1145/2207676.2208576
[5]
Taryn Bipat, Maarten Willem Bos, Rajan Vaish, and Andrés Monroy-Hernández. 2019. Analyzing the Use of Camera Glasses in the Wild. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. ACM Press. https://doi.org/10.1145/3290605.3300651
[6]
B. Bossavit, A. Marzo, O. Ardaiz, and A. Pina. 2013. Hierarchical Menu Selection with a Body-Centered Remote Interface. Interacting with Computers 26, 5 (Aug. 2013), 389–402. https://doi.org/10.1093/iwc/iwt043
[7]
Z. Cao, G. Hidalgo Martinez, T. Simon, S. Wei, and Y. A. Sheikh. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019).
[8]
Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang, and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15. ACM Press. https://doi.org/10.1145/2807442.2807450
[9]
Liwei Chan, Chi-Hao Hsieh, Yi-Ling Chen, Shuo Yang, Da-Yuan Huang, Rong-Hao Liang, and Bing-Yu Chen. 2015. Cyclops: Wearable and Single-PieceFull-Body Gesture Input Devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press. https://doi.org/10.1145/2702123.2702464
[10]
Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: Private and Subtle Interaction Using Fingertips. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. ACM Press. https://doi.org/10.1145/2501988.2502016
[11]
Xiang 'Anthony' Chen and Yang Li. 2016. Bootstrapping User-Defined Body Tapping Recognition with Offline-Learned Probabilistic Representation. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16. ACM Press. https://doi.org/10.1145/2984511.2984541
[12]
Xiang 'Anthony' Chen, Nicolai Marquardt, Anthony Tang, Sebastian Boring, and Saul Greenberg. 2012. Extending a mobile device's interaction space through body-centric interaction. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services - MobileHCI '12. ACM Press. https://doi.org/10.1145/2371574.2371599
[13]
Xiang 'Anthony' Chen, Julia Schwarz, Chris Harrison, Jennifer Mankoff, and Scott Hudson. 2014. Around-body interaction: sensing & interaction techniques for proprioception-enhanced input with mobile devices. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services - MobileHCI '14. ACM Press. https://doi.org/10.1145/2628363.2628402
[14]
Pascal Chiu, Kazuki Takashima, Kazuyuki Fujita, and Yoshifumi Kitamura. 2019. Pursuit Sensing: Extending Hand Tracking Space in Mobile VR Applications. In Symposium on Spatial User Interaction. ACM. https://doi.org/10.1145/3357251.3357578
[15]
Shih-Han Chou, Cheng Sun, Wen-Yen Chang, Wan-Ting Hsu, Min Sun, and Jianlong Fu. 2020. 360-Indoor: Towards Learning Real-World Objects in 360deg Indoor Equirectangular Images. In The IEEE Winter Conference on Applications of Computer Vision. 845–853.
[16]
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Fei-Fei Li. 2009. ImageNet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). IEEE Computer Society, 248–255. https://doi.org/10.1109/CVPR.2009.5206848
[17]
Oliver Glauser, Shihao Wu, Daniele Panozzo, Otmar Hilliges, and Olga Sorkine-Hornung. 2019. Interactive hand pose estimation using a stretch-sensing soft glove. ACM Transactions on Graphics 38, 4 (July 2019), 1–15. https://doi.org/10.1145/3306346.3322957
[18]
Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11. ACM Press. https://doi.org/10.1145/2047196.2047255
[19]
Chris Harrison, Shilpa Ramamurthy, and Scott E. Hudson. 2012. On-body interaction. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction - TEI '12. ACM Press. https://doi.org/10.1145/2148131.2148148
[20]
Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: Appropriating the Body as an Input Surface. In Proceedings of the 28th international conference on Human factors in computing systems - CHI '10. ACM Press. https://doi.org/10.1145/1753326.1753394
[21]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. https://doi.org/10.1109/cvpr.2016.90
[22]
Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861(2017).
[23]
Yu Ishikawa, Buntarou Shizuki, and Junichi Hoshino. 2017. Evaluation of finger position estimation with a small ranging sensor array. In Proceedings of the 5th Symposium on Spatial User Interaction - SUI '17. ACM Press. https://doi.org/10.1145/3131277.3132176
[24]
Thorsten Karrer, Moritz Wittenhagen, Leonhard Lichtschlag, Florian Heller, and Jan Borchers. 2011. Pinstripe: Eyes-free Continuous Input on Interactive Clothing. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11. ACM Press. https://doi.org/10.1145/1978942.1979137
[25]
David Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits. In Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST '12. ACM Press. https://doi.org/10.1145/2380116.2380139
[26]
Ji-Hwan Kim, Nguyen Duc Thang, and Tae-Seong Kim. 2009. 3-D hand motion tracking and gesture recognition using a data glove. In 2009 IEEE International Symposium on Industrial Electronics. IEEE. https://doi.org/10.1109/isie.2009.5221998
[27]
Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization.CoRR abs/1412.6980(2014). http://dblp.uni-trier.de/db/journals/corr/corr1412.html#KingmaB14
[28]
Gierad Laput, Robert Xiao, Xiang 'Anthony' Chen, Scott E. Hudson, and Chris Harrison. 2014. Skin Buttons: Cheap, Small, Low-Power and Clickable Fixed-Icon Laser Projections. In Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14. ACM Press. https://doi.org/10.1145/2642918.2647356
[29]
Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16. ACM Press. https://doi.org/10.1145/2984511.2984582
[30]
Kyungjun Lee and Hernisa Kacorri. 2019. Hands Holding Clues for Object Recognition in Teachable Machines. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19. ACM Press. https://doi.org/10.1145/3290605.3300566
[31]
Kyungjun Lee, Daisuke Sato, Saki Asakawa, Hernisa Kacorri, and Chieko Asakawa. 2020. Pedestrian Detection with Wearable Cameras for the Blind. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3313831.3376398
[32]
Shu-Yang Lin, Chao-Huai Su, Kai-Yin Cheng, Rong-Hao Liang, Tzu-Hao Kuo, and Bing-Yu Chen. 2011. Pub - point upon body: exploring eyes-free interaction and methods on an arm. In Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11. ACM Press. https://doi.org/10.1145/2047196.2047259
[33]
Roman Lissermann, Jochen Huber, Aristotelis Hadjakos, Suranga Nanayakkara, and Max Mühlhäuser. 2014. EarPut: augmenting ear-worn devices for ear-based interaction. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures the Future of Design - OzCHI '14. ACM Press. https://doi.org/10.1145/2686612.2686655
[34]
Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press. https://doi.org/10.1145/2702123.2702461
[35]
Camillo Lugaresi, Jiuqiang Tang, Hadon Nash, Chris McClanahan, Esha Uboweja, Michael Hays, Fan Zhang, Chuo-Ling Chang, Ming Guang Yong, Juhyun Lee, 2019. Mediapipe: A framework for building perception pipelines. arXiv preprint arXiv:1906.08172(2019).
[36]
Denys J. C. Matthies, Simon T. Perrault, Bodo Urban, and Shengdong Zhao. 2015. Botential: Localizing On-Body Gestures by Measuring Electrical Signatures on the Human Skin. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '15. ACM Press. https://doi.org/10.1145/2785830.2785859
[37]
Fabrice Matulic, Riku Arakawa, Brian Vogel, and Daniel Vogel. 2020. PenSight: Enhanced Interaction with a Pen-Top Camera. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3313831.3376147
[38]
Mark R. Mine, Frederick P. Brooks, and Carlo H. Sequin. 1997. Moving objects in space: exploiting proprioception in virtual-environment interaction. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97. ACM Press. https://doi.org/10.1145/258734.258747
[39]
Masa Ogata and Michita Imai. 2015. SkinWatch: skin gesture interaction for smart watch. In Proceedings of the 6th Augmented Human International Conference on - AH '15. ACM Press. https://doi.org/10.1145/2735711.2735830
[40]
Masa Ogata, Yuta Sugiura, Hirotaka Osawa, and Michita Imai. 2012. iRing: intelligent ring using infrared reflection. In Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST '12. ACM Press. https://doi.org/10.1145/2380116.2380135
[41]
Manuel Prätorius, Dimitar Valkov, Ulrich Burgbacher, and Klaus Hinrichs. 2014. DigiTap. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology - VRST '14. ACM Press. https://doi.org/10.1145/2671015.2671029
[42]
J. Rekimoto. [n.d.]. GestureWrist and GesturePad: unobtrusive wearable interaction devices. In Proceedings Fifth International Symposium on Wearable Computers. IEEE Comput. Soc. https://doi.org/10.1109/iswc.2001.962092
[43]
Carlos Ruiz, Shijia Pan, Hae Young Noh, and Pei Zhang. 2019. WhereWear: Calibration-free Wearable Device Identification through Ambient Sensing. In The 5th ACM Workshop on Wearable Systems and Applications - WearSys '19. ACM Press. https://doi.org/10.1145/3325424.3329667
[44]
Michael S Ryoo, Brandon Rothrock, Charles Fleming, and Hyun Jong Yang. 2017. Privacy-preserving human activity recognition from extreme low resolution. In Thirty-First AAAI Conference on Artificial Intelligence.
[45]
T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, and James A. Landay. 2009. Enabling always-available input with muscle-computer interfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology - UIST '09. ACM Press. https://doi.org/10.1145/1622176.1622208
[46]
Roy Shilkrot, Jochen Huber, Wong Meng Ee, Pattie Maes, and Suranga Chandima Nanayakkara. 2015. FingerReader: A Wearable Device to Explore Printed Text on the Go. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press. https://doi.org/10.1145/2702123.2702421
[47]
Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, and Jessica K. Hodgins. 2011. Motion capture from body-mounted cameras. In ACM SIGGRAPH 2011 papers on - SIGGRAPH '11. ACM Press. https://doi.org/10.1145/1964921.1964926
[48]
Mel Slater and Martin Usoh. 1994. Body centred interaction in immersive virtual environments. Artificial life and virtual reality 1, 1994 (1994), 125–148.
[49]
Srinath Sridhar, Anders Markussen, Antti Oulasvirta, Christian Theobalt, and Sebastian Boring. 2017. WatchSense: On- and Above-Skin Input Sensing through a Wearable Depth Sensor. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3025453.3026005
[50]
Lee Stearns, Uran Oh, Leah Findlater, and Jon E. Froehlich. 2018. TouchCam: Realtime Recognition of Location-Specific On-Body Gestures to Support Users with Visual Impairments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (Jan. 2018), 1–23. https://doi.org/10.1145/3161416
[51]
Steven Strachan, Roderick Murray-Smith, Ian Oakley, and Jussi Ängeslevä. 2004. Dynamic Primitives for Gestural Interaction. In Mobile Human-Computer Interaction - MobileHCI 2004. Springer Berlin Heidelberg, 325–330. https://doi.org/10.1007/978-3-540-28637-0_31
[52]
Steven Strachan, Roderick Murray-Smith, and Sile O'Modhrain. 2007. BodySpace: inferring body pose for natural control of a music player. In CHI '07 extended abstracts on Human factors in computing systems - CHI '07. ACM Press. https://doi.org/10.1145/1240866.1240939
[53]
Timo Sztyler and Heiner Stuckenschmidt. 2016. On-body localization of wearable devices: An investigation of position-aware activity recognition. In 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE. https://doi.org/10.1109/percom.2016.7456521
[54]
Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2009. Brainy hand: an ear-worn hand gesture interaction device. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems - CHI EA '09. ACM Press. https://doi.org/10.1145/1520340.1520649
[55]
Alireza Vahdatpour, Navid Amini, and Majid Sarrafzadeh. 2011. On-body device localization for health and medical monitoring applications. In 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE. https://doi.org/10.1109/percom.2011.5767593
[56]
A. Vardy, J. Robinson, and Li-Te Cheng. [n.d.]. The WristCam as input device. In Digest of Papers. Third International Symposium on Wearable Computers. IEEE Comput. Soc. https://doi.org/10.1109/iswc.1999.806928
[57]
Cheng-Yao Wang, Min-Chieh Hsiu, Po-Tsung Chiu, Chiao-Hui Chang, Liwei Chan, Bing-Yu Chen, and Mike Y. Chen. 2015. PalmGesture: Using Palms as Gesture Interfaces for Eyes-free Input. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI '15. ACM Press. https://doi.org/10.1145/2785830.2785885
[58]
Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press. https://doi.org/10.1145/2702123.2702391
[59]
Weipeng Xu, Avishek Chatterjee, Michael Zollhofer, Helge Rhodin, Pascal Fua, Hans-Peter Seidel, and Christian Theobalt. 2019. Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera. IEEE Transactions on Visualization and Computer Graphics 25, 5 (May 2019), 2093–2101. https://doi.org/10.1109/tvcg.2019.2898650
[60]
Hui-Shyong Yeo, Erwin Wu, Juyoung Lee, Aaron Quigley, and Hideki Koike. 2019. Opisthenar. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM. https://doi.org/10.1145/3332165.3347867
[61]
Yang Zhang, Wolf Kienzle, Yanjun Ma, Shiu S. Ng, Hrvoje Benko, and Chris Harrison. 2019. ActiTouch: Robust Touch Detection for On-Skin AR/VR Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM. https://doi.org/10.1145/3332165.3347869
[62]
Yang Zhang, Junhan Zhou, Gierad Laput, and Chris Harrison. 2016. SkinTrack: Using the Body as an Electrical Waveguide for Continuous Finger Tracking on the Skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/2858036.2858082
[63]
Thomas G. Zimmerman, Jaron Lanier, Chuck Blanchard, Steve Bryson, and Young Harvill. 1987. A hand gesture interface device. ACM SIGCHI Bulletin 18, 4 (April 1987), 189–192. https://doi.org/10.1145/1165387.275628
[64]
Jussi Ängeslevä, Ian Oakley, Stephen Hughes, and Sile O’Modhrain. 2003. Body Mnemonics - Portable device interaction design concept. In Proceedings of the 16th Annual Symposium on User Interface Software and Technology - UIST '03.

Cited By

View all
  • (2024)EITPose: Wearable and Practical Electrical Impedance Tomography for Continuous Hand Pose EstimationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642663(1-10)Online publication date: 11-May-2024
  • (2023)MI-PoserProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108917:3(1-24)Online publication date: 27-Sep-2023
  • (2023)OptiRing: Low-Resolution Optical Sensing for Subtle Thumb-to-Index Micro-InteractionsProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614538(1-13)Online publication date: 13-Oct-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SUI '20: Proceedings of the 2020 ACM Symposium on Spatial User Interaction
October 2020
188 pages
ISBN:9781450379434
DOI:10.1145/3385959
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. body-centered spatial interaction
  2. hand interaction
  3. spherical camera

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

SUI '20
SUI '20: Symposium on Spatial User Interaction
October 30 - November 1, 2020
Virtual Event, Canada

Acceptance Rates

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)55
  • Downloads (Last 6 weeks)6
Reflects downloads up to 12 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)EITPose: Wearable and Practical Electrical Impedance Tomography for Continuous Hand Pose EstimationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642663(1-10)Online publication date: 11-May-2024
  • (2023)MI-PoserProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108917:3(1-24)Online publication date: 27-Sep-2023
  • (2023)OptiRing: Low-Resolution Optical Sensing for Subtle Thumb-to-Index Micro-InteractionsProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614538(1-13)Online publication date: 13-Oct-2023
  • (2023)IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and EarbudsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581392(1-12)Online publication date: 19-Apr-2023
  • (2023)OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional CameraProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580747(1-18)Online publication date: 19-Apr-2023
  • (2023)uKnit: A Position-Aware Reconfigurable Machine-Knitted Wearable for Gestural Interaction and Passive Sensing using Electrical Impedance TomographyProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580692(1-17)Online publication date: 19-Apr-2023
  • (2022)EtherPose: Continuous Hand Pose Tracking with Wrist-Worn Antenna Impedance Characteristic SensingProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545665(1-12)Online publication date: 29-Oct-2022
  • (2022)DiscoBand: Multiview Depth-Sensing Smartwatch Strap for Hand, Body and Environment TrackingProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545634(1-13)Online publication date: 29-Oct-2022
  • (2021)Independent Control of Supernumerary Appendages Exploiting Upper Limb RedundancyProceedings of the Augmented Humans International Conference 202110.1145/3458709.3458980(19-30)Online publication date: 22-Feb-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media