Issue Downloads
Acoustic-based Upper Facial Action Recognition for Smart Eyewear
Smart eyewear (e.g., AR glasses) is considered to be the next big breakthrough for wearable devices. The interaction of state-of-the-art smart eyewear mostly relies on the touchpad which is obtrusive and not user-friendly. In this work, we propose a ...
Identifying Mobile Sensing Indicators of Stress-Resilience
Resident physicians (residents) experiencing prolonged workplace stress are at risk of developing mental health symptoms. Creating novel, unobtrusive measures of resilience would provide an accessible approach to evaluate symptom susceptibility without ...
CoolMoves: User Motion Accentuation in Virtual Reality
Current Virtual Reality (VR) systems are bereft of stylization and embellishment of the user's motion - concepts that have been well explored in animations for games and movies. We present CooIMoves, a system for expressive and accentuated full-body ...
mTeeth: Identifying Brushing Teeth Surfaces Using Wrist-Worn Inertial Sensors
Ensuring that all the teeth surfaces are adequately covered during daily brushing can reduce the risk of several oral diseases. In this paper, we propose the mTeeth model to detect teeth surfaces being brushed with a manual toothbrush in the natural ...
Every Byte Matters: Traffic Analysis of Bluetooth Wearable Devices
Wearable devices such as smartwatches, fitness trackers, and blood-pressure monitors process, store, and communicate sensitive and personal information related to the health, life-style, habits and interests of the wearer. This data is typically ...
We Hear Your PACE: Passive Acoustic Localization of Multiple Walking Persons
Indoor localization is crucial to enable context-aware applications, but existing solutions mostly require a user to carry a device, so as to actively sense location-discriminating signals. However, many applications do not prefer user involvement due ...
MemX: An Attention-Aware Smart Eyewear System for Personalized Moment Auto-capture
- Yuhu Chang,
- Yingying Zhao,
- Mingzhi Dong,
- Yujiang Wang,
- Yutian Lu,
- Qin Lv,
- Robert P. Dick,
- Tun Lu,
- Ning Gu,
- Li Shang
This work presents MemX: a biologically-inspired attention-aware eyewear system developed with the goal of pursuing the long-awaited vision of a personalized visual Memex. MemX captures human visual attention on the fly, analyzes the salient visual ...
UVLens: Urban Village Boundary Identification and Population Estimation Leveraging Open Government Data
- Longbiao Chen,
- Chenhui Lu,
- Fangxu Yuan,
- Zhihan Jiang,
- Leye Wang,
- Daqing Zhang,
- Ruixiang Luo,
- Xiaoliang Fan,
- Cheng Wang
Urban villages refer to the residential areas lagging behind the rapid urbanization process in many developing countries. These areas are usually with overcrowded buildings, high population density, and low living standards, bringing potential risks of ...
NeckFace: Continuously Tracking Full Facial Expressions on Neck-mounted Wearables
- Tuochao Chen,
- Yaxuan Li,
- Songyun Tao,
- Hyunchul Lim,
- Mose Sakashita,
- Ruidong Zhang,
- Francois Guimbretiere,
- Cheng Zhang
Facial expressions are highly informative for computers to understand and interpret a person's mental and physical activities. However, continuously tracking facial expressions, especially when the user is in motion, is challenging. This paper presents ...
ApneaDetector: Detecting Sleep Apnea with Smartwatches
Sleep apnea is a sleep disorder in which breathing is briefly and repeatedly interrupted. Polysomnography (PSG) is the standard clinical test for diagnosing sleep apnea. However, it is expensive and time-consuming which requires hospital visits, ...
Investigating Retention in Passive Haptic Learning of Piano Songs
Passive haptic learning (PHL) is a phenomenon where one is able to acquire new motor skills through repeated haptic stimuli applied to the body without paying active attention to learning. In the following work, we investigated the retention of ...
Towards Position-Independent Sensing for Gesture Recognition with Wi-Fi
Past decades have witnessed the extension of the Wi-Fi signals as a useful tool sensing human activities. One common assumption behind it is that there is a one-to-one mapping between human activities and Wi-Fi received signal patterns. However, this ...
Robust Inertial Motion Tracking through Deep Sensor Fusion across Smart Earbuds and Smartphone
IMU based inertial tracking plays an indispensable role in many mobility centric tasks, such as robotic control, indoor navigation and virtual reality gaming. Despite its mature application in rigid machine mobility (e.g., robot and aircraft), tracking ...
Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing
Automated sound recognition tools can be a useful complement to d/Deaf and hard of hearing (DHH) people's typical communication and environmental awareness strategies. Pre-trained sound recognition models, however, may not meet the diverse needs of ...
Who Will Survive and Revive Undergoing the Epidemic: Analyses about POI Visit Behavior in Wuhan via Check-in Records
A rapid-spreading epidemic of COVID-19 hit China at the end of 2019, resulting in unignorable social and economic damage in the epicenter, Wuhan. POIs capture the microscopic behavior of citizens, providing valuable information to understand city ...
Contrastive Predictive Coding for Human Activity Recognition
Feature extraction is crucial for human activity recognition (HAR) using body-worn movement sensors. Recently, learned representations have been used successfully, offering promising alternatives to manually engineered features. Our work focuses on ...
Douleur: Creating Pain Sensation with Chemical Stimulant to Enhance User Experience in Virtual Reality
- Chutian Jiang,
- Yanjun Chen,
- Mingming Fan,
- Liuping Wang,
- Luyao Shen,
- Nianlong Li,
- Wei Sun,
- Yu Zhang,
- Feng Tian,
- Teng Han
The imitation of pain sensation in Virtual Reality is considered valuable for safety education and training but has been seldom studied. This paper presents Douleur, a wearable haptic device that renders intensity-adjustable pain sensations with ...
SonicASL: An Acoustic-based Sign Language Gesture Recognizer Using Earphones
- Yincheng Jin,
- Yang Gao,
- Yanjun Zhu,
- Wei Wang,
- Jiyang Li,
- Seokmin Choi,
- Zhangyu Li,
- Jagmohan Chauhan,
- Anind K. Dey,
- Zhanpeng Jin
We propose SonicASL, a real-time gesture recognition system that can recognize sign language gestures on the fly, leveraging front-facing microphones and speakers added to commodity earphones worn by someone facing the person making the gestures. In a ...
EDEN: Enforcing Location Privacy through Re-identification Risk Assessment: A Federated Learning Approach
Crowd sensing applications have demonstrated their usefulness in many real-life scenarios (e.g., air quality monitoring, traffic and noise monitoring). Preserving the privacy of crowd sensing app users is becoming increasingly important as the collected ...
Designing Kitchen Technologies for Ageing in Place: A Video Study of Older Adults' Cooking at Home
Assistive technologies can significantly increase older adults' independent living if these technologies are designed to meet their needs and abilities. This study investigates conditions and present possibilities for assistive technology to provide ...
A Survey and Taxonomy of Electronics Toolkits for Interactive and Ubiquitous Device Prototyping
Over the past two decades, many toolkits for prototyping interactive and ubiquitous electronic devices have been developed. Although their technical specifications are often easy to look up, they vary greatly in terms of design, features and target ...
AmbientBreath: Unobtrusive Just-in-time Breathing Intervention Using Multi-sensory Stimulation and its Evaluation in a Car Simulator
To promote calm breathing inside a car, we designed a just-in-time breathing intervention stimulated by multi-sensory feedback and evaluated its efficacy in a driving simulator. Efficacy was measured via reduction in breathing rate as well as by user ...
DropMonitor: Millimeter-level Sensing for RFID-based Infusion Drip Rate Monitoring
As an important indicator of the infusion monitoring for clinical treatment, the drip rate is expected to be monitored in an accurate and real-time manner. However, state-of-the-art drip rate monitoring schemes either suffer from high maintenance or ...
BlinkListener: "Listen" to Your Eye Blink Using Your Smartphone
Eye blink detection plays a key role in many real-life applications such as Human-Computer Interaction (HCI), drowsy driving prevention and eye disease detection. Although traditional camera-based techniques are promising, multiple issues hinder their ...
Detecting Receptivity for mHealth Interventions in the Natural Environment
Just-In-Time Adaptive Intervention (JITAI) is an emerging technique with great potential to support health behavior by providing the right type and amount of support at the right time. A crucial aspect of JITAIs is properly timing the delivery of ...
ShaZam: Charge-Free Wearable Devices via Intra-Body Power Transfer from Everyday Objects
In this work, we investigate a wireless power transfer technology that can unobtrusively charge wearable devices while users interact with everyday objects, such as an office desk, laptop, or car. We design and develop our solution, ShaZam, that ...
FabHandWear: An End-to-End Pipeline from Design to Fabrication of Customized Functional Hand Wearables
- Luis Paredes,
- Sai Swarup Reddy,
- Subramanian Chidambaram,
- Devashri Vagholkar,
- Yunbo Zhang,
- Bedrich Benes,
- Karthik Ramani
Current hand wearables have limited customizability, they are loose-fit to an individual's hand and lack comfort. The main barrier in customizing hand wearables is the geometric complexity and size variation in hands. Moreover, there are different ...
Enabling Real-time Sign Language Translation on Mobile Platforms with On-board Depth Cameras
In this work we present SUGO, a depth video-based system for translating sign language to text using a smartphone's front camera. While exploiting depth-only videos offer benefits such as being less privacy-invasive compared to using RGB videos, it ...
IriTrack: Face Presentation Attack Detection Using Iris Tracking
With a growing adoption of face authentication systems in various application scenarios, face Presentation Attack Detection (PAD) has become of great importance to withstand artefacts. Existing methods of face PAD generally focus on designing ...
LumNet: Learning to Estimate Vertical Visual Field Luminance for Adaptive Lighting Control
High-quality lighting positively influences visual performance in humans. The experienced visual performance can be measured using desktop luminance and hence several lighting control systems have been developed for its quantification. However, the ...