Applying Augmented Reality to Enable Automated and Low-Cost Data Capture from Medical Devices

As an alternative to building custom electronic devices that connect to mobile phones (via Bluetooth or USB), we present a new approach using Augmented Reality (AR) and machine vision to digitally recognize a biomedical device and capture readings automatically. In the context of developing countries, this approach enables easy integration with low-cost devices, without the need for designing any electronics or obtaining new FDA regulatory approval. As an example, we illustrate the use of AR with a peak flow meter, a device used in the diagnosis and treatment of respiratory disease. In our mobile application, the AR graphic overlay is used to provide feedback to patients and doctors by displaying personalized reference values. Comparing the automated readings from this device to manual readings, our mobile application had a mean error of 5.8 L/min and a correlation of 0.99. A small user study was also conducted in an India field clinic with three health staff (two nurses and a doctor). Following one minute of instruction, the automated readings from the participants had a mean error of 5.5 L/min and a correlation of 0.99 compared to manual readings, with a median task duration of 17.5 seconds. This small case study illustrates how AR can be used to capture medical device data on a mobile phone and help automate the data recording tasks performed by health workers in developing countries. This technology can also be used in developed countries, enabling patients to automatically record readings from similar devices at home using their smart phones.