Signature Inspired Home Environments Monitoring System Using IR-UWB Technology
<p>The geometry of azimuth angle.</p> "> Figure 2
<p>The secure cloud server and minimal internet of things (IoT) architecture refers to the components of the system embedded within the house comprising a ultra wide band (UWB) data collection front end, storage, and the post processing stages to understand home environment.</p> "> Figure 3
<p>P410 device and associated peripheral hardware.</p> "> Figure 4
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is present in the kitchen space has been considered as C1 in classification phase.</p> "> Figure 5
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is plumping a cushion has been considered as C2 in classification phase.</p> "> Figure 6
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is using the microwave in the kitchen has been considered as C3 in classification phase.</p> "> Figure 7
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is eating in the dining room has been considered as C4 in classification phase.</p> "> Figure 8
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is washing a bowl in the kitchen has been considered as C5 in classification phase.</p> "> Figure 9
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is watching television in the living room has been considered as C6 in classification phase.</p> "> Figure 10
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is walking from the kitchen through to the dining room and hallway entrance to living room has been considered as C7 in classification phase.</p> "> Figure 11
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is brushing their teeth in the bathroom has been considered as C8 in classification phase.</p> "> Figure 12
<p>The relationship between propagation delay, activity frequency, and received power from the radar responses obtained while the person is returning from the bathroom to the living room has been considered as C9 in classification phase.</p> "> Figure 13
<p>Distance and frequency mapping to agree the floor plan for different categorical events.</p> "> Figure 13 Cont.
<p>Distance and frequency mapping to agree the floor plan for different categorical events.</p> "> Figure 14
<p>Scatter plot of categorical UWB localization data.</p> "> Figure 15
<p>Confusion matrix.</p> ">
Abstract
:1. Background
1.1. Scope
1.2. Contribution
- A pilot study has been performed in a real home environment with the presence of a person. Data have been collected for different types of activities via UWB radar and video surveillance (to ensure correlation of finding) to understand the "habitual" position through the daily activities.
- Radar principle has been employed to measure the range, and a new method has been proposed to calculate the azimuth angle or angle of arrival (AoA) from the pulse propagation delay in accordance with the time-stamp to identify the locations. Consequently, the experiment can explore the actual position of the person in different times, which would imply a normal movement.
- Subsequently, the raw data have been processed using short term fourier transform (STFT) to understand the frequency signature of an action. The frequency distribution of an activity along with the range, azimuth, and time-stamp of the movement have been labelled by the recorded evidence and made the ground-truth information.
- Subsequently, a multi class support vector machine (MC-SVM) has been trained and tested including the time-stamp of the daily "habitual" positions in that indoor scenario to make the system automated.
- The proposed method has been validated via statistical metrics and is shown to achieve over 90% accuracy.
2. Proposed Work
2.1. Short-Time Fourier Transform (STFT)
2.2. Range and Azimuth Angle
2.3. Crammer and Singer’s MC-SVM
2.4. Performance Metrics
Algorithm 1 Pseudo code of proposed method |
|
3. Experimental Setup
4. Result Analysis
4.1. Comparison
4.2. Discussion
5. Conclusions and Future Work
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Kleinberger, T.; Becker, M.; Ras, E.; Holzinger, A.; Muller, P. Ambient intelligence in assisted living: Enable elderly people to handle future interfaces. In International Conference on Universal Access in Human-Computer Interaction; Springer: Berlin/Heidelberg, Germany, 2007; pp. 103–112. [Google Scholar]
- Erden, F.; Velipasalar, S.; Alkar, A.Z.; Cetin, A.E. Sensors in Assisted Living: A survey of signal and image processing methods. IEEE Signal Process. Mag. 2016, 33, 36–44. [Google Scholar] [CrossRef]
- Patwari, N.; Hero, A.O.; Perkins, M.; Correal, N.S.; O’dea, R.J. Relative location estimation in wireless sensor networks. IEEE Trans. Signal Process. 2003, 51, 2137–2148. [Google Scholar] [CrossRef] [Green Version]
- Rana, S.P.; Prieto, J.; Dey, M.; Dudley, S.E.M.; Rodríguez, J.M.C. A Self Regulating and Crowdsourced Indoor Positioning System through Wi-Fi Fingerprinting for Multi Storey Building. Sensors 2018, 18, 3766. [Google Scholar] [CrossRef] [PubMed]
- Ali, A.M.; Asgari, S.; Collier, T.C.; Allen, M.; Girod, L.; Hudson, R.E.; Yao, K.; Taylor, C.E.; Blumstein, D.T. An empirical study of collaborative acoustic source localization. J. Signal Process. Syst. 2009, 57, 415–436. [Google Scholar] [CrossRef]
- Martino, L.; Míguez, J. Generalized rejection sampling schemes and applications in signal processing. Signal Process. 2010, 90, 2981–2995. [Google Scholar] [CrossRef] [Green Version]
- Jokanovic, B.; Amin, M.G.; Zhang, Y.D.; Ahmad, F. Multi-window time–frequency signature reconstruction from undersampled continuous-wave radar measurements for fall detection. IET Radar Sonar Navig. 2014, 9, 173–183. [Google Scholar] [CrossRef]
- Ozcan, K.; Mahabalagiri, A.K.; Casares, M.; Velipasalar, S. Automatic fall detection and activity classification by a wearable embedded smart camera. IEEE J. Emerg. Sel. Top. Circuits Syst. 2013, 3, 125–136. [Google Scholar] [CrossRef]
- Silva, B.M.; Rodrigues, J.J.; Simoes, T.M.; Sendra, S.; Lloret, J. An ambient assisted living framework for mobile environments. In Proceedings of the 2014 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), Valencia, Spain, 1–4 June 2014; pp. 448–451. [Google Scholar]
- Zhou, Z.; Chen, X.; Chung, Y.C.; He, Z.; Han, T.X.; Keller, J.M. Activity analysis, summarization, and visualization for indoor human activity monitoring. Comput. Electr. Eng. Publ. 2008. [Google Scholar] [CrossRef]
- Mrazovac, B.; Bjelica, M.Z.; Papp, I.; Teslic, N. Smart audio/video playback control based on presence detection and user localization in home environment. In Proceedings of the 2011 2nd Eastern European Regional Conference on the Engineering of Computer Based Systems (ECBS-EERC), Bratislava, Slovakia, 5–6 September 2011; pp. 44–53. [Google Scholar]
- Bourke, A.K.; Prescher, S.; Koehler, F.; Cionca, V.; Tavares, C.; Gomis, S.; Garcia, V.; Nelson, J. Embedded fall and activity monitoring for a wearable ambient assisted living solution for older adults. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2012, 2012, 248–251. [Google Scholar]
- Uenoyama, M.; Matsui, T.; Yamada, K.; Suzuki, S.; Takase, B.; Suzuki, S.; Ishihara, M.; Kawakami, M. Non-contact respiratory monitoring system using a ceiling-attached microwave antenna. Med. Biol. Eng. Comput. 2006, 44, 835–840. [Google Scholar] [CrossRef]
- Tsirmpas, C.; Anastasiou, A.; Bountris, P.; Koutsouris, D. A new method for profile generation in an internet of things environment: an application in ambient-assisted living. IEEE Internet Things J. 2015, 2, 471–478. [Google Scholar] [CrossRef]
- Costa, S.E.; Rodrigues, J.J.; Silva, B.M.; Isento, J.N.; Corchado, J.M. Integration of wearable solutions in aal environments with mobility support. J. Med. Syst. 2015, 39, 184. [Google Scholar] [CrossRef] [PubMed]
- Yao, B.; Hagras, H.; Alghazzawi, D.; Alhaddad, M.J. A big bang-big crunch type-2 fuzzy logic system for machine-vision-based event detection and summarization in real-world ambient-assisted living. IEEE Trans. Fuzzy Syst. 2016, 24, 1307–1319. [Google Scholar] [CrossRef]
- Diamantini, C.; Freddi, A.; Longhi, S.; Potena, D.; Storti, E. A goal-oriented, ontology-based methodology to support the design of AAL environments. Expert Syst. Appl. 2016, 64, 117–131. [Google Scholar] [CrossRef]
- Alcalá, J.M.; Ureña, J.; Hernández, Á.; Gualda, D. Sustainable Homecare Monitoring System by Sensing Electricity Data. IEEE Sens. J. 2017, 17, 7741–7749. [Google Scholar] [CrossRef]
- Lopez-de Teruel, P.E.; Garcia, F.J.; Canovas, O.; Gonzalez, R.; Carrasco, J.A. Human behavior monitoring using a passive indoor positioning system: a case study in a SME. Procedia Comput. Sci. 2017, 110, 182–189. [Google Scholar] [CrossRef]
- Bleda, A.L.; Fernández-Luque, F.J.; Rosa, A.; Zapata, J.; Maestre, R. Smart sensory furniture based on WSN for ambient assisted living. IEEE Sens. J. 2017, 17, 5626–5636. [Google Scholar] [CrossRef]
- Hassan, M.K.; El Desouky, A.I.; Elghamrawy, S.M.; Sarhan, A.M. Intelligent hybrid remote patient-monitoring model with cloud-based framework for knowledge discovery. Comput. Electr. Eng. 2018. [Google Scholar] [CrossRef]
- Barsocchi, P.; Cimino, M.G.; Ferro, E.; Lazzeri, A.; Palumbo, F.; Vaglini, G. Monitoring elderly behavior via indoor position-based stigmergy. Pervasive Mob. Comput. 2015, 23, 26–42. [Google Scholar] [CrossRef]
- Bocca, M.; Kaltiokallio, O.; Patwari, N. Radio tomographic imaging for ambient assisted living. In International Competition on Evaluating AAL Systems through Competitive Benchmarking; Springer: Berlin/Heidelberg, Germany, 2012; pp. 108–130. [Google Scholar]
- Tapia, D.I.; García, Ó.; Alonso, R.S.; Guevara, F.; Catalina, J.; Bravo, R.A.; Corchado, J.M. The n-core polaris real-time locating system at the evaal competition. International Competition on Evaluating AAL Systems through Competitive Benchmarking; Springer: Berlin/Heidelberg, Germany, 2011; pp. 92–106. [Google Scholar]
- Moschevikin, A.; Galov, A.; Soloviev, A.; Mikov, A.; Volkov, A.; Reginya, S. Realtrac technology overview. In International Competition on Evaluating AAL Systems through Competitive Benchmarking; Springer: Berlin/Heidelberg, Germany, 2013; pp. 60–71. [Google Scholar]
- Diraco, G.; Leone, A.; Siciliano, P. A radar-based smart sensor for unobtrusive elderly monitoring in ambient assisted living applications. Biosensors 2017, 7, 55. [Google Scholar] [CrossRef]
- Chernbumroong, S.; Cang, S.; Atkins, A.; Yu, H. Elderly activities recognition and classification for applications in assisted living. Expert Syst. Appl. 2013, 40, 1662–1674. [Google Scholar] [CrossRef]
- Fleury, A.; Vacher, M.; Noury, N. SVM-based multimodal classification of activities of daily living in health smart homes: sensors, algorithms, and first experimental results. IEEE Trans. Inf. Technol. Biomed. 2010, 14, 274–283. [Google Scholar] [CrossRef] [PubMed]
- Rana, S.P.; Dey, M.; Siddiqui, H.U.; Tiberi, G.; Ghavami, M.; Dudley, S. UWB Localization Employing Supervised Learning Method. In Proceedings of the 17th IEEE International Conference on Ubiquitous Wireless Broadband ICUWB, Salamanca, Spain, 12–15 September 2017. [Google Scholar]
- Rana, S.P.; Dey, M.; Brown, R.; Siddiqui, H.U.; Dudley, S. Remote vital sign recognition through machine learning augmented UWB. In Proceedings of the European Conference on Antennas and Propagation, Excel London, Docklands, London, UK, 9–13 April 2018. [Google Scholar]
- Saeed, A.; Kosba, A.E.; Youssef, M. Ichnaea: A low-overhead robust WLAN device-free passive localization system. IEEE J. Sel. Top. Signal Process. 2014, 8, 5–15. [Google Scholar] [CrossRef]
- Zhong, J.; Huang, Y. Time-frequency representation based on an adaptive short-time Fourier transform. IEEE Trans. Signal Process. 2010, 58, 5118–5128. [Google Scholar] [CrossRef]
- Nawab, S.H.; Quatieri, T.F. Short-time Fourier transform. In Advanced Topics in Signal Processing; Prentice-Hall, Inc.: Upper Saddle River, NJ, USA, 1987; pp. 289–337. [Google Scholar]
- Richards, M.A. Fundamentals of Radar Signal Processing; Tata McGraw-Hill Education: New York, NY, USA, 2005. [Google Scholar]
- Crammer, K.; Singer, Y. On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2001, 2, 265–292. [Google Scholar]
- Dey, M.; Rana, S.P.; Dudley, S. Smart building creation in large scale HVAC environments through automated fault detection and diagnosis. Future Gen. Comput. Syst. 2018. [Google Scholar] [CrossRef]
- Powers, D.M. Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness and Correlation. 2011. Available online: http://hdl.handle.net/2328/27165 (accessed on 15 December 2011).
- Brown, R.; Ghavami, N.; Siddiqui, H.U.R.; Adjrad, M.; Ghavami, M.; Dudley, S. Occupancy based household energy disaggregation using ultra wideband radar and electrical signature profiles. Energy Build. 2017, 141, 134–141. [Google Scholar] [CrossRef] [Green Version]
- Vastardis, N.; Kampouridis, M.; Yang, K. A user behaviour-driven smart-home gateway for energy management. J. Ambient Intell. Smart Environ. 2016, 8, 583–602. [Google Scholar] [CrossRef] [Green Version]
- Federal Communications Commission. In the Matter of Revision of Part 15 of the Commission’s Rules Regarding Ultra-Wideband Transmission Systems. First Report and Order, ET Docket 98-153; 2002. Available online: https://www.gpo.gov/fdsys/pkg/FR-2010-10-12/xml/FR-2010-10-12.xml (accessed on 10 December 2010).
- Win, M.Z.; Scholtz, R.A. Impulse radio: How it works. IEEE Commun. Lett. 1998, 2, 36–38. [Google Scholar] [CrossRef]
Parameter | Values |
---|---|
Center frequency | 4.3 GHz |
Frequency range | 3.1 GHz to 5.3 GHz |
PII | 12 |
Sampling frequency | 16.39 GHz |
PRI | approximately 100 ns |
Scan time interval | 25,000 s |
Transmit gain | −12.64 dBm |
Radar area coverage | upto 10 m |
Number of antennas | 2 [ and ] |
Class Name | Class Description | Feature Description |
---|---|---|
C1 | The person is moving in the kitchen area. | The feature vectors have been made by concatenating range, azimuth, and corresponding frequency obtained from STFT. Therefore, 1065 features have been concatenated for one feature vector where, 355 features have been derived to represent each frequency, range, and azimuth. |
C2 | The person is plumping cushions in the living room. | |
C3 | The person is using the microwave in the kitchen. | |
C4 | The person is eating at the dining table. | |
C5 | The person is washing up at the kitchen sink. | |
C6 | The person is watching television in the living room. | |
C7 | The person is walking from the kitchen to the bathroom via dining room, entrance, and living room. | |
C8 | The person is brushing teeth in the bathroom. | |
C9 | The person is returning via the same path described in C7. |
Statistical Measurements | 10% | 20% | 30% | 40% |
---|---|---|---|---|
Correct Rate | 0.8932 | 0.8946 | 0.9047 | 0.8963 |
Error Rate | 0.1068 | 0.1054 | 0.0953 | 0.1037 |
Sensitivity | 0.8995 | 0.9037 | 0.9038 | 0.9010 |
Specificity | 0.9949 | 0.9951 | 0.9941 | 0.9948 |
Positive Predictive Value | 0.9721 | 0.9735 | 0.9695 | 0.9705 |
Negative Predictive Value | 0.9803 | 0.9812 | 0.9805 | 0.9815 |
Area Under the Curve | 0.6087 | 0.6183 | 0.6245 | 0.6195 |
Time elapsed (in Seconds) | 3.6148 | 3.1795 | 3.0573 | 2.5555 |
Methods | Accuracy | Specificity | Sensitivity |
---|---|---|---|
Yao et al. [16] | 0.7843 | - | - |
Lopez-de-Teruel et al. [19] | 0.9000 | 0.9300 | 0.8000 |
Barsocchi et al. - CPS [22,23] | 0.9120 | 0.6860 | 0.7770 |
Barsocchi et al.- n-Core [22,24] | 0.9060 | 0.6600 | 0.7950 |
Barsocchi et al.- RealTrac [22,25] | 0.8950 | 0.6230 | 0.7950 |
Diraco et al. [26] | - | 0.8015 | 0.8727 |
Chernbumroong et al. [27] | 0.9023 | 0.9043 | 0.9022 |
Fleury et al. [28] | 0.8620 | - | - |
Proposed prototype | 0.9047 | 0.9941 | 0.9038 |
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Rana, S.P.; Dey, M.; Ghavami, M.; Dudley, S. Signature Inspired Home Environments Monitoring System Using IR-UWB Technology. Sensors 2019, 19, 385. https://doi.org/10.3390/s19020385
Rana SP, Dey M, Ghavami M, Dudley S. Signature Inspired Home Environments Monitoring System Using IR-UWB Technology. Sensors. 2019; 19(2):385. https://doi.org/10.3390/s19020385
Chicago/Turabian StyleRana, Soumya Prakash, Maitreyee Dey, Mohammad Ghavami, and Sandra Dudley. 2019. "Signature Inspired Home Environments Monitoring System Using IR-UWB Technology" Sensors 19, no. 2: 385. https://doi.org/10.3390/s19020385
APA StyleRana, S. P., Dey, M., Ghavami, M., & Dudley, S. (2019). Signature Inspired Home Environments Monitoring System Using IR-UWB Technology. Sensors, 19(2), 385. https://doi.org/10.3390/s19020385