Search by item HOME > Access full text > Search by item

JBE, vol. 26, no. 2, pp.132-142, March, 2021

DOI: https://doi.org/10.5909/JBE.2021.26.2.132

Real-time Vital Signs Measurement System using Facial Image Data

DaeYeol Kim, JinSoo Kim, and KwangKee Lee

C.A E-mail: kwangkeelee@gmail.com

Abstract:

The purpose of this study is to present an effective methodology that can measure heart rate, heart rate variability, oxygen saturation, respiration rate, mental stress level, and blood pressure using mobile front camera that can be accessed most in real life. Face recognition was performed in real-time using Blaze Face to acquire facial image data, and the forehead was designated as ROI (Region Of Interest) using feature points of the eyes, nose, and mouth, and ears. Representative values for each channel of the ROI were generated and aligned on the time axis to measure vital signs. The vital signs measurement method was based on Fourier transform, and noise was removed and filtered according to the desired vital signs to increase the accuracy of the measurement. To verify the results, vital signs measured using facial image data were compared with pulse oximeter contact sensor, and TI non-contact sensor. As a result of this work, the possibility of extracting a total of six vital signs (heart rate, heart rate variability, oxygen saturation, respiratory rate, stress, and blood pressure) was confirmed through facial images.



Keyword: Vital Sign, Face detection, non-contact sensing

Reference:
[1] National Early Warning Score(NEWS), https://www.mdcalc.com/national-early-warning-score-news
[2] J. Kim, K. Lee, "A Comparative Study on the Optimal Model for abnormal Detection event of Heart Rate Time Series Data Based on the Correlation between PPG and ECG", https://doi.org/10.7472/jksii. 2019.20.6.137 (accessed Aug, 30, 2019)
[3] V. Bazarevsky, Y. Kartynnik, A. Vakunov, K. Raveendran, M. Grundmann, "BlazeFace: Sub-millisecond Neural Face Detection on Mobile GPUs", CVPR Workshop on Computer Vision for Augmented and Virtual Reality, 2019.
[4] V. Kublanov, K. Purtov and D. Belkov, "Remote Photoplethysmogra- phy for the Neuro-electrostimulation Procedures Monitoring The Possibilities of Remote Photoplethysmography Application for the Analysis of High Frequency Parameters of Heart Rate Variability." 10th International Conference on Bio-Inspired Systems and Signal Processing, BIOSIGNALS 2017-Part of 10th International Joint Conference on Biomedical Engineering Systems and Technologies, BIOSTEC 2017. SciTePress, 2017.
[5] Luchini, D. Paulo, et al,"Validation of a spectrophotometric method for quantification of carboxyhemoglobin." Journal of analytical toxicology Vol.33 No.8, pp.540-544. 2019.
[6] Fred.S, J.P. Ginsberg,"An Overview of Heart Rate Variability Metrics and Norms", Frontiers in public health 5 ,2017
[7] Delaney, J.P.A, & Brodie, D.A,"Effects of short-term psychological stress on the time and frequency domains of heart-rate variability." Perceptual and motor skills Vol.91 No.2 , pp.515-524, 2000.
[8] Sanyal, Shourjya, and K. K.Nundy. "Algorithms for monitoring heart rate and respiratory rate from the video of a user’s face." IEEE Journal of translational engineering in health and medicine Vol.6, pp.1-11. 2018.
[9] Scholander, P. F. "Oxygen transport through hemoglobin solutions." Science Vol.131 No.3400, pp.585-590,1960
[10] Suna, Gürhan, and M. Alp. "Comparison of Strength, Heart Rate, Oxygen Saturation and Technical Test Values of 12-14 Year Male Tennis Players in Competition Period." Journal of Education and Learning Vol.8 No.6, pp.187-194, 2019.
[11] mCube-HealthCare IOT Device, http://www.cndi.co.kr/cndi/board/ bbs/board.php?bo_table=flan&wr_id=5
[12] E. Cha, K. Jong, Development of an IoB-Based HW/SW Platform for Human Motion Detection and Heart Rate Measurement . Journal of Broadcast Engineering, pp.178-180, Nov 2019
[13] D. Kim, J. Kim, K. Kwang, Real-time vital signs measurement system using facial image on Mobile, Journal of Broadcast Engineering, pp.94-97, Nov 2020.

Comment


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: www.kibme.org TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved