|Search by item||HOME > Access full text > Search by item|
JBE, vol. 26, no. 2, pp.132-142, March, 2021
Real-time Vital Signs Measurement System using Facial Image Data
DaeYeol Kim, JinSoo Kim, and KwangKee Lee
C.A E-mail: email@example.com
The purpose of this study is to present an effective methodology that can measure heart rate, heart rate variability, oxygen saturation, respiration rate, mental stress level, and blood pressure using mobile front camera that can be accessed most in real life. Face recognition was performed in real-time using Blaze Face to acquire facial image data, and the forehead was designated as ROI (Region Of Interest) using feature points of the eyes, nose, and mouth, and ears. Representative values for each channel of the ROI were generated and aligned on the time axis to measure vital signs. The vital signs measurement method was based on Fourier transform, and noise was removed and filtered according to the desired vital signs to increase the accuracy of the measurement. To verify the results, vital signs measured using facial image data were compared with pulse oximeter contact sensor, and TI non-contact sensor. As a result of this work, the possibility of extracting a total of six vital signs (heart rate, heart rate variability, oxygen saturation, respiratory rate, stress, and blood pressure) was confirmed through facial images.
Keyword: Vital Sign, Face detection, non-contact sensing
 National Early Warning Score(NEWS), https://www.mdcalc.com/national-early-warning-score-news
 J. Kim, K. Lee, "A Comparative Study on the Optimal Model for abnormal Detection event of Heart Rate Time Series Data Based on the Correlation between PPG and ECG", https://doi.org/10.7472/jksii. 2019.20.6.137 (accessed Aug, 30, 2019)
 V. Bazarevsky, Y. Kartynnik, A. Vakunov, K. Raveendran, M. Grundmann, "BlazeFace: Sub-millisecond Neural Face Detection on Mobile GPUs", CVPR Workshop on Computer Vision for Augmented and Virtual Reality, 2019.
 V. Kublanov, K. Purtov and D. Belkov, "Remote Photoplethysmogra- phy for the Neuro-electrostimulation Procedures Monitoring The Possibilities of Remote Photoplethysmography Application for the Analysis of High Frequency Parameters of Heart Rate Variability." 10th International Conference on Bio-Inspired Systems and Signal Processing, BIOSIGNALS 2017-Part of 10th International Joint Conference on Biomedical Engineering Systems and Technologies, BIOSTEC 2017. SciTePress, 2017.
 Luchini, D. Paulo, et al,"Validation of a spectrophotometric method for quantification of carboxyhemoglobin." Journal of analytical toxicology Vol.33 No.8, pp.540-544. 2019.
 Fred.S, J.P. Ginsberg,"An Overview of Heart Rate Variability Metrics and Norms", Frontiers in public health 5 ,2017
 Delaney, J.P.A, & Brodie, D.A,"Effects of short-term psychological stress on the time and frequency domains of heart-rate variability." Perceptual and motor skills Vol.91 No.2 , pp.515-524, 2000.
 Sanyal, Shourjya, and K. K.Nundy. "Algorithms for monitoring heart rate and respiratory rate from the video of a user’s face." IEEE Journal of translational engineering in health and medicine Vol.6, pp.1-11. 2018.
 Scholander, P. F. "Oxygen transport through hemoglobin solutions." Science Vol.131 No.3400, pp.585-590,1960
 Suna, Gürhan, and M. Alp. "Comparison of Strength, Heart Rate, Oxygen Saturation and Technical Test Values of 12-14 Year Male Tennis Players in Competition Period." Journal of Education and Learning Vol.8 No.6, pp.187-194, 2019.
 mCube-HealthCare IOT Device, http://www.cndi.co.kr/cndi/board/ bbs/board.php?bo_table=flan&wr_id=5
 E. Cha, K. Jong, Development of an IoB-Based HW/SW Platform for Human Motion Detection and Heart Rate Measurement . Journal of Broadcast Engineering, pp.178-180, Nov 2019
 D. Kim, J. Kim, K. Kwang, Real-time vital signs measurement system using facial image on Mobile, Journal of Broadcast Engineering, pp.94-97, Nov 2020.