Remote sensing of heart rate and blood oxygenation level using gaming camera based technology
•Download as PPT, PDF•
1 like•760 views
Explains about Remote sensing of heart rate and the data given by it i.e., Pulse Oximetry, Kinect, Heart Rate and Reflectance measurement setup. For more information visit: http://www.transformhealth-it.org/
Recommended
Recommended
More Related Content
Similar to Remote sensing of heart rate and blood oxygenation level using gaming camera based technology
Similar to Remote sensing of heart rate and blood oxygenation level using gaming camera based technology (20)
More from Apollo Hospitals Group and ATNF
More from Apollo Hospitals Group and ATNF (20)
Recently uploaded
Recently uploaded (20)
Remote sensing of heart rate and blood oxygenation level using gaming camera based technology
- 1. 1 Remote sensing of heart rate and blood oxygenation level using gaming camera-based technology David Harris-Birtill1*, David Morrison1, Devesh Dhasmana2,3 1School of Computer Science, University of St Andrews, Fife, KY16 9SX, Scotland, UK 2School of Medicine, University of St Andrews, Fife, KY16 9TJ, Scotland, UK 3NHS Fife, Victoria Hospital, Hayfield Road, Kirkcaldy, KY2 5AH, Scotland, UK *dcchb@st-andrews.ac.uk
- 2. 2 Pulse Oximetry • Heart Rate (less than 40, or more than 130 beats per minute = bad)* • Blood Oxygenation level (less than 90% = bad)* * Taenzer et al. “Impact of pulse oximetry surveillance on rescue events and intensive care unit transfers: a before-and-after concurrence study.” Anesthesiology. 112 (2010): 282-7.
- 3. 3 Kinect: what data does it give us? • Colour image (RGB) • Infrared (IR) image • Depth map • Joint positions (head arms legs etc.)
- 4. 4 Reflectance measurement setup PC Spectro meter White light source USB Fibre optic cable USB Pulse oximeter PC Kinect v2 USB USB Pulse oximeter Imaging area Spectrometer setup Kinect setup
- 5. 5 Calculation of heart rate Peak frequency: 72 beats per minute Integrated intensity over time (across all wavelengths) Frequency content (using FFT) after high pass filter
- 6. 6 Calculated heart rate at each wavelength Highaccuracy
- 7. 7 Automated extraction of colour and IR skin reflectance
- 9. 9 David Harris-Birtill dcchb@st-andrews.ac.uk Questions? Acknowledgements: - Co-authors: David Morrison, Devesh Dhasmana - St Andrews Human Computer Interaction (SACHI) lab Institutions: Funding:
Editor's Notes
- Heartbeat in the lip as measured using a reflectance spectrometer at 10Hz over time from participant’s lip. a.) Integrated sum of the whole spectrum over time where the fluctuations are due to the heartbeat. b.) The frequency content of this signal over time after a high pass filter of 35 beats per minute is applied. This shows the peak frequency content of 72 beats per minute, which is the heart rate.
- The calculated heartrate in the lip over 30 seconds at each wavelength, using the intensity of the received light at each wavelength over time as the signal to calculate the heart rate from (after using a high pass filter of 35 beats per minute), showing the most accurate region to be between 450nm to 600nm (green region).
- Showing the automated extraction process from two of the co-authors in the (a) infrared image, and (b) colour image. The regions of interest in the face are then extracted (c), with the dots on the top left corner of each of the regions of interest (cheeks, forehead and lips) showing the computed mean value.
- Mockup of the system user interface, showing the automatically extracted images of the faces and their corresponding heart rate and oxygenation level (the current value as a number and the history over time as a chart). If a person’s heart rate or oxygenation level goes out of normal bounds, the system can highlight this as someone to attend to.
- a.) The optical extinction spectra of oxy- (red line) and deoxyhaemoglobin (blue line) within blood. b) The spectral extinction coefficient differences between deoxy- and oxyhaemoglobin (deoxy minus oxy, shown with a black line). Shaded areas correspond to the spectral regions of colour camera channels red, green and blue; the grey shaded area is the near infrared (IR) spectral region above 800nm, which IR cameras, such the Microsoft Kinect games console camera, are able to detect. Figures created using data from http://omlc.org/spectra/hemoglobin/summary.html
- : a.) Measured reflectance spectra over 30 seconds at 10Hz, where the solid red line is the mean and the shaded area shows the range of values over the 30 seconds. b.) Reflectance spectrum showing the ratio of reflected light back compared to the intensity of light in, corrected for the white light emission by normalizing and then dividing by the normalised white light emission spectrum.
- : a.) Measured reflectance spectra over 30 seconds at 10Hz, where the solid red line is the mean and the shaded area shows the range of values over the 30 seconds. b.) Reflectance spectrum showing the ratio of reflected light back compared to the intensity of light in, corrected for the white light emission by normalizing and then dividing by the normalised white light emission spectrum.
- Characterisation of Kinect v2 laser. a.) Measured optical emission spectrum of Microsoft Kinect v2 infrared laser. b.) Histogram of the measured laser peak wavelength after 1,000,000 spectra acquired.