DataTaunew | comments | leaders | submitlogin
Presidential debate: live analysis of candidates' heart rates (hearty.ai)
12 points by asdf314 2739 days ago | 4 comments


1 point by banacer 2738 days ago | link

Was the heart rate data made public? What is the source of this data?

-----

1 point by mansi 2734 days ago | link

They are using Eulerian Video Magnification to visualizing the human pulse. This technique was developed by MIT and it basically magnifies the periodic color variation on their face.

http://people.csail.mit.edu/mrub/vidmag/

-----

1 point by asdf314 2733 days ago | link

For this purpose, MIT's Eulerian Video Magnification is next to impossible when you have both color changes and large motions (it is better suited to magnifying small motions, or subtle color changes in unmoving patches). NASA Glenn's thearn has developed another approach which has the same problems (https://github.com/thearn/webcam-pulse-detector). We developed our own solution, involving (among other things) pixel-accurate facial feature detection and filtering methods not subject to FFT's regularity assumption, based on the synchrosqueezing transform

-----

1 point by ororm 2738 days ago | link

Heart rates are recognized from video, using slight changes in skin color caused by heart beats (video plethysmography).

You can try the demo on the site with your own webcam, and check your own heart rate, if you scroll down

-----




RSS | Announcements