Back to Evidence Hub
Case Study from-video-to-vital-signs-a-new-method-for-contactless-multichannel-seismocardiography
2025 Release

From video to vital signs: a new method for contactless multichannel seismocardiography

Executive Summary

This study introduces a novel, cost-effective method for multichannel seismocardiography (SCG) using smartphone video recordings and deep learning techniques. By employing a grid of QR-coded stickers on the chest, the researchers utilized YOLOv7 for object detection and template tracking to extract SCG signals, achieving high-resolution multichannel SCG maps. The method demonstrated strong agreement with gold-standard ECG-derived heart rate (HR) measurements (bias ± 1.96 SD = 0.04 ± 2.14 bpm; r = 0.99, p < 0.001) and identified optimal chest locations for HR estimation. This approach has significant potential for accessible, non-invasive cardiac monitoring using widely available smartphones.

This study shows that smartphone videos can track heart vibrations using QR stickers on the chest, offering a low-cost way to monitor heart health and detect issues early, with accuracy comparable to clinical tools.

Answer Machine Insights

Q: How accurate is the heart rate estimation using this method compared to ECG?

The heart rate estimation showed a bias ± 1.96 SD of 0.04 ± 2.14 bpm compared to ECG-derived HR, with a correlation coefficient of r = 0.99 (p < 0.001).

Moreover, our algorithm accurately estimated HR from 1968 SCG signals extracted from the videos compared to the gold-standard HR measured from each subject’s electrocardiogram (bias ± 1.96 SD = 0.04 ± 2.14 bpm; r = 0.99, p < 0.001).

Q: What is the significance of using multichannel SCG over single-channel SCG?

Multichannel SCG enhances spatial resolution, enabling precise identification of optimal chest locations for physiological measurements and providing a more comprehensive view of cardiac activities.

This multichannel capability allows for the construction of SCG maps that provide a more comprehensive view of cardiac activities, including rapid ejection phases and valve dynamics, which were not as detailed in our previous work.

Key Results

  • The proposed method achieved a mean squared error of 0.1078 and 0.0418 for right-to-left and head-to-foot SCG signals, respectively.

  • Heart rate estimation from SCG signals showed a bias ± 1.96 SD of 0.04 ± 2.14 bpm compared to ECG-derived HR, with a correlation coefficient of r = 0.99 (p < 0.001).

Visual Evidence