Non-contact, Real-time, Heart-rate Measurement using Image Processing with Commodity Cameras and AI Agents

arXiv cs.AI Papers

Summary

This paper presents a system for non-contact, real-time heart rate measurement using commodity cameras and image processing with deep learning and AI agents, with future plans for personal AI health monitoring.

arXiv:2607.06598v1 Announce Type: cross Abstract: Heart rate measurement is one of the key requirements for real-time health monitoring, in particular for health caring of elderly people. Traditional heart rate measurement relies on contact sensing mechanisms such as some heart rate measurement devices at medical hospitals or some wearable devices with embedded sensors such as Apple Watch, etc. In this paper, we develop a system for non-contact, real-time, heart rate measurement using image processing with commodity cameras such as an embedded camera on a laptop, where we use an innovative algorithm to capture the relevant signals for the computation of heart rate in a time series in real life environments. The presented heart rate computation (HRC) process is composed with four major steps: (a) identify frames per second of the camera in use, i.e., 30 frames per second for a given camera, (b) face detection (FD) with shape predictor of 68 face landmarks using deep learning (DL) method, (c) time sliding window (TSW) algorithm to de-noise the signal by smoothing out the noise, and (d) compute heart rate based on identified signal periodicity. We test and analyze the developed prototypes against heart rate results by Apple Watch and check the difference range in multiple rounds and compute the mean of the difference for the measurement values of the heart rate of the same person at the same time. We will do further tuning and optimization of the present methods and deploy the system as a personal AI agent [6] for health monitoring as our future directions.
Original Article
View Cached Full Text

Cached at: 07/09/26, 07:57 AM

# Non-contact, Real-time, Heart-rate Measurement using Image Processing with Commodity Cameras and AI Agents
Source: [https://arxiv.org/abs/2607.06598](https://arxiv.org/abs/2607.06598)
[View PDF](https://arxiv.org/pdf/2607.06598)

> Abstract:Heart rate measurement is one of the key requirements for real\-time health monitoring, in particular for health caring of elderly people\. Traditional heart rate measurement relies on contact sensing mechanisms such as some heart rate measurement devices at medical hospitals or some wearable devices with embedded sensors such as Apple Watch, etc\. In this paper, we develop a system for non\-contact, real\-time, heart rate measurement using image processing with commodity cameras such as an embedded camera on a laptop, where we use an innovative algorithm to capture the relevant signals for the computation of heart rate in a time series in real life environments\. The presented heart rate computation \(HRC\) process is composed with four major steps: \(a\) identify frames per second of the camera in use, i\.e\., 30 frames per second for a given camera, \(b\) face detection \(FD\) with shape predictor of 68 face landmarks using deep learning \(DL\) method, \(c\) time sliding window \(TSW\) algorithm to de\-noise the signal by smoothing out the noise, and \(d\) compute heart rate based on identified signal periodicity\. We test and analyze the developed prototypes against heart rate results by Apple Watch and check the difference range in multiple rounds and compute the mean of the difference for the measurement values of the heart rate of the same person at the same time\. We will do further tuning and optimization of the present methods and deploy the system as a personal AI agent \[6\] for health monitoring as our future directions\.

## Submission history

From: Fulu Li \[[view email](https://arxiv.org/show-email/fef6f0f3/2607.06598)\] **\[v1\]**Mon, 6 Jul 2026 23:38:02 UTC \(1,845 KB\)

Similar Articles

GlowPulse

Product Hunt

GlowPulse turns your Mac's camera into a heart-rate sensor, enabling contactless health monitoring.

How AI is helping improve heart health in rural Australia

Google AI Blog

Google is launching a new AI initiative in partnership with Australian health organizations to improve heart health outcomes in rural and remote communities, using Population Health AI (PHAI) to identify hidden health risks and enable proactive chronic disease management.