MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories

Hugging Face Daily Papers Papers

Summary

MemLife introduces a multimodal memory system for long-term egocentric videos that builds entity-grounded text episodes and retrieves them with a time-indexed agentic reader, improving over training-free baselines by 4.6-12.0% on long-horizon benchmarks. A reinforcement learning framework called MemOpt further optimizes the memory writer for faithfulness and retrievability, yielding consistent 2.7-5.0% gains.

Long-term egocentric video enables personalized AI assistants to reason about daily life. However, as video histories grow to hundreds of hours spanning months or years, reprocessing raw clips for every query becomes computationally prohibitive. Memory systems offer a scalable alternative by compacting videos into text representations, but often fail on practical benchmarks: either the memory does not preserve key evidence, or the retriever fails to locate relevant entries due to retrieval competition in growing search spaces. To address these challenges, we introduce MemLife, a multimodal memory system that constructs entity-grounded, first-person text episodes and retrieves them via a time-indexed agentic reader. Without training or query-time video access, MemLife improves over the strongest training-free baseline by 4.6--12.0% across four long-horizon benchmarks. To further improve memory quality, we propose MemOpt, a reinforcement learning framework that optimizes the memory writer to produce faithful, informative, and retrievable memories. MemOpt consistently improves MemLife by 2.7--5.0% across different video and question distributions, with gains that generalize across writer and reader backbones and memory systems.
Original Article
View Cached Full Text

Cached at: 10/01/26, 04:23 PM

Paper page - MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories

Source: https://huggingface.co/papers/2609.40195 Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Long-termegocentricvideoenablespersonalizedAIassistantstoreasonaboutdailylife.However,asvideohistoriesgrowtohundredsofhoursspanningmonthsoryears,reprocessingrawclipsforeveryquerybecomescomputationallyprohibitive.Memorysystemsofferascalablealternativebycompactingvideosintotextrepresentations,butoftenfailonpracticalbenchmarks:eitherthememorydoesnotpreservekeyevidence,ortheretrieverfailstolocaterelevantentriesduetoretrievalcompetitioningrowingsearchspaces.Toaddressthesechallenges,weintroduceMemLife,amultimodalmemorysystemthatconstructsentity-grounded,first-persontextepisodesandretrievesthemviaatime-indexedagenticreader.Withouttrainingorquery-timevideoaccess,MemLifeimprovesoverthestrongesttraining-freebaselineby4.6--12.0%acrossfourlong-horizonbenchmarks.Tofurtherimprovememoryquality,weproposeMemOpt,areinforcementlearningframeworkthatoptimizesthememorywritertoproducefaithful,informative,andretrievablememories.MemOptconsistentlyimprovesMemLifeby2.7--5.0%acrossdifferentvideoandquestiondistributions,withgainsthatgeneralizeacrosswriterandreaderbackbonesandmemorysystems.

View arXiv pageView PDFAdd to collection

Get this paper in your agent:

hf papers read 2609\.40195

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2609.40195 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2609.40195 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2609.40195 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory

Hugging Face Daily Papers

MemEye is a visual-centric evaluation framework that assesses multimodal agent memory by measuring visual evidence granularity and retrieval complexity across 8 life-scenario tasks, revealing that current architectures struggle to preserve fine-grained visual details and reason about state changes over time.

MemFit: Efficient Long-Term Agentic Memory

arXiv cs.AI

MemFit is a long-term memory system for conversational agents that stores turns verbatim in an append-only store and uses LLM-free insertion and multi-path retrieval to drastically cut memory construction cost and latency while achieving state-of-the-art results on LoCoMo, MemGallery, and LongMemEval-S.