LightMem-Ego: Your AI Memory for Everyday Life

Hugging Face Daily Papers Papers

Summary

LightMem-Ego is a lightweight streaming multimodal memory system for everyday life assistance that continuously captures egocentric visual and audio streams, organizes them into hierarchical memory, and retrieves grounded answers to user queries about past experiences, deployable on smartphones and AI glasses.

Personal AI assistants on mobile and wearable devices continuously perceive users' daily lives through visual and audio streams. However, answering queries about past experiences requires lightweight multimodal memory that can continuously accumulate, organize, and retrieve long-term experiences, which remains challenging. To address this challenge, we present LightMem-Ego, a lightweight streaming multimodal memory system for everyday-life assistance. The system continuously captures egocentric visual and audio streams, aligns them on a shared timeline, and organizes them into a hierarchical memory consisting of current, short-term, and long-term memory. Given a user query, LightMem-Ego dynamically routes retrieval to the appropriate memory level and generates answers grounded in multimodal evidence. The demonstration can be deployed on smartphones and AI glasses, supporting object finding, conversation recall, life summarization, routine discovery, and personalized assistance. Code is available at https://github.com/zjunlp/LightMem-Ego.
Original Article
View Cached Full Text

Cached at: 07/14/26, 04:13 AM

Paper page - LightMem-Ego: Your AI Memory for Everyday Life

Source: https://huggingface.co/papers/2607.11487 Published on Jul 13

#3 Paper of the day Authors:

,

,

,

,

,

,

,

,

,

,

,

Abstract

PersonalAIassistantsonmobileandwearabledevicescontinuouslyperceiveusers’dailylivesthroughvisualandaudiostreams.However,answeringqueriesaboutpastexperiencesrequireslightweightmultimodalmemorythatcancontinuouslyaccumulate,organize,andretrievelong-termexperiences,whichremainschallenging.Toaddressthischallenge,wepresentLightMem-Ego,alightweightstreamingmultimodalmemorysystemforeveryday-lifeassistance.Thesystemcontinuouslycapturesegocentricvisualandaudiostreams,alignsthemonasharedtimeline,andorganizesthemintoahierarchicalmemoryconsistingofcurrent,short-term,andlong-termmemory.Givenauserquery,LightMem-Egodynamicallyroutesretrievaltotheappropriatememorylevelandgeneratesanswersgroundedinmultimodalevidence.ThedemonstrationcanbedeployedonsmartphonesandAIglasses,supportingobjectfinding,conversationrecall,lifesummarization,routinediscovery,andpersonalizedassistance.Codeisavailableathttps://github.com/zjunlp/LightMem-Ego.

View arXiv pageView PDFAdd to collection

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2607.11487 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2607.11487 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2607.11487 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Memdex

Product Hunt

Memdex turns every AI conversation into reusable local memory, allowing users to capture and reuse insights from their AI interactions.

MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory

Hugging Face Daily Papers

MemEye is a visual-centric evaluation framework that assesses multimodal agent memory by measuring visual evidence granularity and retrieval complexity across 8 life-scenario tasks, revealing that current architectures struggle to preserve fine-grained visual details and reason about state changes over time.