Tag
Guides users on running the Gemma 4 12B multimodal local model on a MacBook with 16GB RAM using LM Studio and Codex, enabling free token usage.
Summarizes several main implementation directions for current multimodal large model startups, including game AI NPC, enterprise-level multimodal Agent, content generation, embodied intelligence, and visual code assistants.
M^3Eval is a comprehensive evaluation framework and benchmark for probing memory capabilities in multi-modal models, grounded in cognitive psychology. Experiments reveal consistent weaknesses in memory maintenance, interference patterns, and spatial-temporal grounding.
This paper explores replacing scalar sentiment scores with high-dimensional FinBERT embeddings in a Transformer-based architecture for short-term stock price prediction, showing improved accuracy with Siamese-optimized embeddings.
WALL-WM advances video-action learning by using semantic events as learning units instead of fixed action chunks, enabling more flexible and scalable vision-language-action training and inference.
NAVA proposes a native audio-visual alignment framework for joint audio-video generation using an Align-then-Fuse MMDiT architecture, achieving improved synchronization and controllability with 6.3B parameters.
This paper introduces slidesqaqa, a Flask-based software system that generates pedagogically useful questions from PDF slide decks. It uses a four-stage LLM pipeline to extract text and images, plan questions across the deck, annotate slides, and reconcile outputs, demonstrating high-fidelity question generation on technical lecture slides.
Unveil introduces a unified visual-textual embedding framework for multi-modal document retrieval, using knowledge distillation to transfer semantic understanding from a visual-textual model to a purely visual model, achieving robust and efficient retrieval.
Discussing two papers, ByteDance Seed's Cola DLM and MIT Kaiming He's ELF, which break the limitations of discrete tokens through a continuous diffusion paradigm, achieving better global planning and multimodal alignment.
UniT is a unified feed-forward model for geometry perception using a Group Autoregressive Transformer that integrates multiple paradigms (online/offline, multi-modal, long-horizon) while maintaining metric-scale accuracy via scale-adaptive loss and queue-style KV caching. It achieves state-of-the-art performance on ten benchmarks spanning seven tasks.
Discusses practical challenges in scaling infrastructure for AI agent pipelines on a budget, highlighting the inadequacy of CPU/memory-based autoscaling for GPU inference workloads.
This paper proposes HT-GRPO, a hierarchical reinforcement learning method for diffusion multi-modal large language models that uses a sketch-then-paint training scheme and hierarchical credit assignment to improve image generation quality and reward alignment.
Lemonade, an open-source local AI solution, has graduated macOS support from beta, now offering all major capabilities including OmniRouter, coding, image/speech generation and transcription on macOS.
MAML is a novel multi-modal AI model that unifies understanding of chemistry, genetics, and proteins, outperforming specialized models on 11 drug discovery benchmarks, promising to accelerate pharmaceutical research and improve success rates.
Introduces HAM3, a hierarchical attack framework targeting perception, communication, and reasoning layers of multi-modal multi-agent systems, achieving up to 78.3% attack success rate on the GQA benchmark.
Perceptron Inc. released its flagship video analysis model Mk1, claiming 80-90% lower cost than competitors while achieving strong performance on spatial and video reasoning benchmarks.
The article introduces DataArc-SynData-Toolkit, an open-source framework designed to simplify multi-path, multimodal, and multilingual synthetic data generation. It aims to lower technical barriers and improve usability for training large language models through a unified, configuration-driven pipeline.
ToolCUA is a new agent framework that optimizes GUI-tool path selection for computer use agents through staged training and reinforcement learning. It achieves state-of-the-art performance on OSWorld-MCP by effectively interleaving GUI actions and high-level tool calls.
ByteDance releases DeerFlow 2.0, an open-source AI agent framework for local execution of tasks like coding, research, and content generation without cloud dependencies or subscriptions.
M2Retinexformer extends the Retinexformer framework for low-light image enhancement by incorporating depth, luminance, and semantic cues via cross-attention and adaptive gating, achieving state-of-the-art results on multiple benchmarks.