large-context

Tag

Cards List
#large-context

Introducing Muse Spark Open: the most capable US open-weight model to date

Reddit r/LocalLLaMA ↗ · 2026-10-15

Meta 发布 Muse Spark Open,号称迄今最强大的美国开源权重模型,专为编码与智能体任务打造,拥有 816B 总参数(42B 激活)、1M 上下文窗口及文本/图像/视频/音频多模态能力,并支持多种推理引擎与微调框架。

0 favorites 0 likes
#large-context

@RayFernando1337: This is going to break the internet. 10M context window technical report is now published. https://voltropy.com/assets/…

X AI KOLs Timeline ↗ · 2026-09-29 Cached

A technical report for a 10M context window model has been published by Voltropy, potentially revolutionizing AI's capacity to handle extremely long texts.

0 favorites 0 likes
#large-context

@AdinaYakup: Xing4.0 from China Telecom has been quietly trending on the Hub since last week - 29B/4B MoE - Trained entirely on Asce…

X AI KOLs Timeline ↗ · 2026-09-25 Cached

Xing4.0 is an AI model from China Telecom with a 29B/4B Mixture of Experts architecture, trained on Ascend 910C using MindSpore, offering up to 512K context and open-sourced under Apache 2.0.

0 favorites 0 likes
#large-context

@AdinaYakup: RedNote don’t release that often, but each one is solid https://huggingface.co/dots-studio/dots3-note-prev…

X AI KOLs Timeline ↗ · 2026-09-22 Cached

dots3-note Preview is a multimodal Mixture-of-Experts AI model with 280B total parameters and 16B activated, supporting up to 512K token context, released as an open-weight model on Hugging Face.

0 favorites 0 likes
#large-context

@AdinaYakup: Xiaomi @XiaomiMiMo just released 2 SoTA models One might be the new BEST open model yet Both are: - Sparse MoE + 1M con…

X AI KOLs Timeline ↗ · 2026-09-21 Cached

Xiaomi has released two state-of-the-art AI models, MiMo-V2.6 Pro RL for maximum capability and MiMo-V2.6 Flash RL for maximum efficiency, both featuring sparse mixture-of-experts architecture, 1M context length, MIT licensing, and native omni-modal support for text, image, video, and audio.

0 favorites 0 likes
#large-context

@novita_labs: Novita now supports DeepSeek-V4.1-Flash on @huggingface. • 552B backbone parameters • Native image and text input • Up …

X AI KOLs Following ↗ · 2026-09-10 Cached

Novita announces support for the DeepSeek-V4.1-Flash AI model on Hugging Face, featuring 552B parameters, native image and text input, a 1M-token context window, and controllable reasoning effort.

0 favorites 0 likes
#large-context

@Modular: It's official: Ox Alpha is @Zai_org's GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series, with 320B…

X AI KOLs Timeline ↗ · 2026-08-26 Cached

Z.ai has officially released GLM-5.3-Flash, a natively multimodal AI model with 320B parameters and a 1M-token context window, previously previewed as Ox Alpha, available via Modular Cloud and running on Chinese AI chips under an MIT License.

0 favorites 0 likes
#large-context

An anonymous lab dropped a model on OpenRouter this week. Just "Ox Alpha". 1M context. Multimodal. Free.

Reddit r/ArtificialInteligence ↗ · 2026-08-21

An anonymous lab released the Ox Alpha model on OpenRouter, featuring 1M token context, multimodal capabilities, and free access. It was showcased in an agent that autonomously built and verified a Three.js website.

0 favorites 0 likes
#large-context

@AdinaYakup: More players are joining the open source summer RedNote just released dots3-note preview The first open weight model in…

X AI KOLs Following ↗ · 2026-08-14 Cached

RedNote has released dots3-note preview, the first open-weight model in the dots3 family, featuring 280B parameters with 16B active, multi-modal understanding (text, image, video, audio), 512K context length, and Apache 2.0 license, with strong agent capabilities.

0 favorites 0 likes
#large-context

@svpino: I've been testing Kimi K3, and holy smokes, this is the best open-weight model the world has seen. It's a 2.8T-paramete…

X AI KOLs Timeline ↗ · 2026-08-05 Cached

Santiago Valdarrama reports that Kimi K3 is the best open-weight model he has tested, a 2.8T-parameter vision model with tool calling, reasoning, and a 1M context window.

0 favorites 0 likes
#large-context

@huckiyang: https://x.com/huckiyang/status/2077625513384841679

X AI KOLs Timeline ↗ · 2026-07-16 Cached

Inkling, a 975B Mixture-of-Experts model (41B active) with 1M context and Apache-2.0 license, introduces a novel audio front end using a 7.9M parameter lookup table instead of a traditional encoder, achieving strong performance on speech tasks. The model was pretrained on 45 trillion tokens of text, images, audio, and video.

0 favorites 0 likes
#large-context

@EntelligenceAI: Kimi K3 is set to launch within hours And this could be one of the most important open-model launches of the year. Why …

X AI KOLs Following ↗ · 2026-07-14 Cached

Kimi K3, the latest open-weight model from Moonshot, launches with a new architecture, agent swarm capabilities, and focus on long-horizon agent workflows, positioning it as a major contender against other top models.

0 favorites 0 likes
#large-context

@NVIDIAAI: You're welcome

X AI KOLs Timeline ↗ · 2026-07-08 Cached

NVIDIA AI releases a 75B MoE model (9.3B active) compressed from Nemotron-3-Super-120B using the Iterative Puzzle framework, with 1M token context support.

0 favorites 0 likes
#large-context

@CDGalpha: gemini 3.5 flash is free now google quietly made their newest flash model free-tier eligible. no credit card, 1M contex…

X AI KOLs Timeline ↗ · 2026-07-03 Cached

Google quietly made its newest flash model, Gemini 3.5 Flash, free-tier eligible with no credit card, a 1M context window, and 1,500 requests per day, including native multimodal support.

0 favorites 0 likes
#large-context

Mimo 2.5 is _fast_ at large context (dual RTX Pro 6000)

Reddit r/LocalLLaMA ↗ · 2026-06-23

Mimo 2.5 demonstrates fast performance with large context windows using dual RTX Pro 6000 GPUs.

0 favorites 0 likes
#large-context

@Modular: .@zai_org open-sourced GLM 5.2 today, and Modular is a Day Zero launch partner. GLM 5.2 is their new flagship for codin…

X AI KOLs Following ↗ · 2026-06-16 Cached

Zhipu AI (zai_org) has open-sourced GLM 5.2, a flagship model for coding and long-horizon agentic tasks with a usable 1M-token context. Modular is a Day Zero launch partner, offering optimized serving on Modular Cloud.

0 favorites 0 likes
#large-context

Anyone gotten Gemma 4 12B (unified audio) to actually attend to speech with a large system prompt?

Reddit r/LocalLLaMA ↗ · 2026-06-10

The user reports that the Gemma 4 12B unified audio model stops attending to speech when the system prompt is large (~21k tokens), and asks for workarounds or explanations, noting the issue persists across vLLM, llama.cpp, and LiteRT-LM backends.

0 favorites 0 likes
#large-context

@mervenoyann: NVIDIA Nemotron Ultra is here > 55B/550B a hybrid MoE  with 1M context window > supports MTP speculative decoding > da…

X AI KOLs Following ↗ · 2026-06-04 Cached

NVIDIA released Nemotron Ultra, a hybrid MoE model with 55B/550B parameters and a 1M context window, supporting MTP speculative decoding and available day-0 in transformers.

0 favorites 0 likes
#large-context

@PrajwalTomar_: Everyone's sleeping on MiniMax. Again. They just shipped M3. The first open-weights model to combine frontier coding, 1…

X AI KOLs Following ↗ · 2026-06-04 Cached

MiniMax released M3, an open-weights model combining frontier coding, 1M context, and native multimodality, offering comparable performance to Opus at a fraction of the cost.

0 favorites 0 likes
#large-context

@AdinaYakup: Step-3.7-Flash New VL model from @StepFun_ai 198B / 11B active - MoE 256K context 3 reasoning level Up to 400 tokens/sec

X AI KOLs Timeline ↗ · 2026-05-29 Cached

StepFun releases Step-3.7-Flash, a new large vision-language MoE model with 198B parameters (11B active), 256K context, and up to 400 tokens/sec inference speed.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback