Deepseek training 2T and plans 8T model

Reddit r/LocalLLaMA News

Summary

DeepSeek is training a 2 trillion-parameter AI model and plans to eventually build an 8 trillion-parameter model.

Quote: DeepSeek is training a 2T-parameter model and plans to eventually build an 8T-parameter model. https://x.com/wallstengine/status/2101982843656388644 Current DeepSeek models: Flash parameter count of 552 billion Pro: 1.6T (trillion) total parameters with 49B (billion) activated weights per token Mythos / Fable is estimated to be 10T parameter count.
Original Article

Similar Articles

DeepSeek Introduces Vision

Hacker News Top

DeepSeek announces a new vision capability, likely a vision-language model, expanding its AI offerings.

deepseek-ai/DeepSeek-V4-Pro-DSpark

Hugging Face Models Trending

DeepSeek releases preview versions of its V4 series, including DeepSeek-V4-Pro (1.6T parameters, 49B activated) and DeepSeek-V4-Flash (284B parameters, 13B activated), both supporting a one-million-token context and featuring hybrid attention, manifold-constrained hyper-connections, and a Muon optimizer.

DeepSeek-V3 Technical Report

Papers with Code Trending

DeepSeek-V3 is a parameter-efficient Mixture-of-Experts language model with 671B total parameters, achieving strong performance comparable to leading closed-source models while requiring only 2.788M H800 GPU hours for training.