@FinanceYF5: Aizpurua team at Multiverse Computing, Spain, proposes using small quantum circuits to expand pretrained large models: instead of stacking parameters, they compress complex mathematical relationships into quantum circuits. Adding only about 6,000 parameters to Llama 3.1 8B (less than 0.01% of the original model) reduces perplexity by 1.4%.

X AI KOLs Following Papers

Summary

The Aizpurua team at Multiverse Computing, Spain, proposes expanding pretrained large models with small quantum circuits. Adding just about 6,000 parameters to Llama 3.1 8B reduces perplexity by 1.4%, demonstrating the feasibility of quantum-circuit-assisted large model scaling.

The Aizpurua team at Multiverse Computing, Spain, proposes using small quantum circuits to expand pretrained large models: instead of stacking parameters, they compress complex mathematical relationships into quantum circuits. Adding only about 6,000 parameters to Llama 3.1 8B (less than 0.01% of the original model) reduces perplexity by 1.4%; the quantum part runs on an IBM 156-qubit processor. The team acknowledges the gain is modest but proves the concept is workable. https://t.co/uOJVbZyY8Z
Original Article
View Cached Full Text

Cached at: 06/08/26, 01:20 PM

Spain’s Multiverse Computing team led by Aizpurua proposes using small quantum circuits to expand pre-trained large models: instead of stacking parameters, they compress complex mathematical relationships into quantum circuits.

For Llama 3.1 8B, adding only about 6,000 parameters (less than 0.01% of the original model) reduces perplexity by 1.4%; the quantum part runs on IBM’s 156-qubit processor. The team notes the gain is modest but confirms feasibility. https://t.co/uOJVbZyY8Z

Similar Articles

@NFTCPS: 4GB VRAM running 70B large model? It actually works! AirLLM did a clever trick — layered inference, not loading the whole model into VRAM at once, but layer by layer, compute and discard, squeezing the giant into a small GPU. The best part: 100% open source, freebie warning https://github.com/0xSo…

X AI KOLs Timeline

AirLLM is a fully open-source tool that uses layered inference (loading and releasing VRAM layer by layer) to enable 70B large language models to run on GPUs with only 4GB VRAM, without quantization, distillation, or pruning. It already supports running Llama3.1 405B on 8GB VRAM.

@shenxiankk: Holy cow! These geeks are squeezing godlike performance out of a CPU! No dedicated GPU needed — they're running a 284B large model purely on 64GB of RAM! An insane open-source bombshell just dropped in the LLM community: synchopate/llama-modchip. Back in the day, running 284 billion parameters…

X AI KOLs Following

The open-source project synchopate/llama-modchip released v2.5.5, enabling a 284B large model (such as DeepSeek-V4) to run on a pure CPU with just 64GB of RAM — no dedicated GPU required — via custom quantization and SIMD optimizations, along with a Web UI and Claude Code backend support.

@vintcessun: Pretraining can be this cost-effective? Train a usable 1B base model from scratch for ~$1000, slashing compute and data by hundreds of times. The key isn't brute-force compute, but hierarchical recursive architecture plus latent space reasoning, combined with PrefixLM packing and FA3 to maximize efficiency. Sounds insane, but the paper and code are open-sourced.

X AI KOLs Timeline

HRM-Text released a 1B-parameter base model, claiming it can be pretrained from scratch for only ~$1000, reducing compute and data volume by hundreds of times. It employs efficient techniques such as hierarchical recursive architecture, latent space reasoning, and PrefixLM packing. The paper and code are open-sourced.

Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B

Reddit r/LocalLLaMA

Precision Numerics 发布 Boole-1.7B,一个基于 Qwen3-1.7B 的 1-bit 量化模型,权重仅 247 MB(比 BF16 小 13.9 倍),在 10 项任务评测中达到 BF16 模型 85.9% 的平均分,超越 1-bit 的 Bonsai-1.7B 并接近 1.58-bit 的 Bonsai-1.7B。模型支持浏览器本地运行、vLLM 与 llama.cpp。

@sitinme: A 26M parameter model can do Function Call, and is even stronger than Qwen-0.6B? This team's out-of-the-box approach is too wild! Nowadays, large models have ever-growing parameter counts, but one question has never been seriously considered: does calling a tool really need hundreds of billions of parameters? Think about it, when you say 'Check today's...'

X AI KOLs Timeline

The Cactus team distilled Gemini 3.1 into a specialized model called Needle with only 26M parameters, specifically for Function Call. Its performance surpasses Qwen-0.6B, demonstrating the potential of small models in tool calling scenarios.