We released a 203M-parameter Portuguese language model — real local CPU demo and public weights

Reddit r/artificial Models

Summary

WAR Enterprise released WARMIND-200M V2, a 203M-parameter Portuguese-first causal language model with public weights and local CPU inference, intended as a research checkpoint to validate their full training pipeline.

Hi r/artificial, We recently released WARMIND-200M V2, an experimental Portuguese-first causal language model developed by WAR Enterprise in Brazil. The attached video shows the model running locally on CPU. The waiting periods were shortened, but the prompts and outputs were not altered. We intentionally kept imperfect responses visible because this is a research checkpoint, not a production assistant. Main specifications: - 203,263,872 parameters - approximately 1 billion pretraining tokens - 23.7 million supervised SFT tokens - 20 Transformer layers - Grouped-Query Attention - SwiGLU, RMSNorm and RoPE - 1,024-token operational context - local CPU inference - Apache 2.0 license The primary goal of this version was to validate the complete pipeline: dataset preparation, tokenizer training, pretraining, supervised fine-tuning, packaging and local inference. Because the training-token budget was relatively small for a 203M-parameter model, it can still hallucinate, repeat information, make factual mistakes and produce incomplete answers. The weights and full documentation are publicly available: https://huggingface.co/warenterprise/WARMIND-200M-V2 We are now studying the next generation, potentially around 500M parameters, with a substantially larger training corpus and integration with external tools. The final architecture and release schedule have not yet been defined. What would you prioritize for the next version: better data quality, more training tokens, a larger architecture or stronger tool integration?
Original Article

Similar Articles

LLaDA2.X (GitHub Repo)

TLDR AI

Ant Group releases LLaDA2.X series of diffusion language models, scaling to 100B parameters with MoE architecture, open-sourcing weights and training code.

WARP: Weight-Space Analysis for Recovering Training Data Portfolios

arXiv cs.LG

WARP is a framework that recovers the domain mixture weights of a fine-tuned model from its released weights by generating pseudo-checkpoints via model merging and extracting geometric features. It achieves low mean absolute error on BERT and GPT-2, outperforming membership inference.