Ling 3.0 (on Nous)
Summary
This article discusses user-reported issues with the Ling 3.0 AI model from Nous, focusing on problems with text output and context length limitations, potentially linked to quantization or rate limits.
Similar Articles
@NousResearch: Ling-3.0-flash, the new MoE model from @AntLingAGI, is now free in Nous Portal for the next week! At 124B parameters an…
AntLingAGI releases Ling-3.0-flash, a 124B-parameter MoE model with 5.1B active parameters, now free for a week on Nous Portal. It matches or beats their 1T flagship on many benchmarks, designed for agent workloads like coding and tool use.
Ling-3.0-tiny is a very interesting model. Run on NVIDIA Orin Nano Super 8GB at 128K context with IQ4_NL quant.
The article demonstrates running the Ling-3.0-tiny AI model on an NVIDIA Orin Nano Super 8GB device with IQ4_NL quantization, achieving 33 tok/s decode speed and full 128K context, showcasing practical edge AI deployment.
ling 3.0 flash/tiny base models
InclusionAI has open-sourced the Ling-3.0 series, featuring highly efficient language models with sparse MoE architecture and hybrid linear attention, providing checkpoints at various training stages to support research and innovation.
Ling-3.1-flash is getting a 1019 update, with open weights to follow
Ant Ling announced a 1019 update for its Ling-3.1-flash model, boosting its Artificial Analysis Intelligence Index score from 41 to 44 and improving agent benchmark results, with API access and open weights promised but no release date given.
Ling Tiny 3.0 is a glimpse of the future
The author runs the Ling Tiny 3.0 AI model on a 2017 laptop without GPU, achieving 10 tokens per second and completing tasks like code generation, showcasing the potential for edge intelligence on existing hardware.