Ling 3.0 (on Nous)

Reddit r/AI_Agents Models

Summary

This article discusses user-reported issues with the Ling 3.0 AI model from Nous, focusing on problems with text output and context length limitations, potentially linked to quantization or rate limits.

Ling 3.0 is great some of the time. The rest of the time it has problems outputting text. It literally tells itself to "say X" in thinking but then doesn't. This seems to start sometimes at 55k context which isn't much. I'm not sure if Nous is using the full model or the 1.3 bit quant model. I don't know if rate-limits are a partial cause.
Original Article

Similar Articles

ling 3.0 flash/tiny base models

Reddit r/LocalLLaMA

InclusionAI has open-sourced the Ling-3.0 series, featuring highly efficient language models with sparse MoE architecture and hybrid linear attention, providing checkpoints at various training stages to support research and innovation.

Ling Tiny 3.0 is a glimpse of the future

Reddit r/LocalLLaMA

The author runs the Ling Tiny 3.0 AI model on a 2017 laptop without GPU, achieving 10 tokens per second and completing tasks like code generation, showcasing the potential for edge intelligence on existing hardware.