Tag
Thinking Machines Lab releases Inkling, a 975B-parameter open-weights multimodal MoE model with 41B active parameters and a controllable thinking effort feature. It uses an encoder-free approach for multimodality and achieves state-of-the-art on several benchmarks.
PJ-RoPE unifies RoPE's Fourier phase, Jordan-RoPE's finite jets, and ALiBi's affine recency into a single learnable relative-position space, and studies task-driven selection of sectors.