Tag
OpenMythos is an open-source project that theoretically reproduces the Claude Mythos architecture, fully implementing the Recurrent-Depth Transformer (RDT), supporting MLA/GQA attention mechanisms and sparse MoE, providing preset configurations from 1B to 1T parameters, and is installable via pip.
22-year-old developer Kye Gomez reversed Anthropic's Claude Mythos black box architecture in just two days and open-sourced the OpenMythos project, using Recurrent-Depth Transformer and other techniques, achieving performance equivalent to a 1.3B model with 770M parameters.