Tag
A 12-billion-parameter multimodal model has been released as open source. It features a unified Transformer architecture and requires only 16GB of RAM to run. It performs exceptionally well across multiple benchmarks, supports a 256K context window, and works with over 140 languages.