MiniCPM-o: Open-Source Multimodal LLM for Vision, Speech, and Text

Fri, 01 May 2026 00:00:00 +0000

Multimodal AI models that can simultaneously process vision, speech, and text represent the cutting edge of artificial intelligence. OpenAI’s GPT-4o demonstrated the potential of this approach, but its closed nature has left the open-source community racing to catch up. MiniCPM-o, developed by OpenBMB (offshoot of Tsinghua University’s NLP lab), has achieved a remarkable milestone: it outperforms GPT-4o on single-image understanding benchmarks while matching or exceeding it on speech tasks – all in an open-source package.

The project at github.com/OpenBMB/MiniCPM-o represents a series of multimodal LLMs that extend the MiniCPM family’s impressive performance-to-size ratio into the multimodal domain. MiniCPM-o supports full-duplex voice interaction – meaning it can listen and speak simultaneously, like a natural conversation – along with image understanding, optical character recognition, and multi-turn dialogue capabilities.

VoxCPM2: OpenBMB's Tokenizer-Free TTS for Multilingual Speech Generation

Fri, 01 May 2026 00:00:00 +0000

VoxCPM2 is a tokenizer-free text-to-speech (TTS) model developed by OpenBMB, an open-source AI research community affiliated with Tsinghua University and the Beijing Academy of Artificial Intelligence (BAAI). With 2 billion parameters, VoxCPM2 represents a paradigm shift in speech synthesis by operating directly on continuous speech representations, eliminating the need for discrete audio tokenizers that typically degrade voice quality.

The model supports over 30 languages with capabilities spanning zero-shot voice cloning, voice design (creating entirely new voices from text descriptions), and real-time streaming inference. VoxCPM2 has quickly become one of the most talked-about open-source TTS models of 2026, competing directly with commercial offerings like ElevenLabs and OpenAI’s TTS while remaining freely available under the Apache 2.0 license.

OpenBMB on SoloSoft

MiniCPM-o: Open-Source Multimodal LLM for Vision, Speech, and Text

VoxCPM2: OpenBMB's Tokenizer-Free TTS for Multilingual Speech Generation