OmniParse: Open-Source Universal Data Parsing for GenAI Pipelines
Modern GenAI applications consume data in many forms – PDFs, spreadsheets, images, audio recordings, and video files. Building a RAG …
Tags
Multimodal
OmniGen2: Advanced Open-Source Multimodal Generation Model
The image generation landscape has become increasingly fragmented. Different models handle text-to-image generation, image editing, and style …
MLX-VLM: Vision Language Model Inference and Fine-Tuning on Apple Silicon
Running Vision Language Models – AI systems that can simultaneously understand images and text – has traditionally required expensive …
MiniCPM-o: Open-Source Multimodal LLM for Vision, Speech, and Text
Multimodal AI models that can simultaneously process vision, speech, and text represent the cutting edge of artificial intelligence. …
LLaMA-VID: An Image is Worth 2 Tokens -- Efficient Long Video Understanding with LLMs
LLaMA-VID (Large Language and Video Assistant) is an ECCV 2024 research project that tackles the fundamental bottleneck in video understanding …
LAVIS: Salesforce's Library for Vision-Language AI
Vision-language AI – models that understand both images and text – is one of the most rapidly advancing areas of artificial …