llama.cpp: High-Performance LLM Inference on CPU and GPU
The dream of running powerful language models entirely on your own hardware, without sending data to cloud APIs, was once considered impractical …
Post
Blog
In-depth guides on AI tools, software engineering, developer productivity, and open-source systems — written for people who ship.
LLaMA-VID: An Image is Worth 2 Tokens -- Efficient Long Video Understanding with LLMs
LLaMA-VID (Large Language and Video Assistant) is an ECCV 2024 research project that tackles the fundamental bottleneck in video understanding …
Live Wallpaper for macOS: Dynamic Desktop Backgrounds
One of the few desktop features that macOS users envy from Windows and Linux is live wallpaper support. Live Wallpaper for macOS, created by …
LiteLLM: The Open-Source AI Gateway for 100+ LLM Providers
The rapid proliferation of large language model (LLM) providers has created a new challenge for developers: each provider has its own API format, …
Linly-Talker: Open-Source Digital Avatar Conversational System
The concept of a digital avatar that can hold a natural conversation — seeing your face, hearing your voice, and responding with synchronized lip …
LingBot-Map: Ant Group's Open-Source 3D Foundation Model for Real-Time Scene Reconstruction
3D scene reconstruction has long been a foundational challenge in computer vision. Traditional approaches rely on expensive LiDAR hardware, …