KTransformers: Flexible LLM Inference with Advanced Kernel Optimization
The efficiency of LLM inference directly determines the cost, latency, and scalability of AI applications. KTransformers …
Categories
AI
InternVL: Open-Source Vision Language Model Family Scaling to 241B Parameters
InternVL is a series of open-source vision-language foundation models developed by OpenGVLab at the Shanghai Artificial Intelligence Laboratory. …
Intangible AI: The AI-Native 3D Spatial Intelligence Platform for Creative Professionals
The 3D creative landscape is undergoing a fundamental transformation. For decades, building 3D scenes required mastering complex software, …
ik_llama.cpp: Fork of llama.cpp with IQ4_NL and Advanced Quantization
The ecosystem around llama.cpp has produced numerous forks, each exploring different optimization strategies for running LLMs efficiently on …
Hugging Face Transformers: The Universal Library for Pretrained Models
The transformer architecture has become the universal building block of modern AI, powering everything from language understanding to image …
HippoRAG: Neurobiologically Inspired Long-Term Memory for LLMs (NeurIPS 2024)
Retrieval-Augmented Generation (RAG) has become the standard approach for grounding LLM outputs in external knowledge. But standard RAG has a …