Deep Learning
Page 2 of 2
- AI
ColossalAI: Open-Source Large-Scale AI Training Framework
Training large AI models is fundamentally a distributed computing problem. A single 70B parameter model requires more memory than any GPU can...
- Open Source
ChatRWKV: The Open-Source 100% RNN Language Model Challenging Transformers
For years, the AI community operated under a widely accepted assumption: the transformer architecture, introduced in the landmark 'Attention Is All...
- AI
Causal-Conv1d: The CUDA-Optimized Kernel Powering Mamba State Space Models
The Transformer architecture has dominated deep learning for years, but a new challenger has emerged: state space models (SSMs). At the heart of one...
- AI
Neuro-Symbolic AI Cuts Energy Use by 100x
The AI industry has spent the past five years scaling its way to smarter models — adding parameters, burning more compute, and consuming electricity at a rate that has …