Triton

NVIDIA Triton: Multi-Framework AI Model Inference Server

Training machine learning models has become accessible to a broad audience of developers and organizations. Serving those models in production —...