Popular repositories Loading

1. server server Public

   Forked from triton-inference-server/server

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python

2. tensorrtllm_backend tensorrtllm_backend Public

   Forked from triton-inference-server/tensorrtllm_backend

   The Triton TensorRT-LLM Backend

   Python

3. inference inference Public

   Forked from mlcommons/inference

   Reference implementations of MLPerf™ inference benchmarks

   Python 2

4. mitten mitten Public

   Forked from NVIDIA/mitten

   Mitten is NVIDIA's framework for our MLPerf Inference code submissions.

   Python

5. inference_results_v4.1 inference_results_v4.1 Public

   Forked from GATEOverflow/inference_results_v4.1

   This repository contains the results and code for the MLPerf™ Inference v4.1 benchmark.

   Python 1

6. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

   Python