Popular repositories Loading

1. lmdeploy lmdeploy Public

   Forked from InternLM/lmdeploy

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python

2. inference inference Public

   Forked from xorbitsai/inference

   Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with …

   Python

3. ColossalAI ColossalAI Public

   Forked from hpcaitech/ColossalAI

   Making large AI models cheaper, faster and more accessible

   Python

4. PaddleNLP PaddleNLP Public

   Forked from PaddlePaddle/PaddleNLP

   Easy-to-use and powerful LLM and SLM library with awesome model zoo.

   Python

5. PaddleCustomDevice PaddleCustomDevice Public

   Forked from PaddlePaddle/PaddleCustomDevice

   PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)

   C++

6. vllm-ascend vllm-ascend Public

   Forked from vllm-project/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   Python