kvcache-ai/ktransformers - 17k Stars

Global Rank#2542Apr 16, 2026

since Jul 2024

kvcache-ai/ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

PythonApache-2.0

17k

1.3k

109

Weekly

3stars

·

5pushes

Stars

Contributors

New Stars

New Pushes

Forks

star-history.com

Share

GitHub README

<p align="center">
 <a href="https://www.star-history.com/kvcache-ai/ktransformers">
  <picture>
   <source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/badge?repo=kvcache-ai/ktransformers&theme=dark" />
   <source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/badge?repo=kvcache-ai/ktransformers" />
   <img alt="Star History Rank" src="https://api.star-history.com/badge?repo=kvcache-ai/ktransformers" />
  </picture>
 </a>
</p>

Markdown (Light)

[![Star History Rank](https://api.star-history.com/badge?repo=kvcache-ai/ktransformers)](https://www.star-history.com/kvcache-ai/ktransformers)

Markdown (Dark)

[![Star History Rank](https://api.star-history.com/badge?repo=kvcache-ai/ktransformers&theme=dark)](https://www.star-history.com/kvcache-ai/ktransformers)

HTML (Light)

<p align="center">
 <a href="https://www.star-history.com/kvcache-ai/ktransformers"><img src="https://api.star-history.com/badge?repo=kvcache-ai/ktransformers" alt="Star History Rank" /></a>
</p>

HTML (Dark)

<p align="center">
 <a href="https://www.star-history.com/kvcache-ai/ktransformers"><img src="https://api.star-history.com/badge?repo=kvcache-ai/ktransformers&theme=dark" alt="Star History Rank" /></a>
</p>

kvcache-ai/ktransformers - 17k Stars · Global Rank #2542