Quellcode durchsuchen

Add prima.cpp in LLM Inference

Li, Zonghang vor 1 Monat
Ursprung
Commit
b4a84e1581
1 geänderte Dateien mit 1 neuen und 0 gelöschten Zeilen
  1. 1 0
      README.md

+ 1 - 0
README.md

@@ -459,6 +459,7 @@
 - [Infinity](https://github.com/michaelfeil/infinity) - Inference for text-embeddings in Python
 - [LMDeploy](https://github.com/InternLM/lmdeploy) - A high-throughput and low-latency inference and serving framework for LLMs and VLs
 - [Liger-Kernel](https://github.com/linkedin/Liger-Kernel) - Efficient Triton Kernels for LLM Training.
+- [prima.cpp](https://github.com/Lizonghang/prima.cpp) - A distributed implementation of llama.cpp that lets you run 70B-level LLMs on your everyday devices.
 
 </details>