Repository
affifuddin-hazam/ghost-infer
Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
Stars
246
Today
+3
last 24 hours
This week
+93
Forks
16
Clone
git clone https://github.com/affifuddin-hazam/ghost-infer.gitStar growth
#cuda#desktop-app#gguf#llm#llm-inference#local-llm#mixture-of-experts#openai-compatible-api#rust#windows
- Created
- 2026-10-27
- Last commit
- 2026-11-14
- Gained since tracking
- +93
Similar in AI & agents
Updated Fri, 20 Nov 2026 07:21:13 GMT · description from the project itself