Built with Open reimplementations
StartLux-Prism
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
236 ★ on GitHub
What it is
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs. StartLux-Prism serves StartLux-Decision v1 and v1.1 AutoThink (4B, 9B, 27B) straight from their released GGUF files, behind the TypeSafe /v1/systemone API, on GPUs from Ampere to Blackwell, one or several. Like a prism that splits light into its…
The homepage listed on the repository, huggingface.co, puts it like this: Org profile for StartLux on Hugging Face, the AI community building the future.
What the README says it does
- Faster than the official engine. Serving the 27B on one H200, StartLux-Prism answers a short question 2.8× and a
- The official engine's accuracy. Prompts, read-outs, thoughts and decision rules are the model's own; only the
- Reproducible to the bit. int8 GEMMs sum exactly in int32, so a request receives the same probabilities whatever
- All of v1.1. AutoThink thoughts are decoded on the GPU (95 tokens/s for one sequence, 3,832 for 64 at once);
- The released files as they are. Q80 files run as int8 (W8A8) and Q4KM files on their own 4-bit weights
From the project’s README.
Where the decision sits
StartLux-Prism calls the hosted decision API rather than running its own weights. That keeps the project small and means its behaviour moves whenever the vendor ships a new model version. It also means an API key and a network round trip sit in the path of every decision.
Models it references: Jev, JevK5.
How active it is
Created 2026-10-13, last pushed 2026-10-27, 236 stars and 5 forks when we read it on 2026-11-02. Everything in this category is weeks old at most, so a stale push date means something different here than it would on a mature project. Check the repository before you depend on it.
Find out what your data actually supports
We turn your historical decisions into a frozen test set, then tell you which model, which threshold, and how much of it you can safely automate.