Built with Open reimplementations

StartLux-Prism

Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.

236 ★ on GitHub

What it is

Fast, exact inference for StartLux-Decision models on NVIDIA GPUs. StartLux-Prism serves StartLux-Decision v1 and v1.1 AutoThink (4B, 9B, 27B) straight from their released GGUF files, behind the TypeSafe /v1/systemone API, on GPUs from Ampere to Blackwell, one or several. Like a prism that splits light into its…

The homepage listed on the repository, huggingface.co, puts it like this: Org profile for StartLux on Hugging Face, the AI community building the future.

What the README says it does

  • Faster than the official engine. Serving the 27B on one H200, StartLux-Prism answers a short question 2.8× and a
  • The official engine's accuracy. Prompts, read-outs, thoughts and decision rules are the model's own; only the
  • Reproducible to the bit. int8 GEMMs sum exactly in int32, so a request receives the same probabilities whatever
  • All of v1.1. AutoThink thoughts are decoded on the GPU (95 tokens/s for one sequence, 3,832 for 64 at once);
  • The released files as they are. Q80 files run as int8 (W8A8) and Q4KM files on their own 4-bit weights

From the project’s README.

Where the decision sits

StartLux-Prism calls the hosted decision API rather than running its own weights. That keeps the project small and means its behaviour moves whenever the vendor ships a new model version. It also means an API key and a network round trip sit in the path of every decision.

Models it references: Jev, JevK5.

How active it is

Created 2026-10-13, last pushed 2026-10-27, 236 stars and 5 forks when we read it on 2026-11-02. Everything in this category is weeks old at most, so a stale push date means something different here than it would on a mature project. Check the repository before you depend on it.

Find out what your data actually supports

We turn your historical decisions into a frozen test set, then tell you which model, which threshold, and how much of it you can safely automate.