What it is
Fast structured decisions on Linux and Apple Silicon
Getting started
From the README:
uv pip install '.[cuda]'Where the decision sits
vllm-jev calls the hosted decision API rather than running its own weights. That keeps the project small and means its behaviour moves whenever the vendor ships a new model version. It also means an API key and a network round trip sit in the path of every decision.
Models it references: Jev, laya-typed-decisions, decider-0.8b, decider-2b, JevK5, laya-multilingual, laya-typed-decisions, laya, Open-Jev-2B, Open-Jev-9B, Tiny-Jev.
How active it is
Created 2026-09-24, last pushed 2026-10-22, 919 stars and 26 forks when we read it on 2026-11-02. Everything in this category is weeks old at most, so a stale push date means something different here than it would on a mature project. Check the repository before you depend on it.
Find out what your data actually supports
We turn your historical decisions into a frozen test set, then tell you which model, which threshold, and how much of it you can safely automate.