Built with Evals and benchmarks
jev-rag-benchmark
Reproducible benchmark for measuring Jev reranking quality, latency, and cost in RAG
20 ★ on GitHub
What it is
Reproducible, vendor-neutral experiments for measuring whether TypeSafe Jev improves a small RAG system. “Jev wins” is not an assumption: quality, latency, and cost can improve, stay flat, or get worse.
Where the decision sits
jev-rag-benchmark calls the hosted decision API rather than running its own weights. That keeps the project small and means its behaviour moves whenever the vendor ships a new model version. It also means an API key and a network round trip sit in the path of every decision.
Models it references: Jev.
How active it is
Created 2026-09-19, last pushed 2026-10-29, 20 stars and 0 forks when we read it on 2026-11-02. Everything in this category is weeks old at most, so a stale push date means something different here than it would on a mature project. Check the repository before you depend on it.
Find out what your data actually supports
We turn your historical decisions into a frozen test set, then tell you which model, which threshold, and how much of it you can safely automate.