On-Fly-Jev
On-Fly-Jev, an open-weight model published to return typed decisions.
Community card
What this is
On-Fly-Jev is a typed-decision model: given a document and a closed set of options, it returns one of those options with a probability across the whole set rather than free text.
Its card lists training data: LocalLLaMA/typed-decisions, ZefanCai/Open-Jev, openai/gsm8k. That matters when you read any benchmark number about it, because a model tuned on a benchmark's own training split has an advantage over one that has never seen it.
A public number is a shortlist, not a decision
The only benchmark that settles which model you ship is one built from your own historical decisions. We freeze that test set, run the candidates against it, and hand back the threshold your error budget supports.