Decision Model

Semantic Classifier which could be also used as generalized

VLA

Will be an agent's tool and perfect for fixed workflow with some flexibility

How To Use Decision Models for Evals – Hamel’s Blog

How to choose a decision model for your task, tune its threshold, and interpret its scores.

https://hamel.dev/blog/posts/decision-model-evals/

Decision Index 0.2.1

Open reproductions of Jev, scored head-to-head on the frozen suite. One index, five categories, every model.

https://multimodalart-jev-decision-index.static.hf.space/index.html

JevBench by Benchmark Heaven — Jev-class model benchmark

Compare Jev-class decision models across intelligence, calibration, speed, and cost with JevBench.

https://benchmarkheaven.com/jev-models

Jev as a judge

DeepEval - The LLM Evaluation Framework

DeepEval is the open-source LLM evaluation framework for testing and benchmarking LLM applications.

https://deepeval.com/docs/metrics-jev-eval