Skip to main content
Conformance run pending. This version becomes active, and GET /engines lists it, once it passes the conformance suite.
Use this version with "engine": {"name": "jev", "version": "current"}. current runs whichever Jev version the provider serves. Every answer records the epoch of model behaviour that produced it; a new epoch begins only when we detect a change, and then we re-check quality against the conformance suite.

Limits

Judging on this version is billed in judgment units, the same as on every engine.

Data handling

Conformance

No conformance run is recorded for this version yet. Every version passes the same suite before it becomes active: 500 human-labelled items per type from a fixed golden set that no engine is tuned to. This page shows the results, with the date and the golden set version, once the run exists.