← All 25 termsAI proof
Frozen spec
AIA pinned version of a model, prompt, and tool set used inside an eval. The spec is immutable for the duration of the eval so scores are reproducible.
Full definition
A frozen spec is the AI-equivalent of a fixed backtest universe. It pins: the model id and version, the system prompt, the tool schema, the temperature and seed, and the JSON-schema validators. Once frozen, no spec element may change for the duration of the eval. any change forces a new eval version. On this site, every published eval ships its frozen-spec manifest as a JSON sidecar so the scores can be reproduced by a third party.
Related terms
Each link opens the long-form definition of a closely related term.
See this term in action.
The /proof page maps every term to the gate or artifact that implements it on this site.