Deterministic runtime for agent evaluation
-
Updated
Mar 25, 2026 - Python
Deterministic runtime for agent evaluation
KayaDB distributed key-value storage engine
Local-first C# project for deterministic prompt versioning, A/B evaluation, and evidence-based promotion using structured scoring.
WordleBench — Deterministic AI Wordle benchmark. Compare 34+ LLMs (GPT-5, Claude 4.5, Gemini, Grok, Llama) head-to-head on accuracy, speed, and cost across 50 standardized words.
Deterministic scenarios and verification for real application interfaces.
MCP tools, Agent Skills, and a runtime bridge for building, playtesting, and debugging browser-native 2D games with Codex, Claude Code, and other coding agents.
Deterministic, zero-dependency static ITSM and ServiceNow Table API compatibility simulator.
A deterministic Python testbench for evaluating structured responses against declared JSON rules.
A Raft consensus library built from scratch in Rust, with a deterministic network simulator for testing leader election, log replication, and partition recovery.
Type-safe clock abstractions for Go with zero dependencies
GitHub Action for mcp-assert — deterministic MCP server testing in CI
The deterministic heap groomer for C/C++ memory debugging.
evals is a shared external contract suite, not the owner of project-local behavior
Agent reliability methodology for false-green testing of AI coding agents — claim, evidence, repeated trials, zero-LLM verdict.
Deterministic Rust testing utility for simulation and stochastic workflows
Deterministic, zero-dependency static Oracle Fusion Procurement REST simulator.
Deterministic clocks, timers, tickers, and time-testing primitives for Go.
Deterministic chaos testing for local-first and replicated applications.
Deterministic evaluations for Cortex Code (CoCo) skills using Inspect AI
Add a description, image, and links to the deterministic-testing topic page so that developers can more easily learn about it.
To associate your repository with the deterministic-testing topic, visit your repo's landing page and select "manage topics."