Issues

• Refine and regression-test the unified benchmark prompt

  CodingThrust/problem-reductions-benchmark#74 · Filter by author isPANN opened on Jul 20, 2026

• Cheaply-verifiable rule for a buggy reduction, generalized to optimization (no solving)

  enhancement
  CodingThrust/problem-reductions-benchmark#15 · Filter by author GiggleLiu opened on Jun 17, 2026
  3

• Easier ways to identify a buggy rule

  CodingThrust/problem-reductions-benchmark#14 · Filter by author isPANN opened on Jun 17, 2026

• 📖 Read me first — benchmark overview & glossary

  CodingThrust/problem-reductions-benchmark#9 · Filter by author GiggleLiu opened on Jun 10, 2026

• M3.2 — CI: rebuild the index and publish the site, schema-gated

  CodingThrust/problem-reductions-benchmark#7 · Filter by author GiggleLiu opened on Jun 10, 2026 · M3: Public website
  1

• M3.1 — Build the public leaderboard: dual metrics + certificate drilldown + trajectory

  CodingThrust/problem-reductions-benchmark#6 · Filter by author GiggleLiu opened on Jun 10, 2026 · M3: Public website
  1

• M2.2 — Harden the verifier (robust equality) and add the novelty filter

  CodingThrust/problem-reductions-benchmark#5 · Filter by author GiggleLiu opened on Jun 10, 2026 · M2: Fair multi-model + trustworthy judgment
  1

• M2.1 — Build fair multi-model orchestration (scheduler + pluggable runner + budget)

  CodingThrust/problem-reductions-benchmark#4 · Filter by author GiggleLiu opened on Jun 10, 2026 · M2: Fair multi-model + trustworthy judgment
  1

• M1.3 — Emit schema-valid results and render certificates on the live leaderboard

  CodingThrust/problem-reductions-benchmark#3 · Filter by author GiggleLiu opened on Jun 10, 2026 · M1: MVP
  1

• M1.2 — Build the bug-hunting session: explore → certify → verify, under budget

  CodingThrust/problem-reductions-benchmark#2 · Filter by author GiggleLiu opened on Jun 10, 2026 · M1: MVP
  1

• M1.1 — Build the pred environment & capability foundation (env + upstream-gap audit)

  CodingThrust/problem-reductions-benchmark#1 · Filter by author GiggleLiu opened on Jun 10, 2026 · M1: MVP
  2