Skip to content

Pull requests: apify/apify-evals

New pull request New
10 Open 0 Closed
10 Open 0 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat(codex): Codex harness backend
#11 opened Sep 16, 2026 by RobertCrupa • 5/5 Loading…
feat: scenarios as YAML, suite profiles, sync tool
#10 opened Sep 16, 2026 by RobertCrupa • 4/5 Loading…
feat(runner): workflow-runner core
#9 opened Sep 16, 2026 by RobertCrupa • 3/5 Loading…
feat(judge): judge Actor
#8 opened Sep 16, 2026 by RobertCrupa • 2/5 Loading…
feat: eval trace contract package t-ai Issues owned by the AI team. tested Temporary label used only programatically for some analytics.
#7 opened Sep 16, 2026 by RobertCrupa • 1/5 Loading…
@RobertCrupa
chore: schedule the daily online eval run and document its alerts
#5 opened Sep 9, 2026 by RobertCrupa • 5/5 Loading…
feat: write online scores idempotently and keep them past retention
#4 opened Sep 9, 2026 by RobertCrupa • 4/5 Loading…
feat: score sampled production turns against the online rubric
#3 opened Sep 9, 2026 by RobertCrupa • 3/5 Loading…
feat: online mode selects production traces for scoring
#2 opened Sep 8, 2026 by RobertCrupa • 2/5 Loading…
chore: define the online evals rubric and score configs
#1 opened Sep 8, 2026 by RobertCrupa • 1/5 Loading…
ProTip! Add no:assignee to see everything that’s not assigned.