Skip to content

Commit 7c51f12

Browse files
committed
Publish provider benchmark results: 1k to 1M scales
- results-gemini-1m: Amazon Polarity 1M/7k, provider gemini 3.7-flash with live 20-row sampled audit (8.98/10) and 20/20 classification; recovery +0.065, clean delta +0.000 - results-openai-25k/50k/100k: AG News ladder (+0.038/+0.028/+0.028) and imdb +0.109 at 25k, provider openai gpt-5.6-sol config, local stages - results-claude/results-openai: 1k baselines for the scale comparison
1 parent 74f3957 commit 7c51f12

12 files changed

Lines changed: 3937 additions & 0 deletions

File tree

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
# Claude benchmark (Anthropic)
2+
3+
Provider: `anthropic` | Model: `claude-sonnet-5` | Base URL: `-` | Seeds: [17, 29] | Epochs: 2 |
4+
Audit rows: 0 | Classify sample: 20
5+
6+
## Recovery (Claude-audited dirty_optimized vs dirty_raw)
7+
8+
| Dataset | Classes | Dirty raw | Dirty optimized | Recovery | Clean delta |
9+
|---|---|---:|---:|---:|---:|
10+
| ag_news | 4 | 0.6590 | 0.6180 | -0.0410 | +0.0000 |
11+
| imdb | 2 | 0.5920 | 0.6850 | +0.0930 | +0.0000 |
12+
13+
## Claude usage per dataset
14+
15+
| Dataset | Audit tokens (in/out/total) | Audit score | Classify tokens |
16+
|---|---|---|---|
17+
| ag_news | 0/0/0 | None | 0 |
18+
| imdb | 0/0/0 | None | 0 |

0 commit comments

Comments
 (0)