Claude Sonnet 4, raw
OpinionsQA · Raw LLM · default settings · 200 questions
raw--claude-sonnet-4--tdefault--tplcurrent--87742c98
Failed to load configuration data.
Aggregated metrics
Mean across replicates, ± sample standard deviation (shown only with 2+ replicates). SynthBench Index: 0 = random answers, 100 = real people. SPS is the raw 0 to 1 score it is computed from. Index = 100 × (SPS − SPS of random answers) ÷ (human ceiling − SPS of random answers), on this config's dataset. The leaderboard averages it over the core datasets.
Index
0 = random answers, 100 = real people
2
single replicate
SPS
SPS, 0 to 1
0.768
single replicate
Distribution gap
mean JSD, lower is better
0.373
single replicate
Rank agreement
Kendall τ, −1 to 1
0.366
single replicate
Variance summary
- Replicates
- 1
- Std dev
- —
- Range
- —
- Coefficient of variation (SPS)
- —
Per-topic breakdown
Index per topic (mean across replicates; 0 = random answers, 100 = real people). All seven topics are shown; topics this config's questions don't cover are marked "no questions".
Show data table
Loading data…
Replicates (1)
| Run | Timestamp | Index | SPS | JSD | Kendall τ | N |
|---|---|---|---|---|---|---|
| opinionsqa_openrouter_anthropic_claude-sonnet-4_20260410_234922 | 2026-04-10 23:49 UTC | 2 | 0.768 | 0.373 | 0.366 | 200 |