GPT-4o mini, raw
OpinionsQA · Raw LLM · default settings · 5 questions
raw--gpt-4o-mini--tdefault--tplcurrent--596e1ac2
Failed to load configuration data.
Aggregated metrics
Mean across replicates, ± sample standard deviation (shown only with 2+ replicates). SynthBench Index: 0 = random answers, 100 = real people. SPS is the raw 0 to 1 score it is computed from. Index = 100 × (SPS − SPS of random answers) ÷ (human ceiling − SPS of random answers), on this config's dataset. The leaderboard averages it over the core datasets.
Index
0 = random answers, 100 = real people
18
± 21.9
SPS
SPS, 0 to 1
0.805
± 0.052
Distribution gap
mean JSD, lower is better
0.287
± 0.008
Rank agreement
Kendall τ, −1 to 1
0.549
± 0.052
Variance summary
- Replicates
- 4
- Std dev
- 21.9 Index points (SPS 0.052)
- Range
- Index -14 to 34 (SPS 0.729–0.843)
- Coefficient of variation (SPS)
- 0.0642
Per-topic breakdown
Index per topic (mean across replicates; 0 = random answers, 100 = real people). All seven topics are shown; topics this config's questions don't cover are marked "no questions".
Show data table
Loading data…
Replicates (4)
| Run | Timestamp | Index | SPS | JSD | Kendall τ | N |
|---|---|---|---|---|---|---|
| opinionsqa_openrouter_openai_gpt-4o-mini_20260410_181811 | 2026-04-10 18:18 UTC | -14 | 0.729 | 0.296 | 0.508 | 50 |
| opinionsqa_openrouter_openai_gpt-4o-mini_20260410_200751 | 2026-04-10 20:07 UTC | 34 | 0.843 | 0.280 | 0.625 | 5 |
| opinionsqa_openrouter_openai_gpt-4o-mini_20260410_210410 | 2026-04-10 21:04 UTC | 27 | 0.828 | 0.280 | 0.535 | 30 |
| opinionsqa_openrouter_openai_gpt-4o-mini_20260410_210433 | 2026-04-10 21:04 UTC | 25 | 0.823 | 0.291 | 0.528 | 30 |