Random answers
OpinionsQA · Baseline · default settings · 100 questions
baseline--random-baseline--tdefault--tplcurrent--081b93ef
Failed to load configuration data.
Aggregated metrics
Mean across replicates, ± sample standard deviation (shown only with 2+ replicates). SynthBench Index: 0 = random answers, 100 = real people. SPS is the raw 0 to 1 score it is computed from. Index = 100 × (SPS − SPS of random answers) ÷ (human ceiling − SPS of random answers), on this config's dataset. The leaderboard averages it over the core datasets.
Index
0 = random answers, 100 = real people
-18
± 5.1
SPS
SPS, 0 to 1
0.721
± 0.012
Distribution gap
mean JSD, lower is better
0.328
± 0.027
Rank agreement
Kendall τ, −1 to 1
0.001
± 0.025
Variance summary
- Replicates
- 4
- Std dev
- 5.1 Index points (SPS 0.012)
- Range
- Index -25 to -13 (SPS 0.704–0.731)
- Coefficient of variation (SPS)
- 0.0168
Per-topic breakdown
Index per topic (mean across replicates; 0 = random answers, 100 = real people). All seven topics are shown; topics this config's questions don't cover are marked "no questions".
Show data table
Loading data…
Replicates (4)
| Run | Timestamp | Index | SPS | JSD | Kendall τ | N |
|---|---|---|---|---|---|---|
| opinionsqa_random-baseline_20260410_202340 | 2026-04-10 20:23 UTC | -13 | 0.731 | 0.316 | 0.030 | 100 |
| opinionsqa_random-baseline_20260410_205928 | 2026-04-10 20:59 UTC | -15 | 0.728 | 0.310 | 0.013 | 175 |
| opinionsqa_random-baseline_20260410_205938 | 2026-04-10 20:59 UTC | -25 | 0.704 | 0.367 | -0.023 | 80 |
| opinionsqa_random-baseline_20260410_205947 | 2026-04-10 20:59 UTC | -17 | 0.721 | 0.318 | -0.016 | 429 |