Majority answer
OpinionsQA · Baseline · default settings · 80 questions
baseline--majority-baseline--tdefault--tplcurrent--14e269c1
Failed to load configuration data.
Aggregated metrics
Mean across replicates, ± sample standard deviation (shown only with 2+ replicates). SynthBench Index: 0 = random answers, 100 = real people. SPS is the raw 0 to 1 score it is computed from. Index = 100 × (SPS − SPS of random answers) ÷ (human ceiling − SPS of random answers), on this config's dataset. The leaderboard averages it over the core datasets.
Index
0 = random answers, 100 = real people
-41
± 28.8
SPS
SPS, 0 to 1
0.666
± 0.068
Distribution gap
mean JSD, lower is better
0.508
± 0.026
Rank agreement
Kendall τ, −1 to 1
0.207
± 0.060
Variance summary
- Replicates
- 5
- Std dev
- 28.8 Index points (SPS 0.068)
- Range
- Index -91 to -20 (SPS 0.548–0.714)
- Coefficient of variation (SPS)
- 0.1024
Per-topic breakdown
Index per topic (mean across replicates; 0 = random answers, 100 = real people). All seven topics are shown; topics this config's questions don't cover are marked "no questions".
Show data table
Loading data…
Replicates (5)
| Run | Timestamp | Index | SPS | JSD | Kendall τ | N |
|---|---|---|---|---|---|---|
| opinionsqa_majority-baseline_20260410_160644 | 2026-04-10 16:06 UTC | -91 | 0.548 | 0.505 | 0.204 | 200 |
| opinionsqa_majority-baseline_20260410_202349 | 2026-04-10 20:23 UTC | -39 | 0.670 | 0.550 | 0.128 | 100 |
| opinionsqa_majority-baseline_20260410_205936 | 2026-04-10 20:59 UTC | -32 | 0.687 | 0.514 | 0.175 | 175 |
| opinionsqa_majority-baseline_20260410_205943 | 2026-04-10 20:59 UTC | -20 | 0.714 | 0.488 | 0.281 | 80 |
| opinionsqa_majority-baseline_20260410_210005 | 2026-04-10 21:00 UTC | -22 | 0.710 | 0.484 | 0.246 | 429 |