Skip to main content

Random answers

OpinionsQA · Baseline · default settings · 100 questions

baseline--random-baseline--tdefault--tplcurrent--59eceb37

Metadata

Baseline · 5 replicates · 100 questions
Method
Baseline
Base provider
—
Model
random-baseline
Dataset
OpinionsQA
Temperature
default
Reasoning effort
default
Template
current
Samples / question
30
Questions
100
First replicate
2026-04-10 16:06 UTC
Last replicate
2026-04-10 20:59 UTC

Aggregated metrics

Mean across replicates, ± sample standard deviation (shown only with 2+ replicates). SynthBench Index: 0 = random answers, 100 = real people. SPS is the raw 0 to 1 score it is computed from. Index = 100 × (SPS − SPS of random answers) ÷ (human ceiling − SPS of random answers), on this config's dataset. The leaderboard averages it over the core datasets.

Index
0 = random answers, 100 = real people
-14
± 22.0
SPS
SPS, 0 to 1
0.730
± 0.052
Distribution gap
mean JSD, lower is better
0.204
± 0.007
Rank agreement
Kendall τ, −1 to 1
-0.051
± 0.036

Variance summary

Replicates
5
Std dev
22.0 Index points (SPS 0.052)
Range
Index -53 to -2 (SPS 0.638–0.757)
Coefficient of variation (SPS)
0.0712

Per-topic breakdown

Index per topic (mean across replicates; 0 = random answers, 100 = real people). All seven topics are shown; topics this config's questions don't cover are marked "no questions".

Show data table

Loading data…

Replicates (5)

Run Timestamp Index SPS JSD Kendall τ N
opinionsqa_random-baseline_20260410_160643 2026-04-10 16:06 UTC -53 0.638 0.200 -0.048 200
opinionsqa_random-baseline_20260410_202348 2026-04-10 20:23 UTC -2 0.757 0.213 -0.018 100
opinionsqa_random-baseline_20260410_205934 2026-04-10 20:59 UTC -8 0.744 0.199 -0.112 175
opinionsqa_random-baseline_20260410_205942 2026-04-10 20:59 UTC -3 0.755 0.209 -0.031 80
opinionsqa_random-baseline_20260410_205959 2026-04-10 20:59 UTC -3 0.757 0.196 -0.047 429