Skip to main content

Claude Sonnet 4, persona

OpinionsQA · Althing persona · default settings · 684 questions

synthpanel--claude-sonnet-4--tdefault--tplcurrent--8d1cda33

Metadata

Althing persona · 3 replicates · 684 questions
Method
Althing persona
Base provider
anthropic
Model
claude-sonnet-4
Dataset
OpinionsQA
Temperature
default
Reasoning effort
default
Template
current
Samples / question
30
Questions
684
First replicate
2026-04-11 22:47 UTC
Last replicate
2026-04-11 23:03 UTC

Aggregated metrics

Mean across replicates, ± sample standard deviation (shown only with 2+ replicates). SynthBench Index: 0 = random answers, 100 = real people. SPS is the raw 0 to 1 score it is computed from. Index = 100 × (SPS − SPS of random answers) ÷ (human ceiling − SPS of random answers), on this config's dataset. The leaderboard averages it over the core datasets.

Index
0 = random answers, 100 = real people
22
± 8.9
SPS
SPS, 0 to 1
0.815
± 0.021
Distribution gap
mean JSD, lower is better
0.254
± 0.035
Rank agreement
Kendall τ, −1 to 1
0.467
± 0.199

Variance summary

Replicates
3
Std dev
8.9 Index points (SPS 0.021)
Range
Index 12 to 28 (SPS 0.791–0.829)
Coefficient of variation (SPS)
0.0259

Per-topic breakdown

Index per topic (mean across replicates; 0 = random answers, 100 = real people). All seven topics are shown; topics this config's questions don't cover are marked "no questions".

Show data table

Loading data…

Replicates (3)

Run Timestamp Index SPS JSD Kendall τ N
opinionsqa_synthpanel_openrouter_anthropic_claude-sonnet-4_20260411_224714 2026-04-11 22:47 UTC 28 0.829 0.274 0.586 684
opinionsqa_synthpanel_openrouter_anthropic_claude-sonnet-4_20260411_225731 2026-04-11 22:57 UTC 27 0.826 0.275 0.578 684
opinionsqa_synthpanel_openrouter_anthropic_claude-sonnet-4_20260411_230326 2026-04-11 23:03 UTC 12 0.791 0.213 0.238 684