Skip to main content

GPT-4o mini, raw

OpinionsQA · Raw LLM · default settings · 175 questions

raw--gpt-4o-mini--tdefault--tplcurrent--312df51d

Metadata

Raw LLM · 1 replicate · 175 questions
Method
Raw LLM
Base provider
openai
Model
gpt-4o-mini
Dataset
OpinionsQA
Temperature
default
Reasoning effort
default
Template
current
Samples / question
50
Questions
175
First replicate
2026-04-10 22:12 UTC
Last replicate
2026-04-10 22:12 UTC

Aggregated metrics

Mean across replicates, ± sample standard deviation (shown only with 2+ replicates). SynthBench Index: 0 = random answers, 100 = real people. SPS is the raw 0 to 1 score it is computed from. Index = 100 × (SPS − SPS of random answers) ÷ (human ceiling − SPS of random answers), on this config's dataset. The leaderboard averages it over the core datasets.

Index
0 = random answers, 100 = real people
20
single replicate
SPS
SPS, 0 to 1
0.811
single replicate
Distribution gap
mean JSD, lower is better
0.314
single replicate
Rank agreement
Kendall τ, −1 to 1
0.515
single replicate

Variance summary

Replicates
1
Std dev
—
Range
—
Coefficient of variation (SPS)
—

Per-topic breakdown

Index per topic (mean across replicates; 0 = random answers, 100 = real people). All seven topics are shown; topics this config's questions don't cover are marked "no questions".

Show data table

Loading data…

Replicates (1)

Run Timestamp Index SPS JSD Kendall τ N
opinionsqa_openrouter_openai_gpt-4o-mini_20260410_221224 2026-04-10 22:12 UTC 20 0.811 0.314 0.515 175