Skip to main content

Gemini 2.5 Flash, raw

GSS · Raw LLM · default settings · 75 questions

raw--gemini-2.5-flash--tdefault--tplcurrent--2d09bedc

Metadata

Raw LLM · 2 replicates · 75 questions
Method
Raw LLM
Base provider
google
Model
gemini-2.5-flash
Dataset
GSS
Temperature
default
Reasoning effort
default
Template
current
Samples / question
30
Questions
75
First replicate
2026-07-15 17:58 UTC
Last replicate
2026-10-13 11:57 UTC

Aggregated metrics

Mean across replicates, ± sample standard deviation (shown only with 2+ replicates). SynthBench Index: 0 = random answers, 100 = real people. SPS is the raw 0 to 1 score it is computed from. Index = 100 × (SPS − SPS of random answers) ÷ (human ceiling − SPS of random answers), on this config's dataset. The leaderboard averages it over the core datasets.

Index
0 = random answers, 100 = real people
21
± 0.0
SPS
SPS, 0 to 1
0.789
± 0.000
Distribution gap
mean JSD, lower is better
0.304
± 0.005
Rank agreement
Kendall τ, −1 to 1
0.401
± 0.010

Variance summary

Replicates
2
Std dev
0.0 Index points (SPS 0.000)
Range
Index 20 to 21 (SPS 0.789–0.789)
Coefficient of variation (SPS)
0.0001

Per-topic breakdown

Index per topic (mean across replicates; 0 = random answers, 100 = real people). All seven topics are shown; topics this config's questions don't cover are marked "no questions".

Show data table

Loading data…

Replicates (2)

Run Timestamp Index SPS JSD Kendall τ N
gss_openrouter_google_gemini-2.5-flash_20260715_175807 2026-07-15 17:58 UTC 20 0.789 0.301 0.394 75
gss_openrouter_google_gemini-2.5-flash_20261013_115716 2026-10-13 11:57 UTC 21 0.789 0.308 0.408 75