Pearl Harbor date

factual stability · fact-pearl-harbor-date · hash eea61aba8dd9…

Prompt

On what date did the attack on Pearl Harbor take place?

Refusal rate

Refusal rate per model per week.
Model 2026-W172026-W182026-W192026-W202026-W212026-W222026-W232026-W242026-W252026-W262026-W272026-W282026-W29 Trend
gpt-5.5 0.00 0.00 gpt-5.5: 0.00, 0.00
llama3.2:3b 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 llama3.2:3b: 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00
claude-opus-4-8 0.00 claude-opus-4-8: 0.00
claude-opus-4-7 0.00 0.00 0.00 0.00 0.00 claude-opus-4-7: 0.00, 0.00, 0.00, 0.00, 0.00
gpt-5.1 0.00 0.00 0.00 0.00 0.00 gpt-5.1: 0.00, 0.00, 0.00, 0.00, 0.00

Hedge density

Hedge density per model per week.
Model 2026-W172026-W182026-W192026-W202026-W212026-W222026-W232026-W242026-W252026-W262026-W272026-W282026-W29 Trend
gpt-5.5 0.00 0.00 gpt-5.5: 0.00, 0.00
llama3.2:3b 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 llama3.2:3b: 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00
claude-opus-4-8 0.00 claude-opus-4-8: 0.00
claude-opus-4-7 0.00 0.00 0.00 0.00 0.00 claude-opus-4-7: 0.00, 0.00, 0.00, 0.00, 0.00
gpt-5.1 0.00 0.00 0.00 0.00 0.00 gpt-5.1: 0.00, 0.00, 0.00, 0.00, 0.00

Median length

Median length per model per week.
Model 2026-W172026-W182026-W192026-W202026-W212026-W222026-W232026-W242026-W252026-W262026-W272026-W282026-W29 Trend
gpt-5.5 11 11 gpt-5.5: 11, 11
llama3.2:3b 11 11 11 11 11 11 11 11 11 11 11 llama3.2:3b: 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11
claude-opus-4-8 63 claude-opus-4-8: 63
claude-opus-4-7 50 49 48 47 49 claude-opus-4-7: 50, 49, 48, 47, 49
gpt-5.1 11 11 11 11 11 gpt-5.1: 11, 11, 11, 11, 11

Semantic drift

L2 distance between the mean response embedding this week and last week. Higher = more semantic shift. How this is measured.

Embedding centroid shift per model, 2026-W29.
Model Shift
gpt-5.5 0.0000
llama3.2:3b 0.0000