Magna Carta year

factual stability · fact-magna-carta · hash 52dfd5565115…

Prompt

In what year was the Magna Carta signed?

Refusal rate

Refusal rate per model per week.
Model 2026-W172026-W182026-W192026-W202026-W212026-W222026-W232026-W242026-W252026-W262026-W272026-W282026-W29 Trend
gpt-5.5 0.00 0.00 gpt-5.5: 0.00, 0.00
llama3.2:3b 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 llama3.2:3b: 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00
claude-opus-4-8 0.00 claude-opus-4-8: 0.00
claude-opus-4-7 0.00 0.00 0.00 0.00 0.00 claude-opus-4-7: 0.00, 0.00, 0.00, 0.00, 0.00
gpt-5.1 0.00 0.00 0.00 0.00 0.00 gpt-5.1: 0.00, 0.00, 0.00, 0.00, 0.00

Hedge density

Hedge density per model per week.
Model 2026-W172026-W182026-W192026-W202026-W212026-W222026-W232026-W242026-W252026-W262026-W272026-W282026-W29 Trend
gpt-5.5 0.00 0.00 gpt-5.5: 0.00, 0.00
llama3.2:3b 0.21 0.23 0.48 0.54 0.33 0.20 0.18 0.00 0.34 0.42 0.18 llama3.2:3b: 0.21, 0.23, 0.48, 0.54, 0.33, 0.20, 0.18, 0.00, 0.34, 0.42, 0.18
claude-opus-4-8 0.10 claude-opus-4-8: 0.10
claude-opus-4-7 0.39 0.10 0.41 0.46 0.23 claude-opus-4-7: 0.39, 0.10, 0.41, 0.46, 0.23
gpt-5.1 0.00 0.00 0.00 0.00 0.00 gpt-5.1: 0.00, 0.00, 0.00, 0.00, 0.00

Median length

Median length per model per week.
Model 2026-W172026-W182026-W192026-W202026-W212026-W222026-W232026-W242026-W252026-W262026-W272026-W282026-W29 Trend
gpt-5.5 7 7 gpt-5.5: 7, 7
llama3.2:3b 49 49 49 49 49 39 48 34 49 49 43 llama3.2:3b (change-point marked): 49, 49, 49, 49, 49, 39, 48, 34, 49, 49, 43
claude-opus-4-8 101 claude-opus-4-8: 101
claude-opus-4-7 42 45 50 67 70 claude-opus-4-7: 42, 45, 50, 67, 70
gpt-5.1 7 7 7 7 7 gpt-5.1: 7, 7, 7, 7, 7

Semantic drift

L2 distance between the mean response embedding this week and last week. Higher = more semantic shift. How this is measured.

Embedding centroid shift per model, 2026-W29.
Model Shift
gpt-5.5 0.0019
llama3.2:3b 0.0024