ETG General Paper
GP / Blog / Science & Technology
Issue briefing

Trust in science, statistics and data: when the numbers themselves can mislead

Statistics are usually defended as the cure for bias and guesswork, the hard ground under a decision. The contrarian case is that numbers are made by people, with choices and incentives, and that a society which treats data as automatically objective has simply found a more authoritative way to be wrong.

Theme · Science & TechnologyLast set at A-Level · 2020 (on whether statistics are a reliable guide for planning the future)SEAB sets the paper
In short

A trust-in-data question rewards a student who can defend evidence-based reasoning and still expose how numbers mislead. Data really is the best guide we have over hunch and anecdote. Argue where that breaks down: when figures are gamed, when studies fail to replicate, when AI fabricates plausible data, and when 'the numbers say' becomes a way to dodge a value judgement.

Why this could come up now

The reliability-of-evidence strand recurs in shifting forms. It appeared as statistics guiding the future in 2020 and as scientific advancement breeding complacency in 2021. Underneath both is the same question: how much weight a data-driven society should put on its own numbers.

The current pressure is real. In 2026 generative AI can fabricate plausible figures, citations and studies at scale; the replication crisis has already shown that a large share of published findings do not hold up; trust in institutions and their statistics is contested in election after election. The ground under 'the data shows' is shakier than the phrase suggests.

Framed honestly: SEAB sets the paper, and nobody outside it knows the wording. A question on data, statistics or scientific reliability is a recurring type rather than a certain return. It is worth rehearsing because the contrarian move, defending data while exposing its failure modes, is one most candidates never make.

201420172020202120232025

set at A-Level most recent appearance. Recurs as the reliability-of-evidence strand. The vehicle changes from statistics to science to data; the trust question stays.

What an essay on this would test

These questions test whether you can value evidence without worshipping it. The lazy answer either trusts numbers blindly or rejects them as 'lies, damned lies and statistics'. The strong answer holds that data is the best tool we have and that tools can be misused, mis-measured and gamed, then argues how to tell good data from bad.

They also test whether you understand how a figure is made. A statistic carries choices: what was counted, how it was defined, who funded it, what was left out. A student who can interrogate the production of a number, not just quote it, is doing the exact thinking the question rewards.

Operative angles
  • reliable guide: not whether data is ever wrong, but whether it is the best available basis for deciding, which is a different and more defensible claim
  • objective versus constructed: numbers feel neutral, but every figure embeds choices about definition, method and measurement
  • gaming and fabrication: when a target becomes a measure it gets gamed, and AI can now manufacture plausible false data at scale

How to answer it: two ways in

Two distinct, defensible routes through the question. A strong script commits to one and uses the other as the concession it answers, rather than sitting on the fence.

Data is the best guide we have

Numbers beat hunch, bias and anecdote

For all its flaws, evidence-based reasoning has outperformed intuition and tradition across medicine, policy and planning, so the answer to bad data is better data, not a retreat into gut feeling.

  • Decisions grounded in measurement, vaccination, public health, resource planning, have saved more lives than decisions grounded in instinct.
  • Anecdote and intuition are not the safe alternative; they are how prejudice and superstition dress themselves up as judgement.
  • The fixes for bad statistics, transparency, replication, peer review, are themselves part of the scientific method correcting itself.
Worked exampleSingapore's data-driven pandemic response, tracking infection and vaccination figures closely to guide policy, produced among the world's lowest case-fatality rates, a case where trusting and acting on the numbers clearly beat guesswork (Singapore government, as of 2026-06).
The numbers can mislead

Constructed, gameable and now fabricated

Data is not found but made, with definitions, incentives and errors baked in, and in a world where studies fail to replicate and AI can manufacture plausible figures, treating numbers as automatically objective is its own kind of credulity.

  • When a number becomes a target it gets gamed, so the very act of measuring distorts what is measured.
  • A large share of published findings have failed to replicate, which means even peer-reviewed data is not self-evidently trustworthy.
  • Generative AI can now fabricate citations, studies and statistics that look authoritative, so the cost of producing convincing false data has collapsed.
Worked exampleThe 2015 Reproducibility Project tried to repeat 100 published psychology studies and confirmed only about 36 percent of the original findings, a blunt demonstration that 'peer-reviewed' and 'reliable' are not the same thing (Open Science Collaboration, as of 2026-06).

The fuel: stats, facts and examples

~36%
of 100 published psychology findings that replicated when independently repeated in the 2015 Reproducibility Project
Source: Open Science Collaboration, Science 2015 · as of 2026-06
100
influential studies the Reproducibility Project re-ran; over half did not hold up, with effect sizes roughly halved
Source: Open Science Collaboration, Science 2015 · as of 2026-06
60%+
of jobs in advanced economies exposed to AI, the same systems now able to fabricate plausible data and citations at scale
Source: IMF, on AI exposure · as of 2026-06

Facts worth deploying

01

The replication crisis, first named widely after the 2015 Reproducibility Project, has since prompted reforms such as pre-registration and open data, so the failure of trust also drove the method to correct itself.Source: Open Science Collaboration and subsequent reform, as of 2026-06

02

Generative AI can now produce fabricated statistics, fake citations and plausible-looking studies, which lowers the cost of manufacturing convincing false data and raises the burden on the reader to verify.Source: general technology reporting, 2026, as of 2026-06

03

Goodhart's principle, that a measure stops being a good measure once it becomes a target, explains why data-driven targets so often get gamed rather than met, from exam metrics to hospital waiting times.Source: established statistical principle, as of 2026-06

A number is not a fact. It is a choice about what to count, dressed in the authority of arithmetic.The contrarian case on data
FAQ
Does arguing that data misleads mean rejecting science?
No, and you should say so explicitly. The strong essay defends evidence as the best available basis for deciding and shows how particular numbers fail. That is the scientific attitude, not its opposite: science earns trust precisely by exposing and correcting its own errors, as the replication-crisis reforms did.
How do I avoid the tired 'lies, damned lies and statistics' line?
Skip the cliche and argue the mechanism. Say how a specific figure misleads, through definition, incentive, non-replication or fabrication, rather than asserting in general that statistics lie. The marks are in explaining the failure, not in quoting the slogan.
Can I bring AI into a statistics question?
Yes, carefully, as the freshest failure mode. AI that fabricates plausible data and citations is a genuine 2026 reason the trust question has sharpened. Use it as one mechanism among several, gaming and non-replication being the others, rather than letting it take over the essay.
ETG General Paper

Learn to argue these, not just read about them

Book a free trial lesson and see how we teach GP from the exam backwards, building the two-stance habit on issues exactly like this one.

Book a Trial Class   WhatsApp the team