Home › Topics › Government › Evidence & Process › Belief: Public policy should be driven by data and measurable outco…
Belief
Public policy should be driven by data and measurable outcomes rather than by ideology. 0.50 Agree Disagree
If you disagree, this page has a column for you. A study, record or dataset for “Policies with measurable outcomes can be corrected when they fail, and policies without them cannot”, which rests on argument alone.
Argument TreesHow arguments are scored →
Reasons to agree
Reasons to disagree
Weight for 0.00 · weight against 0.00 · net +0.00
Each reason is a claim with its own page. Score = sign x (2 x Truth - 1) x Conf x Link x Imp x Uniq, and every column is here so the row can be multiplied out and checked. A reason argued false scores negative and counts against the side it is filed on; a reason nobody has argued yet scores exactly 0, and so does one whose own page has no work behind it.
What Would Change the AnswerTruth scores →
Not shown: 20 further inputs, each moving it less than any row shown
Every claim beneath this page held at false and then at true, one at a time, with the whole graph recomputed each time. "If false" and "if true" are where this page’s truth score lands; "Move" is how far apart they are. "If settled" is that same distance with the input’s confidence held at 1, which is what it would be worth once the work behind it is finished, so the gap between Move and If settled is the value of doing that work. This is one input at a time and finds single points of failure; it does not test several inputs moving together, which is how correlated assumptions actually fail.
Evidence LedgerHow evidence is scored →
Supporting
Weakening
| # | Finding | Bears on | Starts at | Truth | Conf | Link | Imp | Score | EVS |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Cochrane Reviews and meta-analyses of pharmaceutical research consistently find that industry-funded studies produce favorable results at two to three times the rate of independent studies of the same treatments. Cochrane Library Rests on: Nothing observed: no source type recorded, so this claim starts at a coin flip | this belief | 0.50 | 0.50 | 0.00 | 1.00 | 0.50 | -0.00 | 0.00 |
| 2 | Measuring that a policy has failed does not by itself get the policy corrected: crime prevention programs such as D.A.R.E., Scared Straight and boot camps for juvenile offenders showed no effect or harmful effects in rigorous evaluations, yet kept running for decades on political popularity. Campbell Collaboration Rests on: Nothing observed: no source type recorded, so this claim starts at a coin flip | this belief | 0.50 | 0.50 | 0.00 | 1.00 | 0.50 | -0.00 | 0.00 |
Weight for 0.00 · weight against 0.00 · net +0.00
Evidence Verification Score 0.00 · supporting 0.00 · weakening 0.00. 5 of 5 findings have no source type named yet; 5 have no replication count recorded, so each counts as one study.
Findings that can fail empirically. Each has its own page where its accuracy is argued; the source is shown under it. Bears on says which claim the finding is filed under: this belief, or one of its reasons, in which case it reaches this page through that reason's truth score and is counted there. “Starts at” is where a finding's page begins before anyone argues with it, set by what kind of source it is, how many independent replications exist and how many of them agreed. A finding nobody has classified starts at 0.50, and at 0.50 it contributes nothing however often it is listed.
Testable PredictionsEvidence and predictions →
Follows if the belief is true
Follows if the belief is false
| Prediction | Truth | Conf | Link | Imp | Contrib. | At stake |
|---|---|---|---|---|---|---|
| Within five years of a metric becoming a funding condition, the metric improves while the underlying outcome it was meant to track does not. By when, and how it is checked: 5 years; paired tracking of the targeted metric and an untargeted outcome measure in the same domain | 0.50 | 0.00 | 1.00 | 0.50 | -0.00 | 0.00 |
| A documented case shows a metrics-driven regime producing worse results on the outcome that mattered than the ideology-driven regime it replaced, with the Goodhart mechanism traced rather than assumed. No deadline or method stated yet. | 0.50 | 0.00 | 1.00 | 0.50 | -0.00 | 0.00 |
| An evidence-review body of the NICE type is shown to have been steered by industry-generated evidence into decisions with worse patient or fiscal outcomes than the unevaluated baseline. No deadline or method stated yet. | 0.50 | 0.00 | 1.00 | 0.50 | -0.00 | 0.00 |
Prediction contribution +0.00 · points at stake 0.00 · 43% of predictions are diagnostic and dated
If this belief is true, what should the world show that it would not show otherwise; if false, what instead? Result so far is the prediction's own page: pending at 0.50, and moving as it comes true or fails. A pending prediction contributes nothing yet; At stake is what it would contribute once settled.
Interests, Not PositionsConflict resolution framework →
Interests of each side
Interests of supporters
Interests of opponents
Primary conflict pair (computed: the interest with the highest Validity x Drives on each side) Citizens frustrated by gridlock and ideological performance need government to solve the problems it says it will solve. (0.50 x 0.50) against Community advocates need policy to reflect what matters to the communities it affects, which they doubt quantitative metrics capture. (0.50 x 0.50). 50% of the paired weight sits on the supporting side. This is the one disagreement actually driving the debate: the product uses validity on purpose, so a cover story cannot lead a side and neither can a worthy need nobody is moved by. Validity is whether the need should be honored, argued on its own page and never by the power of who holds it; Drives is whether the need is really why this side holds its position, settled by what the side does. They are different numbers.
Shared interests
| Both sides need policies that actually reduce the problems they target. | 0.50 | |
| Both sides need government spending that produces results rather than just activity. | 0.50 | |
| Both sides need a policy process that can be explained and defended to constituents. | 0.50 | |
| Both sides need fewer of the most obvious politically motivated policy failures. | 0.50 |
Best compromise
| Separate the empirical question from the values question explicitly: state what the evidence shows a policy produces and at what cost, and state separately that whether the trade-off is worth making depends on how one weighs the competing values. | Rests on Why difficult | 0.50 |
| Require pre-registration of success metrics for all major government programs, so success is defined before the money is spent. | Rests on Why difficult | 0.50 |
| Make independence of evidence production a structural requirement rather than a voluntary norm: pharmaceutical companies should not be the primary funders of research on whether pharmaceutical treatments work, and industry-funded research should be labeled and discounted systematically. | Rests on Why difficult | 0.50 |
Positions are what people say they want; interests are why. Each interest is a need with a subject (who needs what), and that one sentence is argued two ways that never borrow from each other. Validity asks whether the need should be honored, and is settled on the interest's own page by the mirror test: would the side accept the same need honored for its opponents, and what happens if everyone pursues it? Who holds the need, how many of them there are and how much power they have never count. Drives asks whether this need is really why the side holds its position, and is settled by the side's record, not its rhetoric (the scoring methodology calls it Linkage Accuracy). Score = Validity x Drives. A motive that is real and illegitimate stays in the table with its low validity: it is scored, not deleted, and the same suspicion applies to both sides.
Related Beliefs
- America should adopt a comprehensive scorecard that measures national progress across human development, economic vitality, environmental health, and social cohesion, not just GDP. 0.50
- America should strengthen its global leadership by modeling a strong, functioning democracy at home. 0.50
- Public policy should be driven by data and measurable outcomes rather than by ideology. (this page)
The other beliefs filed under Evidence & Process; this one is listed unlinked.
Not filled in yet
| Falsifiability Test | nothing named that would strengthen or weaken this belief if it turned up |
| Objective Criteria | no yardstick both sides would accept in advance has been proposed |
| What Acting On This Would Cost and Gain | no costs or benefits priced yet |
| Logical Anatomy | the claim has not been split into its component parts |
| Media Resources | no books, studies or films weighed |
| Legal Framework | no laws or rulings cited |
| General to Specific | not linked to broader or narrower beliefs |
Parts of the template nobody has filled in here. They are named rather than shown, because an empty table is not a finding, and each one is a reason the confidence above is not higher. A part that takes rows has a form for its first one.
What this page needs right now
| # | The gap | Where it goes | Who is best placed to fill it |
|---|---|---|---|
| 1 | A study, record or dataset for “Policies with measurable outcomes can be corrected when they fail, and policies without them cannot”, which rests on argument alone | Evidence Ledger | anyone with the source |
| 2 | A measurement both sides would accept in advance, with the reading each side predicts | Objective Criteria | anyone who can name a yardstick the other side would sign |
Named gaps, read off the tables above, so a newcomer can see exactly where a contribution goes. None of them requires agreeing with the page, and each one links to the form it goes in.
What the numbers are made of
- Share on the agree side
- no scored weight either way
- Confidence
- 36%. Weakest parts: scrutiny 0% · grounding 0%
- Depended on
- ReasonRank 0.0033, 144 of 2173
- Strongest reason for
- Policies with measurable outcomes can be corrected when they fail, and policies without them cannot. +0.00
- Strongest reason against
- The label "evidence-based" is regularly used as a rhetorical weapon to favor some kinds of knowledge over others. -0.00
- What would move this most
- Settling Policies with measurable outcomes can be corrected when they fail, an…: 0.50 if false, 0.50 if true
- Coverage
- Of 22 scored rows, 22 have no linkage page, 22 have no importance page, 22 have no uniqueness page. This page reads 34 other pages. 34 of them are one-sided or empty: Policies with measurable outcomes can be corrected when they fail, and policies without them cannot.; The track record of ideology-driven policy, across the political spectrum, is substantially worse than that of evidence-driven alternatives.; Good policy ideas come from all parts of the political spectrum, and filtering ideas by ideology discards them.; When the reasoning behind a policy is laid out openly, with each claim linked to its evidence and the quality of that evidence shown, motivated reasoning becomes visible and can be corrected.; Voters can only hold officials accountable for outcomes they can measure.; The label "evidence-based" is regularly used as a rhetorical weapon to favor some kinds of knowledge over others.; Most major policy disagreements are about values rather than facts, and data cannot resolve disputes about values.; Data-driven policy systems can be captured by the people who generate and control the data.; Measurable outcomes create their own distortions, because when a measure becomes a target it ceases to be a good measure (Goodhart's Law).; Expert consensus has been wrong on important questions, sometimes systematically, so policy frameworks that defer excessively to it build in a systematic lag before correcting errors that independent political pressure might have caught sooner.; The UK's National Institute for Health and Care Excellence, a standing body that reviews evidence and issues binding recommendations based on cost-effectiveness, is documented to save the NHS about 1.5 billion pounds a year compared with unevaluated adoption of new treatments, while improving patient outcomes.; Education programs rated "strong evidence" by the U.S. Department of Education's What Works Clearinghouse consistently outperform programs without evidence ratings.; Police departments that use data-driven deployment (crime hotspot analysis and predictive resource allocation) achieve measurably better crime reduction per dollar than departments using traditional patrol methods, with effect sizes of 15 to 30 percent in controlled comparisons.; Cochrane Reviews and meta-analyses of pharmaceutical research consistently find that industry-funded studies produce favorable results at two to three times the rate of independent studies of the same treatments.; Measuring that a policy has failed does not by itself get the policy corrected: crime prevention programs such as D.A.R.E., Scared Straight and boot camps for juvenile offenders showed no effect or harmful effects in rigorous evaluations, yet kept running for decades on political popularity.; Citizens frustrated by gridlock and ideological performance need government to solve the problems it says it will solve.; Fiscally minded voters need demonstrated value for government spending.; Reform-oriented politicians need an evidence standard to justify cross-partisan positions.; Policy researchers and evaluation professionals need frameworks that validate their expertise, which evidence-based policy does.; Organizations like the Idea Stock Exchange need evidence-based norms to be adopted, because the value of their platforms depends on it.; Policy analysts at centrist think tanks and technocratic policy advisers need the "evidence-based" label to cast centrist or technocratic preferences as the neutral default and opponents as anti-science, which is a positioning move rather than a value.; Community advocates need policy to reflect what matters to the communities it affects, which they doubt quantitative metrics capture.; Voters and representatives need value choices to stay with the electorate rather than with whoever runs the evaluation.; Politicians whose brand is ideological clarity rather than pragmatic problem-solving need to keep that brand intact.; Interest groups whose programs survive on political relationships need those programs to be judged on relationships rather than on demonstrated outcomes.; Ideological partisans whose preferred policies fare poorly under evidence scrutiny, and people who benefit from the current opacity of policy reasoning, need that scrutiny kept away from their programs.; Directors of nonprofit and government programs whose funding depends on ideologically committed donors or legislators need to invoke the idea that many kinds of knowledge count, or democratic legitimacy, to shield a program from any evaluation at all, which is ideological or donor protection dressed as principle.; Federal programs covered by the 2018 Evidence Act's evaluation requirements are discontinued or redesigned after poor evaluations at higher rates than comparable programs were before the Act.; Programs with pre-registered outcome metrics show smaller gaps between claimed and independently measured results than programs whose metrics were defined after launch.; In a matched comparison over a decade, programs selected by evidence review outperform programs selected by political popularity in the same domain, on outcomes both sides named in advance.; Agencies under a statutory evaluation mandate discontinue or redesign evaluated failures at measurably higher rates than before the mandate, as shown in audit records rather than agency self-reports.; Within five years of a metric becoming a funding condition, the metric improves while the underlying outcome it was meant to track does not.; A documented case shows a metrics-driven regime producing worse results on the outcome that mattered than the ideology-driven regime it replaced, with the Goodhart mechanism traced rather than assumed.; An evidence-review body of the NICE type is shown to have been steered by industry-generated evidence into decisions with worse patient or fiscal outcomes than the unevaluated baseline..
- Bottom line
- There is a strong case for evidence as a necessary input to policy, and there are significant, legitimate objections to naive data-driven frameworks that ignore values, local knowledge, and data capture. The disagreement is rarely about whether data should matter; it is about which data, who interprets it, and whether "evidence-based" is a neutral standard or a rhetorical weapon.
Scoring EngineTruth scores →
| Quantity | Value | How |
|---|---|---|
| Argument score | +0.00 | argument rows: weight for minus weight against |
| Evidence score | +0.00 | evidence rows: weight for minus weight against |
| Prediction contribution | +0.00 | prediction rows, same signed formula as every other row |
| Belief score | +0.00 | the three lines above added together |
| Positive total | 0.00 | every row whose signed contribution came out positive, from either side |
| Negative total | 0.00 | every row whose signed contribution came out negative, as a magnitude |
| Starting point | 0.50 | where this claim starts before any of its own rows count: Nothing observed: no source type recorded, so this claim starts at a coin flip |
| Weight of the starting point | 1.00 | k x a bounded reward for independent replication, k = 1, capped at 2.0 x k |
| Truth score, argued | 0.50 | (positive + weight x starting point) / (positive + negative + weight) |
| Truth score | 0.50 | argued truth, capped by the weakest load-bearing component that has its own page |
| ReasonRank | 0.0033 | how much of the site depends on this page: rank 144 of 2173. The share of a walk that starts at the 162 beliefs and steps to the pages they read, with a 0.85 chance of stepping on each time |
| Work value | 0.0022 | ReasonRank x (1 - confidence): how much settling this page would be worth to everything above it |
| Completeness | yes | at least one scored reason on each side (an importance page: at least one interest; an interest page: both readings filled) |
Cite this page Public policy should be driven by data and measurable outcomes rather than by ideology. Idea Stock Exchange, belief page public-policy-driven-data, truth 0.50, confidence 36%, revision 42c8344 of 2026-10-04. The revision is what makes this quotable: these numbers move as the argument is worked on, and rebuilding that revision reproduces them exactly.
Every number on this page as data: public-policy-driven-data.json. Constants: K = 1 · UNARG = 0.5 · DEFLINK = 1 · DEFIMP = 0.5 · DEFUNIQ = 1. A reason placed under a conclusion is presumed relevant until a linkage page says otherwise; the burden is on the challenger. The neutral start for importance, the wiki's own rule.
Every value here is computed from the tables above at build time. Nothing is typed.