Home › Method

Methodology

How every number on this site is computed

Generated from the same modules the pages run, so it cannot describe a rule the site is not using.

The one formula

Row contribution sign × (2 × Truth − 1) × Confidence × Link × Imp × Uniq

FactorRangeWhat it isWhen nobody has argued it
sign+1 or −1Which side of the table the row was filed on.Not applicable: every row sits on a side.
Truth0 to 1The row's own claim page score, put on a −1 to +1 scale so a claim argued false subtracts from the side it was filed on.A row with no page reads 0.5, and (2 × 0.5 − 1) is 0, so it contributes exactly nothing.
Confidence0 to 1How much of the work behind that claim page has been done. It gates what the page passes upward; it never changes the page’s own truth score.A claim with no page contributes 0 regardless.
Link0 to 1The linkage page: if the claim were true, would the conclusion have to move?Reads 1. A reason placed under a conclusion is presumed relevant and the burden is on the challenger.
Imp0 to 1The importance page: the most valid interest this row really speaks to.Reads 0.5, the neutral start. Not a penalty; the absence of a claim either way.
Uniq0 to 1The uniqueness page: does this row make a point some other row has not already made?Reads 1. Presumed distinct until someone argues the overlap, which is why the duplicate list below matters.

Positive contributions are added into POS and negative ones into NEG as magnitudes, so a row lands on the side its sign puts it on and not the side it was filed on: a refuted objection counts as support. The belief score is POS − NEG, open ended. It is a quantity of argued weight, not a probability, and comparing it between a page with forty rows and a page with four is comparing volumes.

Every scored row on every page, whether it is an argument, a cited finding or a prediction, contributes this and nothing else.

Where a page starts, and why it has to start somewhereEvidence →

A row contributes (2 × Truth − 1). A page with no rows reads 0.50, so it contributes nothing, so every page above it also reads 0.50. By induction every page of an argument graph in which nothing is cited reads exactly 0.50, forever, however many reasons are listed and however well they are argued. Reasoning about reasoning never touches the world. What touches the world is evidence, so a page may say what it rests on, and that sets where its truth starts before any of its own rows count.

Starting point p₀ = 0.5 + 0.5 × ESIW × (2 × ERP/100 − 1)  ·  Weight w = k × 2 × ERQ / (ERQ + 1)

Truth, argued (POS + w × p₀) / (POS + NEG + w), k = 1

And then the conclusion cannot outrun its premises

What a page’s rows argue is not the last word on it. A page may list components it needs to be true, and mark some of them load-bearing: a premise the claim does not survive without. A conclusion cannot be more settled than something it needs, so the published truth is the smaller of what the rows argue and the weakest of those premises.

Truth, published min(Truth argued, the smallest truth among load-bearing components that have a page of their own)

It is a minimum and not a replacement, so a premise better established than the conclusion leaves the conclusion where its rows put it, and a premise stated in words that nobody has opened a page for caps nothing rather than capping at zero. This rule is why the five beliefs here read 0.50 while citing twenty findings between them. Their rows argue higher; each is held down by a necessary premise nobody has argued, which sits at 0.50 because nothing beneath it is established either way. That is the rule working, and it is also the thing to check first when a number looks wrong: each belief page says in words what is holding it and names the premise.

ERP is the share of independent replications that agreed and decides which way a claim is pushed; ESIW is the source type and decides how far it can be pushed; ERQ is how many replications there are and decides how much arguing it takes to shift. A page that names none of them reads p₀ = 0.50 and w = k, which is the neutral vote the rule always had, so citing nothing is not a penalty and is worth nothing. The weight is capped at twice k, so no pile of citations puts a claim beyond argument: at k = 1 a handful of argued objections pulls the best-sourced claim back under the line.

Two kinds of page score themselves differently

A linkage, uniqueness, equivalence or driver page is argued like any other claim and scores by the rules above. Two are not.

Importance page max over the interests it lists of Truth(the interest) × Bears(how much the row speaks to it)

A maximum and not a sum, because a reason that speaks to one interest that matters is important; listing five interests it barely touches is not five times as important. Bears is itself an argued page where one exists, and the labelled constant for relevance where none does. An importance page with nothing listed under it reads its own starting point, which is 0.50 unless it cites something.

Media page quality from its own argument rows, impact from its impact rows, each by the argued-truth rule above

A work is scored on whether what it says holds up and, separately, on how much of the corpus it moved. The two are kept apart because a widely read work that is wrong and an unread work that is right are different problems.

The evidence tiers

Source typeESIWWiki rankConfirmed it starts atContradicted it starts atWhat it covers
statistics 22 here0.9010.950.05Statistics and data, with the source cited
record added 15 here0.90beyond the sixteen0.950.05Primary official record: statute, judicial holding, agency rule, sworn filing
rct0.8520.930.08Formal scientific study: randomized controlled trial
meta0.8020.900.10Formal scientific study: meta-analysis
observational 5 here0.7530.880.12Observational or correlational study
historical0.7040.850.15Historical trend, with references
expert_data 1 here0.6550.820.17Expert testimony with supporting data
expert_claim0.6060.800.20Expert or social media claim
anecdote0.5570.780.22Personal experience or anecdote
logic0.5080.750.25Common sense or logic
analogy0.4590.720.28Analogy or metaphor
norm0.40100.700.30Cultural norm
intuition0.35110.680.33Intuition or gut feeling
news0.30120.650.35News or media report
survey0.25130.620.38Survey or poll
eyewitness0.20140.600.40Eyewitness testimony
visual0.15150.570.42Visual evidence
artifact0.10160.550.45Historical artifact

The sixteen ranked rows are the wiki’s own table with its weights and its order. Two readings an auditor should have: the wiki gives one band, 0.85 to 0.80, for randomised trials and meta-analyses together, split here in the order it lists them; and the wiki has no row for a primary official record, so one was added and marked, because calling a Supreme Court holding a historical trend would be wrong. Classify what the sentence on the page asserts, not the instrument that produced it: “58 percent told a pollster X” is a published statistic, while “Americans believe X” inferred from the same poll is survey evidence and much weaker.

This is the part that is easy to skip and is load-bearing.

Confidence: how much a score has earned the right to count

ComponentWeightWhat it measures
grounding0.30Whether this claim is actually established, taking the better of its own cited source and the average confidence of the claims argued beneath it. Recursive, and the reason a tree of bare assertions scores near zero however many rows it lists.
two sided0.20Whether anyone has argued the other side at all. Not applicable to an importance page, which has no sides by design.
scrutiny0.20Of the multipliers on each row, how many have been argued on a page of their own rather than resting on a starting constant.
breadth0.15How much has been brought to bear. Saturating, so volume never overtakes reasoning quality.
depth0.05How far down the tree goes.
sourcing0.05Of the findings cited on this page, how many cite a source and say what kind of source it is. An uncategorised citation is a reference, not a verification.
testability0.05Of the predictions listed, how many are dated and have a linkage page arguing how diagnostic they are.

Components that do not apply to a page are dropped and the rest renormalised, so a page is never punished for a signal its shape cannot carry. Across these 2173 pages confidence runs from 0.00 to 0.67, mean 0.06. The wiki also lists behavioural signals: up and down votes, weekly visitors, dwell time, edit frequency, duplicate submission attempts, per-argument evaluation responses, and the standard deviation of a score over time. A published corpus has one snapshot and no users, so all seven carry weight zero and are reported as having no data rather than scored as zero. Wire them up and they take weight from the structural components.

A score means nothing until the work behind it has been done, and then means more and more as it is done. Confidence multiplies what a page passes to any page above it: at 0 a claim moves its parent not at all, however true it looks. It is deliberately not a cap on the page’s own truth score. Truth is what the arguments say; confidence is how much to bet on it.

What would change the answer

The sweep reaches 6 levels below a page, and every page says so along with how many pages sit deeper than that. The flip point, where a page crosses 0.50 and the conclusion changes sides, is found by bisection to 16 places rather than by algebra, because a closed form would be a second implementation of the rule and would drift from the first. An input that moves a page by less than 0.005 is reported as inert: nothing anyone could learn about it changes the answer. A second sweep holds the input’s confidence at 1, which is what it would be worth once the work behind it is finished, and the gap between the two sweeps is the value of doing that work.

What it does not do. This is one input at a time. It finds single points of failure and it cannot see three assumptions each moving a little in the same direction, which is how correlated assumptions actually fail. The three widest inputs are also pushed against the belief together, which is a gesture at the problem rather than a solution to it. Reading a robust column here as “the conclusion is safe” is the mistake this paragraph exists to prevent.

On every belief and claim page, each claim beneath it is held at false and then at true, one at a time, and the whole graph is recomputed.

ReasonRank: how much depends on a claim

A walk starts evenly at the 162 beliefs and steps from each page to the pages it reads, choosing among rows in proportion to Link × Imp × Uniq, with a 0.85 chance of stepping on rather than restarting at a belief. ReasonRank is the share of that walk arriving at a page; it sums to 1 across the corpus and converged here to a residual of 8.8e-13. The truth of the claim being ranked is deliberately absent, so a page does not drop out of the queue at the moment it is proved false, and confidence is absent, because a page nobody has started is exactly what the ranking exists to find. Work value is ReasonRank × (1 − confidence): high rank with the work done is a settled foundation, high rank with the work undone is the next week an analyst should spend.

The network half of the algorithm the project is named for, which is a different question from whether a claim is true.

Computed equivalency, and what it gets wrong

Two lexical signals over the claim text, each weighted by inverse document frequency across this corpus and averaged: overlap of content words, and cosine over character 4-grams. Pairs above 0.45 are flagged for a human to read; above 0.70 they are probably one page. It measures wording, not meaning. It will flag two claims that share a long subject phrase and say different things, and it will miss two claims that share no words and say the same thing.

It changes no score and cannot. The wiki blends the computed and argued halves with weights set by a validity comparison argument. No such argument exists, so the computed weight is 0 and the argued page decides, which is the same rule as everywhere else here: an input nobody has argued counts nothing. The same goes for the uniqueness multiplier. The wiki defines it as one minus the highest similarity to any other row, computed; this site leaves it presumed distinct and flags the overlap instead, because a number that silently discounts an argument and has no page behind it cannot be audited, and every other number on this site is a link to the page that argues it.

One claimThe otherAlikeSame pageArgued
Increases in the immigrant college-graduate share measurably raise patents per capita.Increases in the share of immigrants who are college graduates measurably raise patents per capita.0.71nonobody has argued the overlap
Without Caitlin Clark, WNBA attendance and television ratings would have grown only modestly from their 2023 levels in 2024 and 2025.Without Caitlin Clark, WNBA attendance and television ratings would have stayed close to their 2023 levels in 2024 and 2025.0.70Caitlin Clark is the main reason WNBA a…nobody has argued the overlap
Institutions granted emergency exception powers expand their use beyond the original emergency.Emergency exception powers, once granted, do not expand beyond their original justification.0.66A good end does not justify using means…nobody has argued the overlap
During the Bracero era, expansions of the legal guest-worker channel coincided with sharp declines in unauthorized crossings, and ending the program coincided with their rebound.During the Bracero era, expansion of the legal channel coincided with a collapse in unauthorized crossings, and the program's termination coincided with their rebound.0.64nonobody has argued the overlap
A percentage-point increase in the share of immigrant college graduates measurably raises patents per capita.Increases in the share of immigrants who are college graduates measurably raise patents per capita.0.63nonobody has argued the overlap
Every one of the 12 players chosen for the 2024 United States Olympic women's basketball team had already won an Olympic or World Cup gold medal with the senior national team, and Caitlin Clark had never played a senior national team game.Every one of the 12 players on the 2024 United States Olympic women's roster had already won Olympic or World Cup gold with the senior national team, and the committee applied that standard to every spot.0.62Leaving Caitlin Clark off the 2024 Unit…nobody has argued the overlap
Paige Bueckers' nationally televised Dallas Wings games that do not involve the Fever will average less than half the audience of Clark's Fever games in the 2027 season.Paige Bueckers' Dallas Wings games that do not involve the Fever will draw national audiences within 25 percent of Clark's Fever games by the 2027 season.0.61Caitlin Clark's popularity owes more to…nobody has argued the overlap
Leaving Caitlin Clark off the 2024 United States Olympic basketball team was the right call.Leaving Caitlin Clark off the 2024 United States Olympic basketball team cost the United States nothing on the floor and nothing in the growth of the sport.0.60nonobody has argued the overlap
Ryan Brewer, associate professor of finance at Indiana University Columbus, estimated that Caitlin Clark accounted for 26.5 percent of all WNBA economic activity in 2024 and about 60 percent of the league's attendance increase.Ryan Brewer, a finance professor at Indiana University Columbus, concluded in an analysis for the Indianapolis Star in December 2024 that Caitlin Clark accounted for 26.5 percent of all WNBA economic activity in her rookie season.0.57Caitlin Clark is the main reason WNBA a…nobody has argued the overlap
WNBA national viewership was already rising before Caitlin Clark arrived, with 2023 viewership up 21 percent over 2022 and the most-watched regular season in 21 years.WNBA national viewership in 2023, the season before Caitlin Clark was drafted, was up 21 percent over 2022 across ABC, CBS, ESPN and ESPN2, the most-watched regular season in 21 years.0.57Caitlin Clark is the main reason WNBA a…nobody has argued the overlap
A percentage-point increase in the share of immigrant college graduates measurably raises patents per capita.Increases in the immigrant college-graduate share measurably raise patents per capita.0.56nonobody has argued the overlap
Leaving Caitlin Clark off the 2024 United States Olympic basketball team was the right call.Leaving Caitlin Clark off the 2024 United States Olympic basketball team was defensible on basketball grounds even if it was a missed chance to grow the sport's audience.0.53nonobody has argued the overlap

40 pairs flagged out of 2041 claims, of which the 12 most alike are shown and 28 are not. 30 sit on the same page with no uniqueness page between them, which is the live padding risk: each is scored as if it made a point the other did not. A word carried by almost every claim is skipped when looking for pairs, because the score is weighted by how rare a word is and such a word carries no weight in it; a word that is merely common is not skipped. 337,302 pairs share at least one such word and 31,956 of them were scored in full, which covered every claim.

The wiki splits the equivalency score into a computed half and an argued half. The argued half is the equivalence page. This is the computed one.

The labelled constants

ConstantValueWhat it presumes
K1A page starts as one vote with this weight, at 0.5 when it cites nothing and at its evidence prior when it does. Truth = (positive + w x p0) / (positive + negative + w), w = k x a bounded reward for replication. With k = 1 an unargued, unsourced page reads 0.5, a page with one unrebutted reason moves part of the way, not all the way, to certainty, and even the strongest evidence prior is within reach of one well-argued objection.
UNARG0.5What a row reads for Truth when it has no page yet: a coin flip. Give it a page and the page decides.
DEFLINK1A reason placed under a conclusion is presumed relevant until a linkage page says otherwise; the burden is on the challenger. Open the linkage page ("If it were true that X, it would necessarily strengthen Y") and argue it down. The scorecard counts how many rows still rest on this presumption.
DEFIMP0.5The neutral start for importance, the wiki's own rule: an importance nobody has argued opens at 0.5, neither trivial nor decisive, until an importance page names the issues the row addresses and their argued importance takes over. Not a penalty; the absence of a claim either way.
DEFUNIQ1A reason is presumed distinct until a uniqueness page shows the overlap.

What the engine reads when nobody has argued a factor. Each is a presumption, and each is visible in grey on the page so a reader can see which factors are still resting on one.

What this cannot do

Votes are counted and shown, and never scored.Anyone with a GitHub account can vote agree or disagree on a claim, and only that account’s latest vote counts. The counts sit on the claim’s heading line next to the truth score, and a home card ranks the gap between the two once three or more people have voted on a claim. No vote enters any number here: every score comes from the structure of the argument and from what pages cite, so the wiki’s behavioural half of confidence carries zero weight, and a score is not a measure of what anyone believes.
The evidence classifications are a judgement call.Somebody decided that a newspaper’s tally of public filings is a published statistic rather than a news report, and that decision moves the claim from 0.65 to 0.95. The wiki says the category should itself be argued in pro and con form. Here it is typed, and a wrong call is not visible as a disagreement.
One-at-a-time sensitivity misses correlated failure.Named above, repeated here because it is the failure mode most likely to matter in a real decision.
The duplicate detector reads words, not meaning.It has no language model. It will miss a paraphrase that shares no vocabulary, which is the case that pads a score most effectively.
Magnitudes in the cost and benefit tables are typed, not computed.They are the only typed numbers in the system. Every other number is derived, and these are not; treat them as an author’s estimate with an author’s error. Not one of them states a range, so every net on this site is a band built out of points.
The bottom line at the end of a page is a rule, not a judgement.It composes numbers already on the page in a fixed order and says when it cannot tell you. It cannot notice that a claim is absurd, that a source is fabricated, or that the whole question is wrongly framed. A reader who stops at the verdict has read a summary of the arithmetic, not an assessment of the argument.
The sensitivity sweep stops a fixed number of levels down.Each page says how deep it looked and how many pages sit below that. Nothing in this corpus sits deeper than the sweep reaches, but on a deeper one a claim below the line can still be the thing the conclusion rests on, and the sweep will not have touched it.
The revision page compares against the previous revision only.It answers what this revision changed, not what has changed since some earlier state a reader cares about. A number that drifts across twenty revisions drifts invisibly.
The duplicate detector has a work limit.A word is skipped only when it carries no weight in the score, which is when almost every claim has it, so how common a word is cannot on its own hide a duplicate. What remains is a limit on how many candidate pairs are held at once and a bar on how little two claims may share before the expensive half of the score is computed for them. Both are stated, and whatever the limit stopped it from examining is named rather than left out.
A truth score is not a probability.It is a share of argued weight around a starting point. It has the shape of a probability and does not have the calibration of one. Nothing here has been checked against outcomes.
The corpus is small.2173 pages on one topic, written by very few people. A rule that behaves well here has not been shown to behave well at scale or on a topic where the evidence is worse.

A methodology without this section is marketing.

The tables behind every page

Everything the site is built from, free to download and check. Every number on every page can be recomputed from these.

Where the code is

Every rule above is one short module, and a conformance corpus of twenty-four pages, their expected numbers, the five constants and the evidence tiers, published as conformance_corpus.json and conformance_expected.json so an implementation in any other language can be held to the same contract without cloning anything. The data behind every page is in the section above as JSON, XML, SQL and a loaded SQLite database. The repository holds all of it.

Built from revision 42c8344, committed 2026-10-04.