Home › Method
Methodology
How every number on this site is computed
The one formula
Row contribution sign × (2 × Truth − 1) × Confidence × Link × Imp × Uniq
| Factor | Range | What it is | When nobody has argued it |
|---|---|---|---|
| sign | +1 or −1 | Which side of the table the row was filed on. | Not applicable: every row sits on a side. |
| Truth | 0 to 1 | The row's own claim page score, put on a −1 to +1 scale so a claim argued false subtracts from the side it was filed on. | A row with no page reads 0.5, and (2 × 0.5 − 1) is 0, so it contributes exactly nothing. |
| Confidence | 0 to 1 | How much of the work behind that claim page has been done. It gates what the page passes upward; it never changes the page’s own truth score. | A claim with no page contributes 0 regardless. |
| Link | 0 to 1 | The linkage page: if the claim were true, would the conclusion have to move? | Reads 1. A reason placed under a conclusion is presumed relevant and the burden is on the challenger. |
| Imp | 0 to 1 | The importance page: the most valid interest this row really speaks to. | Reads 0.5, the neutral start. Not a penalty; the absence of a claim either way. |
| Uniq | 0 to 1 | The uniqueness page: does this row make a point some other row has not already made? | Reads 1. Presumed distinct until someone argues the overlap, which is why the duplicate list below matters. |
Positive contributions are added into POS and negative ones into NEG as magnitudes, so a row lands on the side its sign puts it on and not the side it was filed on: a refuted objection counts as support. The belief score is POS − NEG, open ended. It is a quantity of argued weight, not a probability, and comparing it between a page with forty rows and a page with four is comparing volumes.
Every scored row on every page, whether it is an argument, a cited finding or a prediction, contributes this and nothing else.
Where a page starts, and why it has to start somewhereEvidence →
A row contributes (2 × Truth − 1). A page with no rows reads 0.50, so it contributes nothing, so every page above it also reads 0.50. By induction every page of an argument graph in which nothing is cited reads exactly 0.50, forever, however many reasons are listed and however well they are argued. Reasoning about reasoning never touches the world. What touches the world is evidence, so a page may say what it rests on, and that sets where its truth starts before any of its own rows count.
Starting point p₀ = 0.5 + 0.5 × ESIW × (2 × ERP/100 − 1) · Weight w = k × 2 × ERQ / (ERQ + 1)
Truth, argued (POS + w × p₀) / (POS + NEG + w), k = 1
And then the conclusion cannot outrun its premises
What a page’s rows argue is not the last word on it. A page may list components it needs to be true, and mark some of them load-bearing: a premise the claim does not survive without. A conclusion cannot be more settled than something it needs, so the published truth is the smaller of what the rows argue and the weakest of those premises.
Truth, published min(Truth argued, the smallest truth among load-bearing components that have a page of their own)
It is a minimum and not a replacement, so a premise better established than the conclusion leaves the conclusion where its rows put it, and a premise stated in words that nobody has opened a page for caps nothing rather than capping at zero. This rule is why the five beliefs here read 0.50 while citing twenty findings between them. Their rows argue higher; each is held down by a necessary premise nobody has argued, which sits at 0.50 because nothing beneath it is established either way. That is the rule working, and it is also the thing to check first when a number looks wrong: each belief page says in words what is holding it and names the premise.
ERP is the share of independent replications that agreed and decides which way a claim is pushed; ESIW is the source type and decides how far it can be pushed; ERQ is how many replications there are and decides how much arguing it takes to shift. A page that names none of them reads p₀ = 0.50 and w = k, which is the neutral vote the rule always had, so citing nothing is not a penalty and is worth nothing. The weight is capped at twice k, so no pile of citations puts a claim beyond argument: at k = 1 a handful of argued objections pulls the best-sourced claim back under the line.
Two kinds of page score themselves differently
A linkage, uniqueness, equivalence or driver page is argued like any other claim and scores by the rules above. Two are not.
Importance page max over the interests it lists of Truth(the interest) × Bears(how much the row speaks to it)
A maximum and not a sum, because a reason that speaks to one interest that matters is important; listing five interests it barely touches is not five times as important. Bears is itself an argued page where one exists, and the labelled constant for relevance where none does. An importance page with nothing listed under it reads its own starting point, which is 0.50 unless it cites something.
Media page quality from its own argument rows, impact from its impact rows, each by the argued-truth rule above
A work is scored on whether what it says holds up and, separately, on how much of the corpus it moved. The two are kept apart because a widely read work that is wrong and an unread work that is right are different problems.
The evidence tiers
| Source type | ESIW | Wiki rank | Confirmed it starts at | Contradicted it starts at | What it covers |
|---|---|---|---|---|---|
statistics 22 here | 0.90 | 1 | 0.95 | 0.05 | Statistics and data, with the source cited |
record added 15 here | 0.90 | beyond the sixteen | 0.95 | 0.05 | Primary official record: statute, judicial holding, agency rule, sworn filing |
rct | 0.85 | 2 | 0.93 | 0.08 | Formal scientific study: randomized controlled trial |
meta | 0.80 | 2 | 0.90 | 0.10 | Formal scientific study: meta-analysis |
observational 5 here | 0.75 | 3 | 0.88 | 0.12 | Observational or correlational study |
historical | 0.70 | 4 | 0.85 | 0.15 | Historical trend, with references |
expert_data 1 here | 0.65 | 5 | 0.82 | 0.17 | Expert testimony with supporting data |
expert_claim | 0.60 | 6 | 0.80 | 0.20 | Expert or social media claim |
anecdote | 0.55 | 7 | 0.78 | 0.22 | Personal experience or anecdote |
logic | 0.50 | 8 | 0.75 | 0.25 | Common sense or logic |
analogy | 0.45 | 9 | 0.72 | 0.28 | Analogy or metaphor |
norm | 0.40 | 10 | 0.70 | 0.30 | Cultural norm |
intuition | 0.35 | 11 | 0.68 | 0.33 | Intuition or gut feeling |
news | 0.30 | 12 | 0.65 | 0.35 | News or media report |
survey | 0.25 | 13 | 0.62 | 0.38 | Survey or poll |
eyewitness | 0.20 | 14 | 0.60 | 0.40 | Eyewitness testimony |
visual | 0.15 | 15 | 0.57 | 0.42 | Visual evidence |
artifact | 0.10 | 16 | 0.55 | 0.45 | Historical artifact |
The sixteen ranked rows are the wiki’s own table with its weights and its order. Two readings an auditor should have: the wiki gives one band, 0.85 to 0.80, for randomised trials and meta-analyses together, split here in the order it lists them; and the wiki has no row for a primary official record, so one was added and marked, because calling a Supreme Court holding a historical trend would be wrong. Classify what the sentence on the page asserts, not the instrument that produced it: “58 percent told a pollster X” is a published statistic, while “Americans believe X” inferred from the same poll is survey evidence and much weaker.
This is the part that is easy to skip and is load-bearing.
Confidence: how much a score has earned the right to count
| Component | Weight | What it measures |
|---|---|---|
| grounding | 0.30 | Whether this claim is actually established, taking the better of its own cited source and the average confidence of the claims argued beneath it. Recursive, and the reason a tree of bare assertions scores near zero however many rows it lists. |
| two sided | 0.20 | Whether anyone has argued the other side at all. Not applicable to an importance page, which has no sides by design. |
| scrutiny | 0.20 | Of the multipliers on each row, how many have been argued on a page of their own rather than resting on a starting constant. |
| breadth | 0.15 | How much has been brought to bear. Saturating, so volume never overtakes reasoning quality. |
| depth | 0.05 | How far down the tree goes. |
| sourcing | 0.05 | Of the findings cited on this page, how many cite a source and say what kind of source it is. An uncategorised citation is a reference, not a verification. |
| testability | 0.05 | Of the predictions listed, how many are dated and have a linkage page arguing how diagnostic they are. |
Components that do not apply to a page are dropped and the rest renormalised, so a page is never punished for a signal its shape cannot carry. Across these 2173 pages confidence runs from 0.00 to 0.67, mean 0.06. The wiki also lists behavioural signals: up and down votes, weekly visitors, dwell time, edit frequency, duplicate submission attempts, per-argument evaluation responses, and the standard deviation of a score over time. A published corpus has one snapshot and no users, so all seven carry weight zero and are reported as having no data rather than scored as zero. Wire them up and they take weight from the structural components.
A score means nothing until the work behind it has been done, and then means more and more as it is done. Confidence multiplies what a page passes to any page above it: at 0 a claim moves its parent not at all, however true it looks. It is deliberately not a cap on the page’s own truth score. Truth is what the arguments say; confidence is how much to bet on it.
What would change the answer
The sweep reaches 6 levels below a page, and every page says so along with how many pages sit deeper than that. The flip point, where a page crosses 0.50 and the conclusion changes sides, is found by bisection to 16 places rather than by algebra, because a closed form would be a second implementation of the rule and would drift from the first. An input that moves a page by less than 0.005 is reported as inert: nothing anyone could learn about it changes the answer. A second sweep holds the input’s confidence at 1, which is what it would be worth once the work behind it is finished, and the gap between the two sweeps is the value of doing that work.
What it does not do. This is one input at a time. It finds single points of failure and it cannot see three assumptions each moving a little in the same direction, which is how correlated assumptions actually fail. The three widest inputs are also pushed against the belief together, which is a gesture at the problem rather than a solution to it. Reading a robust column here as “the conclusion is safe” is the mistake this paragraph exists to prevent.
On every belief and claim page, each claim beneath it is held at false and then at true, one at a time, and the whole graph is recomputed.
ReasonRank: how much depends on a claim
A walk starts evenly at the 162 beliefs and steps from each page to the pages it reads, choosing among rows in proportion to Link × Imp × Uniq, with a 0.85 chance of stepping on rather than restarting at a belief. ReasonRank is the share of that walk arriving at a page; it sums to 1 across the corpus and converged here to a residual of 8.8e-13. The truth of the claim being ranked is deliberately absent, so a page does not drop out of the queue at the moment it is proved false, and confidence is absent, because a page nobody has started is exactly what the ranking exists to find. Work value is ReasonRank × (1 − confidence): high rank with the work done is a settled foundation, high rank with the work undone is the next week an analyst should spend.
The network half of the algorithm the project is named for, which is a different question from whether a claim is true.
Computed equivalency, and what it gets wrong
Two lexical signals over the claim text, each weighted by inverse document frequency across this corpus and averaged: overlap of content words, and cosine over character 4-grams. Pairs above 0.45 are flagged for a human to read; above 0.70 they are probably one page. It measures wording, not meaning. It will flag two claims that share a long subject phrase and say different things, and it will miss two claims that share no words and say the same thing.
It changes no score and cannot. The wiki blends the computed and argued halves with weights set by a validity comparison argument. No such argument exists, so the computed weight is 0 and the argued page decides, which is the same rule as everywhere else here: an input nobody has argued counts nothing. The same goes for the uniqueness multiplier. The wiki defines it as one minus the highest similarity to any other row, computed; this site leaves it presumed distinct and flags the overlap instead, because a number that silently discounts an argument and has no page behind it cannot be audited, and every other number on this site is a link to the page that argues it.
40 pairs flagged out of 2041 claims, of which the 12 most alike are shown and 28 are not. 30 sit on the same page with no uniqueness page between them, which is the live padding risk: each is scored as if it made a point the other did not. A word carried by almost every claim is skipped when looking for pairs, because the score is weighted by how rare a word is and such a word carries no weight in it; a word that is merely common is not skipped. 337,302 pairs share at least one such word and 31,956 of them were scored in full, which covered every claim.
The wiki splits the equivalency score into a computed half and an argued half. The argued half is the equivalence page. This is the computed one.
The labelled constants
| Constant | Value | What it presumes |
|---|---|---|
| K | 1 | A page starts as one vote with this weight, at 0.5 when it cites nothing and at its evidence prior when it does. Truth = (positive + w x p0) / (positive + negative + w), w = k x a bounded reward for replication. With k = 1 an unargued, unsourced page reads 0.5, a page with one unrebutted reason moves part of the way, not all the way, to certainty, and even the strongest evidence prior is within reach of one well-argued objection. |
| UNARG | 0.5 | What a row reads for Truth when it has no page yet: a coin flip. Give it a page and the page decides. |
| DEFLINK | 1 | A reason placed under a conclusion is presumed relevant until a linkage page says otherwise; the burden is on the challenger. Open the linkage page ("If it were true that X, it would necessarily strengthen Y") and argue it down. The scorecard counts how many rows still rest on this presumption. |
| DEFIMP | 0.5 | The neutral start for importance, the wiki's own rule: an importance nobody has argued opens at 0.5, neither trivial nor decisive, until an importance page names the issues the row addresses and their argued importance takes over. Not a penalty; the absence of a claim either way. |
| DEFUNIQ | 1 | A reason is presumed distinct until a uniqueness page shows the overlap. |
What the engine reads when nobody has argued a factor. Each is a presumption, and each is visible in grey on the page so a reader can see which factors are still resting on one.
What this cannot do
| Votes are counted and shown, and never scored. | Anyone with a GitHub account can vote agree or disagree on a claim, and only that account’s latest vote counts. The counts sit on the claim’s heading line next to the truth score, and a home card ranks the gap between the two once three or more people have voted on a claim. No vote enters any number here: every score comes from the structure of the argument and from what pages cite, so the wiki’s behavioural half of confidence carries zero weight, and a score is not a measure of what anyone believes. |
| The evidence classifications are a judgement call. | Somebody decided that a newspaper’s tally of public filings is a published statistic rather than a news report, and that decision moves the claim from 0.65 to 0.95. The wiki says the category should itself be argued in pro and con form. Here it is typed, and a wrong call is not visible as a disagreement. |
| One-at-a-time sensitivity misses correlated failure. | Named above, repeated here because it is the failure mode most likely to matter in a real decision. |
| The duplicate detector reads words, not meaning. | It has no language model. It will miss a paraphrase that shares no vocabulary, which is the case that pads a score most effectively. |
| Magnitudes in the cost and benefit tables are typed, not computed. | They are the only typed numbers in the system. Every other number is derived, and these are not; treat them as an author’s estimate with an author’s error. Not one of them states a range, so every net on this site is a band built out of points. |
| The bottom line at the end of a page is a rule, not a judgement. | It composes numbers already on the page in a fixed order and says when it cannot tell you. It cannot notice that a claim is absurd, that a source is fabricated, or that the whole question is wrongly framed. A reader who stops at the verdict has read a summary of the arithmetic, not an assessment of the argument. |
| The sensitivity sweep stops a fixed number of levels down. | Each page says how deep it looked and how many pages sit below that. Nothing in this corpus sits deeper than the sweep reaches, but on a deeper one a claim below the line can still be the thing the conclusion rests on, and the sweep will not have touched it. |
| The revision page compares against the previous revision only. | It answers what this revision changed, not what has changed since some earlier state a reader cares about. A number that drifts across twenty revisions drifts invisibly. |
| The duplicate detector has a work limit. | A word is skipped only when it carries no weight in the score, which is when almost every claim has it, so how common a word is cannot on its own hide a duplicate. What remains is a limit on how many candidate pairs are held at once and a bar on how little two claims may share before the expensive half of the score is computed for them. Both are stated, and whatever the limit stopped it from examining is named rather than left out. |
| A truth score is not a probability. | It is a share of argued weight around a starting point. It has the shape of a probability and does not have the calibration of one. Nothing here has been checked against outcomes. |
| The corpus is small. | 2173 pages on one topic, written by very few people. A rule that behaves well here has not been shown to behave well at scale or on a topic where the evidence is worse. |
A methodology without this section is marketing.
The tables behind every page
- The two tables and the topics, in every shape: JSON, XML, SQL schema, SQL data or a SQLite database.
- Every page's computed numbers, indexed, and every claim in the tables, drafts included.
- Every draft and what it still needs.
- What changed since the last revision, row by row.
Everything the site is built from, free to download and check. Every number on every page can be recomputed from these.
Where the code is
Every rule above is one short module, and a conformance corpus of twenty-four pages, their expected numbers, the five constants and the evidence tiers, published as conformance_corpus.json and conformance_expected.json so an implementation in any other language can be held to the same contract without cloning anything. The data behind every page is in the section above as JSON, XML, SQL and a loaded SQLite database. The repository holds all of it.
Built from revision 42c8344, committed 2026-10-04.