How to verify the citations in an academic paper

Why “the reference exists” isn't enough

A citation can fail in three distinct ways. The reference can be fabricated — no such paper exists (increasingly common in AI-assisted writing). It can be misattributed — the paper exists but the details are wrong: wrong authors, wrong year, wrong venue, or a DOI pointing somewhere else. Or it can be unsupported — the paper is real and correctly described, but it doesn't say what the citing sentence claims it says. Studies of citation accuracy across fields routinely find that a meaningful fraction of citations misrepresent their sources, so the third failure mode is not an edge case — it's the common one.

Step 1: Build the list of what needs checking

Go through the paper and collect every in-text citation together with the sentence it appears in. The sentence matters: the unit of verification is not the reference, it's the claim–citation pair. A single sentence citing three sources makes (at least) three verification tasks, and a sentence like “X improves Y and reduces Z [7]” makes two distinct claims against one source.

Step 2: Confirm each reference resolves to a real work

1. If the reference has a DOI, resolve it at doi.org and confirm the landing page matches the title, authors, and year in the bibliography.
2. If there's no DOI, search the exact title in quotes on Google Scholar, Crossref, or OpenAlex.
3. Treat near-misses with suspicion. A plausible title with a slightly wrong author list, or a real author paired with a paper they never wrote, is the classic signature of a fabricated reference.

Step 3: Get the right version of the source

Preprints, accepted manuscripts, and published versions of record can differ in substance — numbers change between arXiv and the journal. Verify against the version the paper actually cites where possible. Open-access copies can be found via OpenAlex or CORE; otherwise use your library access.

Step 4: Find the passage behind the claim

This is the step that separates real verification from reference checking. For each claim–citation pair, locate the place in the source that the claim rests on. Search the source PDF for the claim's key terms and their synonyms; check the abstract, results, and conclusion first, but don't stop there — hedged or conditional findings in the discussion section are where overreach hides. If a page number is given in the citation, start there but don't trust it blindly.

Step 5: Judge support — and record it honestly

A useful three-level scale:

• Supported — the source states the claim, or reports findings that straightforwardly entail it.
• Partially supported — the source supports part of the claim but not all of it: the direction but not the magnitude, the population but not the generalization, the correlation but not the causation.
• Unsupported — the source doesn't address the claim, or contradicts it.

Record the verdict together with the passage you based it on. A verification record you can't re-open and inspect later is just a memory.

How long does this take by hand?

For a typical research paper with 40–80 references, expect several minutes per claim–citation pair once sources are in hand — realistically a full working day or more for one paper, which is why it's so rarely done thoroughly.

Doing the same thing with CiteFirm

CiteFirm automates the mechanical parts of exactly this method. You upload the paper as a PDF; it extracts every in-text citation and bibliography entry (step 1), resolves each reference against scholarly metadata and flags the ones that don't match any real work (step 2), retrieves open-access source PDFs and accepts your uploads for the rest (step 3), splits each citing sentence into its individual claims, and finds the most relevant passage in each source, shown side by side with the claim (step 4).

Step 5 stays yours on purpose: CiteFirm never declares a citation “true.” You read the claim next to the passage, record the verdict, and export the whole thing as a shareable verification record (.cfv) that anyone can open to see the evidence. Extraction and manual review are free; the AI steps are part of Pro.