Spot Fabricated Citations and Claims in AI Text

Fabricated citations and unsupported claims can make plausible writing look trustworthy when it is not. Use this guide to check whether a source exists, supports the statement attributed to it, and is reliable enough for your purpose. You will need the text, access to a search engine or library catalogue, and time to open the original sources.

What You’ll Need

The complete text, including its citations, footnotes, links, and bibliography.
A web search engine and, for scholarly work, access to a library catalogue or academic database.
A way to record findings, such as a document or spreadsheet with columns for claim, citation, verification result, and notes.
For high-stakes material, a subject expert or authoritative primary source to consult.

Step-by-Step

Separate factual claims from interpretation. Read the text once and mark statements that could be checked: dates, figures, quotations, study results, named laws, historical events, and claims about what a source found. Distinguish these from opinions, recommendations, or transitions. Break sentences containing several facts into separate claims; one citation may support only one part.
Make an inventory of every citation. Note in-text references, numbered notes, hyperlinks, and bibliography entries. Match each citation in the body to a full reference, and flag references that appear in the list but are never used. Missing details, inconsistent author names, and incomplete publication information are warning signs, not proof of fabrication.
Search for the source using its exact details. Search a distinctive title in quotation marks, then try the author’s name, publication, year, and any DOI or other identifier. Check the publisher’s site, a library catalogue, a journal archive, or a recognized scholarly index. For books, verify the title, author, edition, and publisher; for articles, check the journal, volume, issue, pages or article number, and publication date. Do not assume that a plausible-looking DOI or URL is valid: open it and confirm that it resolves to the cited work.
Check that the reference is real and correctly described. Compare the text’s reference with the source record. A real author may have written a similarly titled work, or a real article may be attributed to the wrong journal or year. Confirm that the source type, title, author list, date, and identifier agree. If you cannot locate it, search key title words without quotation marks and check spelling, alternate title forms, and institutional repositories before labeling it fabricated.
Open the original source, not just a search snippet. Search results, abstracts, and summaries can omit qualifications or reproduce errors. Read the relevant passage in the article, report, book, dataset, or official document. If the source is paywalled, use an accessible abstract or repository copy cautiously, and say when you cannot verify the full text.
Test whether the source actually supports the claim. Compare the exact wording and scope. Check the population, location, timeframe, method, and conditions. A study about a small group does not automatically prove a claim about everyone; an association does not establish cause; a preliminary result does not necessarily show settled consensus. Record whether the source directly supports the statement, supports only a narrower version, contradicts it, or says nothing relevant.
Verify quotations and numbers precisely. Search a quotation within the source and compare the wording, punctuation, context, and speaker. For statistics, find the original table or passage and check the unit, denominator, date range, sample, and whether the text has confused percentages with percentage points. Recalculate simple totals or percentages when possible, while noting any assumptions.
Assess source quality and currency. A citation can be genuine but weak, outdated, or irrelevant. Prefer primary documents for what an organization or law says, and well-supported reviews or research for broader evidence. Check who produced the source, its methods, editorial or review process, and potential conflicts. For changing subjects, look for updates and later evidence; an old source is not automatically false, but may no longer describe the current situation.
Assign a clear result and revise the text. Use labels such as “verified and supports,” “real but misrepresented,” “not located,” “contradicted,” or “insufficient evidence.” Treat “not located” as unresolved rather than proof of invention. Replace unsupported wording with a narrower, sourced claim, remove it, or clearly identify it as uncertain. Keep a brief record of the sources and searches so another reader can repeat the check.

Common Mistakes

Checking only whether a citation exists. A real source can be cited for a conclusion it never reached. Verify the relevant passage, not just the bibliographic record.
Trusting polished formatting. A convincing journal title, DOI, or publisher name can still be wrong. Resolve identifiers and compare records against the publisher or catalogue.
Calling every failed search fabricated. Spelling variations, older editions, incomplete indexing, and paywalls can hide legitimate sources. Record uncertainty and try alternate search terms.
Accepting secondary summaries as proof. A blog or another article may repeat the same mistake. Trace important claims back to the original evidence.
Ignoring qualifiers and context. Words such as “may,” “in this sample,” or “under these conditions” can change a finding substantially. Read around the cited passage.

Tips

Prioritize claims that could materially affect a decision, and check unusual numbers, quotations, and highly specific claims first.
Search distinctive phrases from a title or quotation, but also search author plus topic in case wording differs from the citation.
Use more than one independent source for important claims. Agreement is most useful when sources do not all trace back to the same report.
Keep “source authenticity” separate from “claim accuracy”: a genuine source can be mistaken, biased, outdated, or misquoted.
When you correct a claim, preserve its original qualification and avoid replacing one overstatement with another.

Troubleshooting

The citation cannot be found. Check spelling, initials, title variants, publication year, and alternate editions. Search the DOI or identifier separately, then try the publisher, library catalogue, and repository. If it remains unavailable, label it “not located” and do not rely on it until verified.

The source is behind a paywall. Look for an author-accepted manuscript in an institutional repository, a legitimate open-access copy, or a library copy. An abstract can help identify the topic and methods, but may not establish that a detailed claim or quotation is supported.

The source exists but does not match the claim. Check whether the text has combined findings from multiple sources or omitted a limitation. Narrow the statement to what the source supports, find a better source, or remove the claim.

Sources disagree. Compare publication dates, methods, definitions, and populations rather than choosing the source that matches the text. Explain the disagreement or present the most defensible conclusion with its limits. For a consequential decision, seek qualified subject-matter review.

Frequently Asked Questions

Does an unfindable citation prove that it was fabricated?
No. It may be incomplete, misspelled, unindexed, or inaccessible. Report that you could not verify it unless you find evidence that the cited work does not exist or the details were invented.

Can a real citation still be misleading?
Yes. It may not support the claim, may be quoted out of context, or may describe a narrower population or result.

Are DOI links enough to verify a paper?
No. Open the identifier and compare the resulting record with the cited title, authors, journal, and date. A valid link alone does not show that the paper supports the claim.

How many sources should I check?
Check every citation used for a consequential factual claim. For lower-priority material, prioritize precise, surprising, disputed, or decision-relevant statements and note what remains unchecked.

What should I do with a claim that has no citation?
Look for reliable evidence independently. Add a source if one supports it, qualify the statement, or remove it if it cannot be substantiated.

Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.

More cards in this drawer

The whole Numbers and Powers drawer →