Hallucinated Citations:How to Verify AI-Generated References

Hallucinated citations can seem ready to paste into your manuscript, and an AI-generated reference may appear complete and credible. Each may include an author, plausible title, journal name, publication year, and even a DOI. However, a complete citation is not necessarily accurate.

Sometimes the article does not exist. In other cases, the article is real, but the year is wrong, the DOI belongs to a different article, or the source does not support the statement citing it. The University of British Columbia (UBC) Library cautions that generative AI can produce convincing citations for articles that do not exist or do not belong to the journal listed in the reference (see UBC Library: Evaluating Information from Generative AI).

To verify AI-generated references before including them in a research paper, check three things: whether the source exists, whether its bibliographic details are accurate, and whether the source supports your claim. This guide explains each check and covers an easily overlooked detail: the publication year.

What Are Hallucinated Citations?

Hallucinated citations, also called hallucinated references, are AI-generated references that cite a nonexistent source or misrepresent a real one. A fabricated title may be paired with real researchers’ names, or details from separate publications may be combined into one convincing entry. Whether you are checking fake citations from ChatGPT or another AI tool, you must distinguish between the following three problems.

Problem	What you might find	What to do
A fabricated reference	No identifiable publication matches the cited work.	Search independently before treating the reference as usable.
Incorrect bibliographic details	A real paper has a different year, author list, journal, or DOI.	Rebuild the entry from the verified publication record.
An unsupported claim	The paper exists, but its findings do not support your sentence.	Revise the claim, locate the appropriate evidence, or remove it.

These problems require different corrections. Fixing a year does not establish that a paper supports your argument, and finding a working DOI does not confirm that it identifies the intended paper. Moreover, reference errors also occur without AI. The purpose of citation verification is to verify the evidence in your manuscript rather than to infer how a suspicious reference was created.

How to Verify AI-Generated References

Citation verification begins by locating the publication independently of the AI response. Follow these steps to check whether a reference is real and whether its bibliographic details are accurate.

Step 1. Search for the title independently

Start the search with the article title in a scholarly search service, a library discovery system, or a database appropriate for your field. For biomedical literature, PubMed is a useful starting point. Crossref can help identify publications registered with a DOI. If the exact title does not produce a match, try distinctive title words along with the first author’s surname. Remove the AI-provided year from your search, as an incorrect year can prevent finding the correct article.

Compare the results with the proposed reference, as a similar title alone is insufficient. Check the authors, journal, subject, and publication type before determining whether you have located the intended work. If you cannot find a match, try another relevant database, the journal archive, or a library catalog. One unsuccessful search does not prove that a source is fabricated. Consider the reference unverified until you can independently identify the source.

Step 2. Open the DOI and compare the destination

If the reference includes a DOI, follow it and inspect the destination page. Confirm that the title and authors match the citation, then check the journal and publication details. A DOI that successfully resolves may still point to an incorrect article. Do not treat a working link as proof that the citation is correct.

If you have a reference but no DOI, Crossref’s Simple Text Query can attempt to match the entry with the DOI. Crossref notes that incomplete metadata or multiple possible matches can require a manual evaluation. Review the returned record before accepting it. Do not add a DOI simply because it resembles the journal’s usual DOI pattern. If you cannot verify a reference, omit it rather than invent an identifier.

Step 3. Rebuild the reference from the verified record

Once you have identified the publication, compare each of the following fields with the publisher’s record or an appropriate bibliographic database:

·       Author names and order

·       Article title

·       Journal or book title

·       Publication year

·       Volume and issue, where applicable

·       Page range or article number

·       DOI or other relevant identifier

Importing a citation into your reference manager can reduce manual typing, but inspect the imported fields before formatting the final bibliography. Make corrections in the reference manager so that regenerating the bibliography does not restore the original error.

Check the Publication Year, Even When the Paper Exists

A practical tip from our content workflow: check the year separately. We have encountered AI-provided references with incorrect publication years, so recognizing the title or author should not end the verification process. This recommendation is based on experience rather than a measured error rate across AI tools. An incorrect year can be easy to miss because the rest of the reference appears familiar. The error can also create discrepancies between the reference list and an author-date citation in the text.

However, conflicting dates do not necessarily mean that AI invented one. A paper may appear online in one year and be assigned to a journal issue in another. PubMed explains that online-first and issue publication dates can differ, sometimes by more than a year. Moreover, PubMed records may include both dates (see PubMed User Guide: Publication Date).

Use this process when the dates conflict:

1.     Identify the version you are citing. Distinguish a preprint, online-first journal article, and article assigned to an issue.

2.     Check the publisher’s citation information and publication history. Separate publication dates from submission, acceptance, and website update dates.

3.     Apply the target journal’s reference style. Use the date that the style requires for that publication record rather than the earliest or latest year.

4.     Update the manuscript consistently. For author-date styles, check the reference entry and every corresponding in-text citation.

For example, suppose an AI-provided entry lists 2022, whereas the publisher records online publication in November 2023 and issue publication in February 2024. This scenario is illustrative rather than a reported test result. The 2022 date must be corrected, but choosing between 2023 and 2024 requires checking the publication record and citation style. Asking AI to guess again would not resolve that distinction.

Verify That the Source Supports Your Claim

After confirming the reference details, read the source. A bibliographic match confirms the paper’s identity, not its relevance. Assessing its relevance requires examining what the paper reports.

For each citation, identify the corresponding sentence in your manuscript and locate the relevant passage, result, or table in the source. Ask the following questions:

·       Did the study examine the population or setting described in the sentence?

·       Does the study report the outcome I am discussing?

·       Does the study design justify the strength of the wording?

·       Have I preserved any qualifications, uncertainty, and limitations?

·       Am I citing the original study or a review that discusses it?

Consider the illustrative example below.

Draft sentence	What the source actually reports	Appropriate response
“The intervention improves performance across all age groups.”	An association in a sample limited to university students.	Narrow the claim to the studied population and avoid unsupported causal wording.

Changing the reference format would not solve this problem. The sentence requires revision.

An abstract may help you assess relevance but consult the full text when your claim depends on detailed methods, subgroup results, numerical findings, or limitations. If you cannot access the necessary material, ask your library for assistance or look for a legitimate, accessible version. Do not cite a result on the basis of an AI summary alone.

Check the publisher’s page for corrections, retractions, or other updates that could affect your citation of the article. Record the location of the supporting evidence in your research notes so that you or a coauthor can revisit the records during revision.

Citation Verification Checklist Before Journal Submission

☐ I can locate every cited source independently of the AI response.

☐ Titles, authors, journal names, and other bibliographic details match the verified records.

☐ I checked publication years separately and resolved differences between publication versions or dates.

☐ Each DOI identifies the intended work.

☐ I consulted the passages needed to support the claims in my manuscript.

☐ My wording reflects the study population, methods, results, and limitations.

☐ I checked relevant publication updates, including corrections or retractions.

☐ In-text citations and the reference list agree after revisions.

☐ Unresolved references are not presented as verified evidence.

☐ I checked the target journal’s requirements for disclosing any AI assistance used.

Verification and disclosure serve different purposes. A disclosure explains the role of AI in your work but does not establish the accuracy of the references. The International Committee of Medical Journal Editors (ICMJE) places responsibility for reviewing AI-assisted content and citing appropriate sources with the human authors (see ICMJE: Use of Artificial Intelligence in Publishing). For the disclosure step, see the Wordvice guides to journal AI policies and AI disclosure statements for research papers.

Frequently Asked Questions

Does ChatGPT make up references?

Yes. ChatGPT can generate references that do not exist. Fake ChatGPT citations may also include invented titles, incorrect publication details, or combine details from separate papers. Treat a suggested citation as a lead to investigate. Locate the publication independently, check its details, and read the relevant material before citing the source as evidence.

Is a reference real if its DOI works?

Not necessarily. A working DOI identifies a registered object, but you must still confirm that it indicates the work described in your citation. Compare the title, authors, and publication details on the destination page. Then, check whether the source supports your claim.

Does a missing DOI mean a reference is fake?

No. Many legitimate sources (e.g., older articles, books, and some conference papers) do not have DOIs. Search for the source by title and author in the publisher’s archive, appropriate database, or library catalog. Do not reject a source solely because it lacks a DOI, and do not invent one to complete the entry.

What if AI provides the correct title but the wrong year?

Check the publisher’s record and identify the relevant publication version. Resolve any online-first and issue-date differences based on your target reference style, then update the reference and corresponding author-date citations.

Can I ask another AI tool to verify the references?

You can use an AI citation checker or another tool to help locate records, but its agreement is not independent evidence that a citation is correct. Follow the links the tool provides and inspect the underlying publication. If the tool cannot provide a verifiable source, consider the reference unresolved.

Can an AI citation checker verify my references?

An AI citation checker can help locate publication records and flag potential reference errors, but its results still require review. Check what the tool’s “verified” label means: a formatting check or DOI match does not establish that the source supports your claim. Open the underlying publication, confirm its bibliographic details, and read the relevant passages before citing it.

Prepare a Clear, Well-Supported Manuscript

Citation verification helps readers and reviewers follow your evidence and helps you identify hallucinated references before submission. Check the source’s existence, bibliographic details, and relevance to your argument before focusing on the final presentation of the manuscript.

Once you have verified your sources, Wordvice’s academic editing service can help refine the grammar, clarity, and academic expression in your manuscript. As always, the source verification and scientific interpretation remain the authors’ responsibility.