Check if Something Was Written by ChatGPT: AI Detection Guide

Download Article

Detect AI-generated content using simple tools and context clues

Co-authored by Nicole Levine, MFA Reviewed by Stan Kats

Last Updated: June 25, 2024 Fact Checked

Download Article

How AI Detection Tools Work

|

Using AI Detection Tools

|

Signs of ChatGPT Use

|

Q&A

|

Tips

With the rising popularity of ChatGPT, Bard, and other AI chatbots, it can be hard to tell whether a piece of writing was created by a human or AI. There are many AI detection tools available, but the truth is, many of these tools can produce both false-positive and false-negative results in essays, articles, cover letters, and other content. Fortunately, there are still reliable ways to tell whether a piece of writing was generated by ChatGPT or written by a human. This wikiHow article will cover the best AI detection tools for teachers, students, and other curious users, and provide helpful tricks for spotting AI-written content by sight.

Things You Should Know

Tools like OpenAI's Text Classifier, GPTZero, and Copyleaks can check writing for ChatGPT, LLaMA, and other AI language model use.
AI-generated content that have been passed through paraphrasing tools may not be reliably detected by standard AI content detectors.^{[1]
X
Research source}
ChatGPT often produces writing that looks "perfect" on the surface but contains false information.
Some signs that ChatGPT did the writing: A lack of descriptive language, words like "firstly" and "secondly," and sentences that look right but don't make sense.
AI writing may lack a consistent tone, style, or perspective throughout a piece.
AI-generated text usually lacks authentic personal experiences or specific real-world examples.
AI may struggle with nuanced cultural or contextual references that a human writer would naturally include.

Section 1 of 3:

How AI Detection Tools Work

Download Article

1
AI detection tools evaluate how predictable the text is. ChatGPT, Bard, and similar chatbots "write" content by predicting the next word or sentence based on its training data. Similarly, AI detection tools also work by detecting how predictable the words, sentences, and format are based on similar training data.
- The detection tool compares a piece of writing to similar content, decides how predictable the text is, and labels the text as either human or AI-generated.
- These tools also look for other indicators, or "signatures" that are associated with AI-generated text, such as word choice and patterns.^{[2]
  X
  Research source}
2
AI detectors often make mistakes. ChatGPT detection tools can be helpful, but they aren't infallible. AI detectors often produce false positive results, meaning that they tend to flag human-written text as AI-generated if it follows certain patterns.^{[3]
X
Research source} It's also quite easy for students and other writers to modify content written by ChatGPT to make it virtually undetectable by AI detectors, meaning that AI-generated writing could fly under the radar of the detector.
- If an AI detection tool reports that a piece of writing was mostly AI-generated, don't rely on that report alone. It's best to only use AI detection tools if you've already found other signs that the writing was written by ChatGPT.^{[4]
  X
  Research source}
- Running a piece of writing through multiple AI detection tools can help you get an idea of how different tools work. It can also help you narrow down false-negatives and false-positives.

Section 2 of 3:

Using AI Detection Tools

Download Article

This free tool created by the same people who brought us ChatGPT predicts how likely it is that a piece of writing was generated by an AI language model. You'll need a free OpenAI account to use AI Text Classifier. For now, you can only paste a piece of writing into the tool, but the option to upload documents may be available in the future.
This AI-detection tool was developed by a student at Princeton University in an effort to combat AI plagiarism.^{[5]
X
Research source} GPTZero gives you the option of pasting or uploading documents to check for ChatGPT and other AI-generated writing, and you can evaluate up to 5000 words per document with the free (Classic) version of the tool. Paid options are available, including a subscription designed for teachers. You can use the tool in your web browser, or by installing the Chrome Extension or Word plugin.^{[6]
X
Research source} Visit https://gptzero.me to create a free account.
This free online ChatGPT detector was developed by an AI content creation company. Their focus is to help writers who use ChatGPT and other AI content generators edit their work before publishing so it won't be so obvious that it's AI written.^{[7]
X
Research source} You can paste 25 words or more into this tool. Try it out at https://contentatscale.ai/ai-content-detector.
If you're looking for a premium ChatGPT detector that's secure and equipped to detect content written by GPT-4 (the newest version of OpenAI's language model that's only available in ChatGPT Plus), Copyleaks has a variety of subscription plans for checking work for AI plagiarism. Without a paid subscription, you can still evaluate up to 250 characters of writing for ChatGPT, Bard, and other AI chatbot use.^{[8]
X
Research source} Give it a try at https://copyleaks.com/ai-content-detector.

Section 3 of 3:

Signs of ChatGPT Use

Download Article

1
Implausible or inaccurate statements. ChatGPT, Google Bard, and other generative AI tools are known to hallucinate or make up facts.^{[9]
X
Research source} While students and job applicants can also include inaccuracies in their writing, AI bots make false information seem extremely believable. ChatGPT also has limited knowledge of events that occurred after 2021, which means it usually can't produce factual information about current events.^{[10]
X
Research source} If the writing seems very well-written but contains false information, it could be AI generated.
- If you're evaluating a piece of writing for potential AI use, try searching the web for a few facts from the text. Try to search for facts that are easy to verify—e.g., dates and specific events.
ChatGPT can create grammatically perfect sentences that don't make sense, even though they look great on the surface. This is because ChatGPT doesn't know whether something is true or false—it only knows how to use the right kind of word in the right place. If you find yourself rereading something that looks like it should make sense, but you can't grasp what the sentence is trying to say, there's a good chance you're looking at AI-generated writing.
While many school-age essay writers also use this type of language when laying out their essays, you'll almost always see these words in ChatGPT-written essays. Some AI detection tools will even flag human-written content as AI-written because it includes these terms.
While the version of ChatGPT that's built into Bing cites sources automatically, the standard version of ChatGPT tends to make up sources that don't exist.^{[11]
X
Trustworthy Source

PubMed Central
Journal archive from the U.S. National Institutes of Health

Go to source} If you're a teacher evaluating a student essay or a student who uses ChatGPT to find sources, double-check the sources provided by ChatGPT to make sure they're real.
AI models like ChatGPT work by predicting the next word in a sentence, which results in lots of non-specific words like "it," "is," and "they." Because ChatGPT is less likely to use rarer words to describe things, an overall lack of descriptive language could mean that ChatGPT wrote the content.^{[12]
X
Research source}

EXPERT TIP

Tyrone Showers
Technologist
Tyrone Showers is a Technologist and the Co-owner of Taliferro Group, an IT consulting company based in Seattle, Washington. With over 35 years of professional experience, he specializes in API Design, e-Commerce, Operational Efficiency, and website development. He has a B.S. in Computer Science from DeVry Institute of Technology.

Tyrone Showers
Technologist

Spotting AI-written text on your own can be a real challenge. Look for grammatically correct but robotic language lacking humor and personal touches. A writer's sudden shift towards perfect language can also indicate AI involvement. Remember, human writing can share these traits, so considering the context is crucial.
While students, job applicants, and authors do their best to catch all grammatical and spelling errors before turning in their writing, it's hard to catch everything. Computers, on the other hand, produce grammatically impeccable work—even if it the writing isn't factual.
7
Ask ChatGPT to produce a similar piece of writing when in doubt. If you think ChatGPT wrote an essay, letter, or other bit of text, log in to ChatGPT and ask the chatbot to create similar content using the writing's main points. If ChatGPT's response contains the same structure as the piece of content you're evaluating, it's possible the writer used ChatGPT.
- For example, if you're evaluating a cover letter for AI use, you might tell ChatGPT, "Write me a cover letter for a junior developer position at Company X. Explain that I graduated from Rutgers with a Computer Science degree, love JavaScript and Ruby, and have been working as a barista for the past year."
- Because ChatGPT is conversational, you can continue providing more context. For example, "add something to the cover letter about not jumping right into the industry after college because of the pandemic."

Community Q&A

Search

Add New Question

Question

How can I tell if someone's used ChatGPT?

Lewis Carhart

Community Answer

Copy the text into an AI Content Detector tool. Bear in mind that no content detection tools are 100% reliable.

Thanks! We're glad this was helpful.
Thank you for your feedback.
If wikiHow has helped you, please consider a small contribution to support us in helping more readers like you. We’re committed to providing the world with free how-to resources, and even $1 helps us in our mission. Support wikiHow
Yes No

Not Helpful 0 Helpful 3

Ask a Question

200 characters left

Include your email address to get a message when this question is answered.

Submit

Tips

Cornell researchers determined that humans incorrectly found AI-generated news articles credible more than 60% of the time.^{[13]
X
Research source}

Thanks
Helpful 1 Not Helpful 0
If you're using a ChatGPT detection tool that identified writing as AI-written, consider that it may be a false positive before approaching the situation with the writer.

Thanks
Helpful 2 Not Helpful 0
If you suspect ChatGPT wrote something but can't tell for sure, have a conversation with the writer. Don't accuse them of using ChatGPT—instead, ask them more questions about the writing or content to make their knowledge lines up with the content. You may also want to ask them about their writing process to see if they admit to using ChatGPT or other AI writing tools.

Thanks
Helpful 1 Not Helpful 0