keepcalculator

06 Numbers and Powers

AI Washing in Tech: How to Spot Inflated Claims

Card No. 06·24499 · Updated · Standard formula, shown below

AI washing is the practice of overstating or misrepresenting how much artificial intelligence a product or service actually uses. To spot inflated claims in a tech announcement, look past the label and ask what the system does, what evidence supports the claim, and whether AI meaningfully contributes to the advertised result.

What AI washing means

The phrase borrows from “greenwashing,” the misleading presentation of a product as environmentally friendly. AI washing describes marketing or public statements that make a technology seem more AI-driven, capable, autonomous, or novel than the available evidence warrants. It is a useful shorthand, not a precise technical or legal category with one universal definition.

Some announcements use “AI” loosely because it attracts attention. Others describe a genuine feature but omit important qualifications: perhaps it works only on a narrow set of tasks, needs substantial human review, or depends on an outside service. A claim can therefore be inflated without the underlying technology being wholly fake.

Nor does every broad use of the term prove misconduct. “AI” covers many techniques, from machine-learning models that classify data to generative systems that produce text, images, or code. Companies may also use the term differently from engineers. The practical question is not whether a product contains any AI at all, but whether the announcement gives a fair picture of what the AI does and how well it does it.

Why announcements can be hard to evaluate

Product releases compress complicated systems into short claims. Phrases such as “AI-powered,” “intelligent,” or “autonomous” do not specify the model, task, data, or level of human involvement. A feature might use a model for one small step while most of the product relies on conventional software. Conversely, a company may use AI in a substantial way without publishing every technical detail.

There are also real limits to what an announcement can establish. A demonstration shows that a system produced an output in a particular setting; it does not by itself show that the result is reliable across users, languages, edge cases, or everyday conditions. A benchmark score can be informative, but its value depends on what was measured and whether the benchmark resembles the actual task.

Keep three questions separate: Does the system use an AI technique? Does that technique perform the advertised function? And is the resulting product useful and dependable in practice? Evidence for the first does not automatically prove the other two.

A practical checklist for reading claims

Use these checks when evaluating a launch post, press release, product page, or executive interview:

  • Identify the task. Replace “AI-powered” with a specific verb: Does it summarize, recommend, detect, generate, rank, or automate something? If the announcement never says, the claim is difficult to assess.
  • Find the boundary. Look for the supported inputs, languages, formats, users, and situations. “Can answer questions about your files” is not the same as “can answer every question accurately.”
  • Check human involvement. Does a person approve suggestions, correct outputs, or handle exceptions? “Automated” may mean only that some steps happen without manual entry.
  • Look for measurable evidence. Useful details may include an evaluation method, comparison baseline, sample size, error rates, or documented limitations. Ask whether the test measures the advertised job rather than an easier substitute.
  • Trace the source of the capability. Is the model developed in-house, supplied by another company, or accessed through an API? Using an external model is not inherently misleading, but a vague announcement may obscure who provides the feature and what happens when that service changes.
  • Compare the claim with the product. Release notes, help pages, demonstrations, and user documentation may reveal whether the feature is available now, limited to a preview, or dependent on a particular plan or setup.

For example, “our assistant understands your business” is a broad claim. A more checkable description would say that it searches specified company documents and drafts responses, identify any supported file types, explain that a user should verify answers, and show how performance was evaluated. The latter is not automatically true just because it is more detailed, but it gives readers facts they can investigate.

Evidence, benchmarks, and demonstrations

Evidence is strongest when it matches the claim. If a company says a tool reduces the time needed to categorize support requests, an evaluation should involve representative requests and state how time and accuracy were measured. A benchmark on a different task may show general model capability, but it cannot establish that the company’s product improves a particular workflow.

Useful questions include: Who ran the evaluation? Was it independent or conducted by the vendor? What was the comparison point? Were unsuccessful cases counted? Did human reviewers know which outputs came from the system? A vendor-run test can still be useful, but readers should understand its source and scope.

Watch for cherry-picked demonstrations. A polished example can illustrate a feature, but it is not a reliability study. Ask whether the demo is repeatable, whether the system needed a carefully prepared prompt or input, and what happens when it encounters missing or conflicting information. If a company publishes only a standout result, that alone does not establish typical performance.

Common warning signs—and what they do not prove

Potential warning signs include impressive capability claims with no defined task, “human-level” language without a clear comparison, sweeping promises of autonomy, and a lack of information about errors or oversight. Another clue is when the announcement emphasizes the AI label but provides little explanation of what changed for the user.

These signs justify follow-up questions; they are not proof of deception. Early products may have limited documentation, and companies may protect trade secrets or user data. The absence of public technical detail is a reason to lower confidence in a claim, not a basis for asserting that a product uses no AI.

Similarly, a familiar feature is not automatically AI washing. Search, spam filtering, recommendations, and image recognition can use AI, conventional rules, or a combination. The method matters less to users than a truthful description of capability, limitations, and results. Avoid treating any one technical term—or the mere presence of a model—as a verdict.

How to judge a claim without being an expert

You do not need to identify a model architecture to evaluate an announcement. Focus on what a buyer or user can verify: the promised task, the conditions under which it works, the role of people, the quality evidence, and the consequences of mistakes. If a claim affects an important decision, seek documentation or independent evaluations rather than relying on a promotional demo.

A practical confidence scale is more useful than a binary label. A specific claim backed by relevant, transparent testing deserves more confidence than a vague slogan. A narrow feature with clear limitations may be credible even if it is not revolutionary. A sweeping claim with no method or evidence should be treated as unverified until better information appears.

For journalists, procurement teams, and investors, record the exact wording and date of an announcement, then compare it with product documentation and later evidence. Capabilities can change over time, and a preview may not represent a generally available release. Rechecking the claim later helps distinguish a temporary limitation from a promise that was never substantiated.

Frequently Asked Questions

What is an example of AI washing?
An example would be advertising a product as an autonomous AI analyst when it mainly applies fixed rules or produces drafts that require extensive human work, without disclosing those limits. The label alone is not enough to establish that a specific company has done this.

Is every product that says “AI-powered” misleading?
No. The phrase may describe a real capability, but it is too broad to explain what the system does or how reliably it does it. Check the feature’s specific function, scope, and supporting evidence.

How can I tell whether a product really uses AI?
Look for technical or product documentation describing the feature, its inputs and outputs, and the provider or model involved. Public information may not reveal every implementation detail, so distinguish evidence that AI is used from evidence that the product performs well.

Are AI benchmarks reliable proof of a product claim?
They can provide useful evidence when the benchmark is relevant, the method is explained, and the results are compared fairly. A score on a general test does not by itself prove that a specific product works accurately in a real-world setting.

What should I do if an AI announcement gives no evidence?
Treat its performance claims as unverified. Look for documentation, limitations, representative evaluations, and details about human review; if those are unavailable, avoid assuming the advertised capability is established.

Related

Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.

More cards in this drawer

The whole Numbers and Powers drawer →