AI Operations · established evidence

Who's Liable When Your Chatbot Lies? The Legal Reality of Deployed Business AI

Last reviewed 2026-07-20. Written by Chandranshu Kumar, Founder, Raveneye Global. · 11 min read

Chatbot liability is now a settled question at the level of principle: a business legally owns what its deployed AI tells the public, and it cannot delegate that responsibility to the software. In the first adjudicated test of the idea, a Canadian tribunal held Air Canada responsible for a wrong answer its website chatbot gave a grieving customer, ruling that a company is accountable for all information on its site whether it comes from a static page or a bot, and rejecting the argument that the chatbot was a separate legal actor. In the United States, the Federal Trade Commission drew a parallel line by acting against firms that overstated what their AI could do. The two records point the same way. If your bot states a price, a policy, a service area or a claim, the law treats those words as your words, which makes evaluating what the bot actually says a legal precaution, not a technical nicety.

The Air Canada chatbot ruling that settled who owns a bot’s words

The foundational case is Moffatt v. Air Canada, 2024 BCCRT 149, decided by the British Columbia Civil Resolution Tribunal on 14 February 2024. A customer, planning travel after a family bereavement, asked the airline’s website chatbot about bereavement fares. The bot told him he could book at the regular price and apply for a bereavement discount retroactively within ninety days. That was wrong. Air Canada’s actual policy did not permit retroactive bereavement claims, a fact stated correctly elsewhere on the airline’s own website. Relying on the bot’s answer, the customer bought full-price tickets and was later refused the discount.

The tribunal found Air Canada liable for negligent misrepresentation and ordered it to pay the difference, damages of roughly CAD 650. The sum was modest. The reasoning was not. The tribunal held that the airline was responsible for all the information on its website, and that it made no difference whether that information came from a static page or an interactive chatbot. The company, not the customer, bore the burden of ensuring its automated agent was accurate.

Because the decision is a small-claims-level ruling from a Canadian civil tribunal, it does not bind a United States court, and readers should treat it as persuasive authority rather than settled national law. Its influence, however, is disproportionate to its dollar value: legal commentators across jurisdictions now cite it as the first clear statement of the principle that a business owns what its deployed AI says.

Negligent misrepresentation AI: the doctrine does not care that a machine spoke

The legal hook in the Air Canada matter was negligent misrepresentation, a long-established civil doctrine that predates the internet by generations. In broad terms it holds a party responsible when it makes a careless false statement that another party reasonably relies on to their detriment. The doctrine attaches to the statement and to the party that put it into the world. It has never required that a human personally utter each sentence.

This is why the automated origin of the answer did not rescue the airline. A chatbot is a channel the business chose to operate, populated with information the business is responsible for. From the doctrine’s point of view, an incorrect fare answer generated by a bot is no different from an incorrect fare answer printed in a brochure or read aloud by an undertrained agent. The company published it; the company answers for it.

The operational consequence follows directly. A generative system is engineered to produce fluent, confident language, which means it will state a wrong price or an invented policy with the same smoothness as a correct one. Every such confident-but-wrong statement is a candidate for exactly the kind of reliance the doctrine punishes. The liability surface of a bot is not its worst crash; it is its most plausible mistake.

The “the bot is a separate entity” defense that failed

Air Canada advanced an argument that many operators still assume will protect them: that the chatbot was, in effect, a separate legal actor responsible for its own statements. The tribunal rejected it plainly. There is no basis, it reasoned, for treating a component of a company’s own website as a distinct legal person that can absorb blame the company would otherwise carry.

The rejection matters far beyond one airline. It forecloses the most tempting mental model an owner can hold about a deployed bot, that the vendor, the model provider or the software itself stands between the business and the customer as a liability buffer. It does not. The business is the deploying party. The bot is its instrument. Responsibility runs to the party that chose to put the instrument in front of the public, which is a principle old enough that no novelty in the technology disturbs it.

FTC AI enforcement draws the same line for capability claims

The Air Canada matter concerns what a bot says to one customer. A parallel body of United States enforcement concerns what a business says about its AI to everyone. On 25 September 2024 the Federal Trade Commission announced Operation AI Comply, a sweep of five simultaneous actions against companies making unsubstantiated claims about artificial intelligence.

The headline target was DoNotPay, which had marketed itself as “the world’s first robot lawyer.” According to the Commission, the company had never hired or retained an attorney to review the legal documents its service produced, and had not tested whether those documents were valid or effective. The finalized order, entered in early 2025, bars DoNotPay from claiming that its service performs like a licensed professional without evidence to back the claim, and requires 193,000 US dollars in consumer redress along with notice to affected past subscribers.

Read together, the two records close a loop. Under the negligent-misrepresentation logic, a business is liable for the specific false statements its bot makes to customers. Under the FTC’s deception authority, a business is separately answerable for the capability claims it makes about the bot to the market. A firm can be exposed on both fronts at once: overstating what the AI can do in its marketing, and then having the AI understate, misstate or invent a fact in a live conversation.

Why deployed AI produces the statements that create liability

The liability is not hypothetical because the failure mode is measured. The clearest benchmark evidence comes from research on tool-using agents in realistic service settings.

Agents fail realistic tasks, and fail inconsistently

In the tau-bench study of tool-agent-user interaction in retail and airline customer-service scenarios, agents built on frontier models using standard constructs succeeded on fewer than half of realistic tasks. Consistency was worse than the raw success rate implies: repeating the identical task eight times, the same agent completed it only about a quarter of the time. A system that is right on one attempt and wrong on the next, given the same question, is precisely the profile that produces an occasional confidently wrong answer to a real customer.

A stranger can make the bot break its own rules

Accuracy is only one exposure. The OWASP Top 10 for Large Language Model Applications, in both its 2023 and 2025 editions, ranks prompt injection as the single highest risk, and the 2025 edition splits it into direct and indirect forms, the latter being hidden instructions smuggled inside content the model reads. For a bot that can quote, book or look things up, this means a carefully worded message from an outsider can make it ignore its instructions, disclose information or take an action it should refuse. The words it emits under manipulation are still, in the eyes of the Air Canada reasoning, the company’s words.

An AI chatbot disclaimer is not a reliable shield

A common reflex after reading the Air Canada outcome is to reach for a disclaimer: a line of small print telling users the bot may be inaccurate and that official policy governs. Air Canada, in fact, argued that its terms and the correct policy elsewhere on the site should have governed. The customer still recovered, because the tribunal found it was not reasonable to expect him to hunt for a contradiction between one part of the site and another when the bot had answered his question directly.

The lesson is not that disclaimers are worthless; it is that they do not convert a wrong answer into a lawful one. A disclaimer cannot cure a misrepresentation the user reasonably relied on, and it does nothing at all about the FTC’s separate concern with the truthfulness of capability claims. The durable protection is not a paragraph of legal text bolted onto an inaccurate system. It is making the system accurate, bounding what it is allowed to say and do, and being able to show that you checked.

Reading the record

The position here is neither alarmism nor dismissal. The core principle, that a business owns what its deployed AI says in public, rests on an adjudicated decision and a finalized regulatory order, and it is consistent with civil doctrine that long predates the technology. That much is established. What remains genuinely unsettled is how a United States court would apply the principle in a large-stakes case, since the foundational ruling is a modest Canadian tribunal decision rather than binding national precedent. The governance frameworks that describe the fix are sound but young, and the sharpest autonomy taxonomy is only months old. Treated as direction rather than certainty, the record still supports one unambiguous action: measure what your bot actually says and does before, not after, a customer or a regulator does it for you.

The evidence

Key findings, with their sources

  • A civil tribunal held Air Canada liable for negligent misrepresentation after its website chatbot gave a customer wrong information about bereavement fares, ruling the company responsible for all information on its site whether from a static page or a chatbot, and rejecting the argument that the chatbot was a separate legal actor. Damages were roughly CAD 650.

    established Moffatt v. Air Canada, 2024 BCCRT 149 (British Columbia Civil Resolution Tribunal, decided 2024-02-14); CBC News (2024-02-14); American Bar Association, Business Law Today.

  • The FTC’s Operation AI Comply (announced 2024-09-25) brought five simultaneous actions over unsubstantiated AI claims. The finalized DoNotPay order bars claiming the service performs like a licensed professional without evidence and requires 193,000 US dollars in consumer redress plus notice to past subscribers; DoNotPay had never retained an attorney to review its output.

    established U.S. Federal Trade Commission, Operation AI Comply press release (2024-09-25) and finalized In re DoNotPay order (early 2025), ftc.gov.

  • Agents built on frontier models succeeded on fewer than 50% of realistic customer-service tasks, and repeating the identical task eight times the same agent succeeded only about 25% of the time, evidence that deployed agents are inconsistent, not merely occasionally wrong.

    established Yao et al., "tau-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains", arXiv:2406.12045, 2024 (Sierra Research).

  • Prompt injection has ranked as the number-one risk in the OWASP Top 10 for LLM Applications in both the 2023 and 2025 editions, with the 2025 edition splitting it into direct and indirect (hidden-instruction) forms.

    established OWASP Foundation, "Top 10 for Large Language Model Applications", 2025 edition, owasp.org.

  • Klarna’s AI assistant handled 2.3 million conversations in its first month (likened by the company to roughly 700 full-time agents), but by May 2025 Klarna resumed hiring humans after complaints about generic answers and mishandled complex cases, and moved to a hybrid model that keeps a person reachable.

    established Fast Company, "Klarna tried to replace its workforce with AI"; CX Dive, customerexperiencedive.com, 2025.

  • The NIST AI Risk Management Framework defines governance as a continuous govern-map-measure-manage cycle rather than a one-time check, with the govern function infused across the others.

    established NIST, "AI Risk Management Framework (AI RMF 1.0)", NIST AI 100-1, January 2023, nist.gov/itl/ai-risk-management-framework.

  • The Cloud Security Alliance’s Agentic AI Autonomy Levels and Control Framework (v1.1) holds that autonomy must be deliberately granted and technically enforced, never assumed, prescribing tighter human control as impact and irreversibility rise.

    emerging Cloud Security Alliance, "Agentic AI Autonomy Levels and Control Framework", v1.1, 2026-01-29, cloudsecurityalliance.org.

Calibration

What is proven, what is promising, what is unproven

Evidence tierTacticsWhat the evidence says
EstablishedA business owns what its deployed AI says; overstated AI capability claims are actionable.Moffatt v. Air Canada, 2024 BCCRT 149 (adjudicated); FTC Operation AI Comply and finalized DoNotPay order (regulatory record); tau-bench and OWASP on the underlying failure modes.
EmergingGovern autonomy on a continuous cycle with a human-in-the-loop gate at each threshold of irreversibility.NIST AI RMF 1.0 (2023); Cloud Security Alliance Agentic AI framework v1.1 (published 2026, not yet battle-tested at scale).
ContestedHow a United States court would apply the ownership principle in a high-stakes dispute.The foundational ruling is a small-claims-level Canadian tribunal decision, persuasive rather than binding on US courts; no equivalent US appellate precedent is settled here.

Reference

Glossary

Negligent misrepresentation
A civil doctrine holding a party responsible for a careless false statement that another party reasonably relies on to their detriment. It attaches to the statement and to whoever published it, regardless of whether a human or an automated system produced the words.
Deployed AI
An AI system a business has put into live, public-facing use, such as a website chatbot, a voice agent or an automation that answers customers. In liability terms, its statements are treated as the deploying business’s own statements.
Prompt injection
An attack in which crafted input, sometimes hidden inside content the model reads, makes an AI system ignore its instructions, disclose information or take an action it should refuse. It is the top-ranked risk in the OWASP LLM Top 10.
Human-in-the-loop
A design pattern in which a person reviews or approves an AI system’s consequential actions before they take effect, concentrated at the points where a wrong answer or action would be costly or hard to reverse.
Operation AI Comply
A 2024 FTC enforcement sweep against companies making unsubstantiated claims about their AI products, including the action that produced the finalized DoNotPay "robot lawyer" order.

Straight answers

Frequently asked questions

Is my business legally responsible for what my chatbot tells customers?

At the level of principle, yes. The Air Canada ruling held that a company is responsible for all information on its site whether it comes from a static page or a chatbot, and treated the bot’s wrong answer as the company’s own misrepresentation. That decision is a Canadian tribunal case and is persuasive rather than binding in the United States, but it reflects long-standing civil doctrine and is widely cited as the foundational statement of the rule.

Does a disclaimer protect me if my bot gives a wrong answer?

Not reliably. In the Air Canada matter the airline pointed to correct information elsewhere on its site, and the customer still recovered, because it was not reasonable to expect him to hunt for a contradiction when the bot had answered him directly. A disclaimer does not convert a misrepresentation the user reasonably relied on into a lawful one, and it has no bearing on the separate FTC concern with truthful capability claims.

Can I blame the AI vendor or the model provider instead of my business?

The Air Canada tribunal rejected the argument that the chatbot was a separate legal actor. Responsibility runs to the party that chose to deploy the system in front of the public. A vendor contract may allocate risk between you and the vendor privately, but to the customer and to a regulator, the deploying business is the one answerable for what the bot said.

What did the FTC actually require of DoNotPay?

The finalized order bars DoNotPay from claiming its service performs like a licensed professional without evidence to support the claim, requires 193,000 US dollars in consumer redress, and requires notice to affected past subscribers. The Commission found the company had never retained an attorney to review its output and had not tested whether its generated documents were valid.

How would I know if my deployed bot is exposing me to this risk?

You measure it directly. An independent evaluation tests the bot against your own approved facts to find where it is confidently wrong, and red-teams it for manipulation such as prompt injection, capturing every failure with the exact prompt that triggered it. That read is the starting point before a customer or a regulator finds the failure first.

Provenance

Sources

  1. Moffatt v. Air Canada, 2024 BCCRT 149 (British Columbia Civil Resolution Tribunal, decided 2024-02-14) (established)
  2. CBC News, "Air Canada found liable for chatbot’s bad advice", 2024-02-14 (established)
  3. American Bar Association, Business Law Today, summary of Moffatt v. Air Canada, 2024 (established)
  4. U.S. Federal Trade Commission, Operation AI Comply press release, 2024-09-25, ftc.gov (established)
  5. U.S. Federal Trade Commission, finalized In re DoNotPay order, early 2025, ftc.gov (established)
  6. Yao, S. et al., "tau-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains", arXiv:2406.12045, 2024 (established)arxiv.org
  7. OWASP Foundation, "Top 10 for Large Language Model Applications", 2025 edition, owasp.org (established)
  8. NIST, "AI Risk Management Framework (AI RMF 1.0)", NIST AI 100-1, January 2023 (established)doi.org
  9. Cloud Security Alliance, "Agentic AI Autonomy Levels and Control Framework", v1.1, 2026-01-29 (emerging)labs.cloudsecurityalliance.org
  10. Fast Company / CX Dive, reporting on the Klarna AI customer-service reversal, 2025 (established)
  11. AI Incident Database #1152, coding-agent database-deletion incident, July 2025; Fortune (2025-07-23) (established)

Every figure above is attributed to a real, dated source and tagged with its evidence tier. Where a claim could not be verified to a primary source, it is not stated as fact.

What this means for your business

The law treats your bot’s words as your words, which turns one quiet question into an urgent one: does your deployed AI actually say what you think it says, and can you prove you checked? Most owners have never once tested for the confident wrong answer or the injected instruction that creates the exposure. An Agent Evaluation and QA Audit is an independent read that measures your agent against your own approved facts and red-teams it for manipulation, so you understand your real liability before a customer or a regulator does.

diagnostic Agent Evaluation & QA Audit An independent inspection of an AI system already in production. A specialist scores its accuracy against your facts, deliberately tries to break it, and delivers a ranked findings report with the exact prompt behind every failure. For a standing cadence across multiple systems, it rolls up into the AI Governance & QA Program. See how it works

Start free with a Machine-Readiness Score, a specialist-reviewed read of where you stand across search and AI answers. No guaranteed number, and no obligation.