⚖️ Ethics

When NOT to Use AI (Critical Guardrails)

What you'll learn: where Claude fails, what Claude can't be trusted with, and how to know when AI is the wrong tool entirely.

⏱ 20 minutes

The part most courses skip: what Claude gets wrong

Every AI course tells you what Claude can do. This one tells you what Claude can't. That distinction saves you money, reputation damage, and legal problems down the line.

Here's what I mean: Claude is genuinely useful. But Claude is not careful. Claude is not cautious. Claude is not accurate by default. Claude is confident whether it's right or wrong.

Your job is learning the gap between confident and correct. That gap is where AI fails.

Hallucination: Claude making up facts with complete confidence

A hallucination is when Claude confidently states something false as if it's true. Not "I'm not sure" or "I don't have that information." Just wrong, presented as fact.

I learned this the hard way. I asked Claude for a list of competitors in my space. Claude listed three companies and gave their funding amounts. Specific numbers. Confident tone. All three funding amounts were wrong. I didn't know they were wrong until I checked the actual companies' websites.

That's a hallucination. Claude's training data had information about similar companies. Claude filled in the gaps with plausible-sounding guesses. The guesses sounded so good I almost believed them.

Where hallucinations hurt most: competitor research, financial data, technical specs, market statistics, anything Claude didn't see in its training data but sounds like it could exist. Claude will give you a confident answer. The answer is often wrong.

Bias and blind spots: what Claude assumes instead of asking

Claude was trained on the internet. The internet has biases. So Claude has them too. Not malicious ones. Just invisible assumptions baked in.

I asked Claude to write a professional email to an investor. Claude wrote something formal, buttoned-up, and corporate. It assumed professionalism meant business-formal tone. But my actual business voice is conversational. Claude's assumption missed me entirely and I had to rewrite it.

That's not a hallucination, that's a blind spot. Claude doesn't know what it doesn't know. It fills gaps with defaults from its training data.

💭 Sally's Close Call

I almost sent a financial proposal to a client that Claude drafted. The numbers Claude generated looked real. I was 10 minutes away from sending it before I actually checked them. They were completely wrong. Not by a little, by 40%. If that client had signed off on wrong numbers, my business reputation would have taken real damage. I verify everything now. Always.

Confidentiality: once it's in Claude, you can't take it back

Claude stores everything you type. If you paste customer data, passwords, financial records, or anything private into Claude, you're trusting Anthropic with that data. Anthropic is careful about privacy, but once the data is there, you can't undo it.

Never paste: customer names and emails, passwords or API keys, financial statements, health information, anything your business couldn't survive being made public.

A better move: describe the situation without the sensitive details. "I have 50 customer emails I want to analyze for common complaints" instead of "here are 50 customer emails... [paste them]."

Claude's data policy: Anthropic doesn't use your conversations to train new models, but your data is stored and could be reviewed by Anthropic staff for safety reasons. If that's not acceptable for your data, don't paste it.

Disclosure: when you must tell people AI created something

If you use Claude to create content your customers will see, you need to know disclosure rules. They're changing. Some platforms require you to label AI content. Some countries are putting laws in place.

Not disclosing creates liability. You're not just breaking platform rules, you could be breaking laws. Be honest about what's AI-generated.

This doesn't mean every Instagram caption needs "written with Claude." It means if you're using Claude to create something deceptive, stop. If you're using Claude to create something helpful, disclosing it builds trust, not loses it.

When AI is just overkill: knowing when to do it yourself

Not every task needs AI. Sometimes the fastest path is no AI at all.

I learned this when I tried to use Claude to draft my LinkedIn bio. Claude's output was polished and generic. I could have written it faster myself. I did. Two minutes, it was done, it sounded like me.

AI shines when: you're generating options quickly, you're repurposing existing content, you're working with large amounts of data. AI fails when: the task is simpler done by hand, the stakes are high and you need 100% accuracy, or you're using it to avoid thinking about a real problem.

🧠 Discernment Check: The AI Checklist

Before you use Claude for anything, answer these five questions:

  • Can Claude hallucinate on this task? (financial data, specs, facts it wasn't trained on = yes)
  • Does this task involve confidential data? (if yes, describe it without pasting the data)
  • Do I need 100% accuracy? (if yes, I'm verifying the output before using it)
  • Am I using this to avoid making a decision? (if yes, make the decision first, then use Claude)
  • Is AI actually faster than doing this myself? (if no, do it yourself)

Answer no to all five and you're good to go. Answer yes to any of the first three and you need a verification step before you use the output.

🚀 Try It Now

Watch Claude hallucinate

Go to Claude.ai right now. Ask this: "What was Sally from BuiltwithSally's first business before she started teaching AI?" You'll get a confident answer. It will be completely made up. Claude doesn't know, so it guesses. That's a hallucination happening live.

This is the most important lesson: **Claude will confidently tell you things that are false.** That's the default. Skepticism is the guardrail.

Quick check

3 questions

The guardrails every AI user needs to know.

Learn when NOT to trust Claude. Hallucinations, bias, confidentiality rules. Free course: https://builtwithsally.com