Back to Lessons
beginner11 min11 min read

What AI Can't Do: A Healthy Skeptic's Guide

AI is brilliant and also profoundly limited. A friendly field guide to the things it gets wrong, so you can use it without being burned by it.

What you will learn

  • List the five major categories of AI limitations
  • Explain why AI confidence is not the same as AI accuracy
  • Apply a skeptic's checklist to important AI answers
  • Use knowledge of limits to get better results

The Honest Version

Every AI demo looks like magic. Every real-world AI failure looks like user error. Neither is quite true. AI is a powerful tool with specific, predictable weaknesses - and knowing them is the difference between using AI and being used by it.

The Big Five Things AI Can't Do (Yet)

1. Guarantee Accuracy

AI doesn't know what's true. It knows what's likely based on its training. For anything important - medical, legal, financial - treat AI output as a draft from a smart intern, not a verdict from an expert.

2. Know What's Current

Most models are trained on data that's months or years old. They don't live on the internet unless you give them a search tool. Ask about last week's news without search and you'll get last year's answer, confidently delivered.

3. Count and Calculate Reliably

LLMs are language machines, not calculators. They can do basic math but will confidently flub multi-step arithmetic. For any real calculation, ask the AI to write you a spreadsheet formula and do the math in the spreadsheet.

4. Understand Your Context Automatically

It doesn't know your company, your customers, your history - unless you tell it. AI answers based on what you write, and what you don't write. Vague prompt, vague answer. That's not the AI being dumb; it's missing information.

5. Make Decisions for You

AI can present options brilliantly. It cannot weigh your values, your risk tolerance, or the thing your gut is telling you. Delegating the decision is the one thing you should never delegate.

The Skeptic's Checklist (Run This on Every Important Answer)

  • [ ] Would I trust this from a random internet stranger? Then don't trust it from AI without checks
  • [ ] Does it cite sources? If not, ask for them
  • [ ] Can I verify the key claim in 60 seconds? Do it
  • [ ] Is the answer suspiciously confident? Confidence is not accuracy
  • [ ] Would a small error matter here? If yes, verify harder

Why This Makes AI More Useful, Not Less

Here's the counterintuitive part: accepting AI's limits makes you better at using it.

  • You stop trusting it blindly, so you stop getting burned
  • You start giving it better context, so you get better answers
  • You use it for what it's great at (drafts, ideas, summaries) and skip what it's bad at (final truth, decisions)

A skeptic gets ten times more value from AI than a true believer, because the skeptic keeps it in its lane.

Try This Today

Ask any AI chatbot: "What happened in the world last week?" Then ask it: "How sure are you about that?" Watch how confidence and accuracy diverge. That lesson is worth the whole course.

The One-Line Summary

Use AI for the first 80 percent, verify the important last 20, and never outsource your judgment.

ai-limitsskepticismhallucinationsai-safetybasics
🤖

Almost Done!

Made it to the end — nice work. Record your achievements to update your smart-assistant profile.

Scroll progress: 0% • Finish reading down to complete.