A user asks: "What year did World War 2 end?" Should you use Chain of Thought?

CoT is for complex reasoning tasks. Simple factual questions ("What year did X happen?") don't need step-by-step reasoning — they just need the AI to recall a fact.

Step-back prompting means:

Step-back prompting = zoom out first. Ask "what are the principles behind X?" before asking about X specifically. This activates broader knowledge and leads to richer answers.

Chapter 5 of 7·7 min read·Quiz included

🔗

Think Out Loud

Q: What does adding "Let's think step by step" to a prompt do?

Chain of Thought prompting forces AI to show its reasoning process. Like a student showing their math work, this leads to much more accurate answers on complex problems.

Step-back prompting and Chain of Thought

Show Your Work 📝

In math class, your teacher always says: "Show your work." Not because they enjoy reading your scratch paper — but because step-by-step thinking leads to correct answers. When you just guess, you're wrong more often. When you work through it step by step, you catch your own mistakes and arrive at the right answer. AI is exactly the same. Left to itself, AI will blurt out an answer without checking its logic. But when you ask it to "think step by step", something remarkable happens: it gets smarter.

😱 The Shocking Difference CoT Makes

Watch what happens with and without Chain of Thought on the SAME question:

Without Chain of Thought

When I was 3 years old, my sister was twice my age. Now I am 20. How old is my sister?

AI: “40 years old.”

Wrong! AI just doubled 20 without thinking about the age gap.

With Chain of Thought

When I was 3 years old, my sister was twice my age. Now I am 20. How old is my sister? Let's think step by step.

Step 1: When I was 3, my sister was 3×2 = 6 years old.
Step 2: The age gap between us is 6-3 = 3 years.
Step 3: My sister is always 3 years older than me.
Step 4: Now I am 20, so my sister is 20+3 = 23 years old.

Answer: My sister is 23 years old.

Correct! Just adding "Let's think step by step" fixed everything.

🎯 When Should You Use Chain of Thought?

✅Math problems

✅Logic puzzles

✅Complex reasoning ("Should I take this job?")

✅Planning tasks ("How do I launch this product?")

❌Simple facts ("What's the capital of France?")

❌Quick translations

❌Creative writing (CoT kills creativity)

Rule of thumb: if a human would need to "think it through", use CoT.

🔭 Step-Back Prompting: Zoom Out Before Zooming In

Sometimes before solving a specific problem, it helps to zoom out and think about the bigger picture first. This is Step-Back Prompting. Instead of diving straight into your specific question, you first ask a broader, more general question to activate relevant knowledge. Then use THAT answer as context for your real question.

Direct (no step-back)

Write a scary first level for a horror video game.

↓

Step 1 — Step back (ask general first)

What are the 5 key elements that make horror games scary and engaging?

Uncertainty and darkness
Slow-building tension (not just jump scares)
Meaningful player choices
Isolated setting with no easy escape
Escalating sense of dread

↓

Step 2 — Apply context to real question

Using these 5 horror elements, write a scary first level for a video game.

Result

Level 1 takes place in an abandoned research station with flickering lights. The player hears distant sounds but never sees the threat immediately. They must find a keycard in 3 rooms — each room darker than the last...

The step-back produced a much richer, more intentional result!

✨ Magic Phrases That Activate Deep Thinking

"Let's think step by step.""Walk me through your reasoning.""Explain your logic before giving the answer.""Think carefully before answering.""Show your working.""Before answering, consider: [broader question]"

Quick Quiz

Test what you learned from this chapter. No pressure — it's just for you!

Question 1 of 3

What does adding "Let's think step by step" to a prompt do?

← Previous Next Chapter →