How can reasonable people together produce a harmful result?
When Good People Produce Bad Outcomes
Harm often comes not from villains but from many reasonable people acting sensibly inside a poorly designed system. A look at why structure, not intent, so often decides the result.
Most people do not intend to cause harm.
They act with reasons. With pressures. With partial information. With goals that, at least locally, make sense.
And yet, harm occurs.
Not occasionally. Not accidentally. But systematically.
This creates a tension that is difficult to resolve:
How can well-intentioned people, acting rationally within their roles, produce outcomes that are clearly harmful?
The Misplaced Focus on Intent
When something goes wrong, we look for a cause.
And we often look for it in people.
Who made the decision? Who failed to act? Who is responsible?
This instinct is understandable. Human systems are built out of human actions.
But it can also be misleading.
Because in many cases, the outcome is not the result of a single bad actor—
It is the result of many reasonable actions, aligned in the wrong way.
Local Rationality, Global Consequence
Inside a system, decisions are made locally.
A person responds to:
- incentives
- constraints
- expectations
- available information
From their perspective, the action is justified.
It fits the role. It follows the rules. It achieves the target.
But systems aggregate decisions.
What is rational at the local level can produce harm at the system level.
A company cuts costs to remain competitive. Another follows. And another.
Individually, each decision makes sense.
Collectively, the system degrades:
- quality declines
- risk increases
- trust erodes
No single actor intended the outcome.
But the outcome emerges.
The Alignment Problem
This is not simply about error.
It is about alignment.
When incentives are aligned with outcomes, systems tend to produce what they intend.
When they are misaligned, systems produce something else.
Often, something worse.
If a system rewards short-term performance, long-term stability becomes secondary.
If it rewards visibility, substance can be neglected.
If it rewards individual success, collective outcomes may suffer.
Actors respond to what is rewarded.
Even when they know better.
Participation Without Ownership
There is another layer.
In complex systems, responsibility is distributed.
No single person sees the whole. No single decision determines the outcome.
This creates a condition where:
Everyone participates. No one feels fully responsible.
Actions become fragments. Consequences become diffuse.
And accountability becomes difficult to locate.
Not because no one acted—
But because everyone did.
The Moral Illusion
This leads to a common misunderstanding:
If the outcome is harmful, someone must have intended harm.
But this is often not the case.
The system can produce outcomes that no participant would choose in isolation.
This is the moral illusion:
We expect outcomes to reflect intention.
But in systems, outcomes reflect structure.
When Systems Override Judgment
There are moments when individuals recognize the problem.
They see the risk. They sense the misalignment.
And still, they proceed.
Why?
Because the system makes alternatives costly.
To resist may mean:
- losing status
- losing income
- losing position
- losing access
So individuals adapt.
Not because they lack awareness— but because the system defines what is viable.
The Design Question
So the question is not:
Are people good or bad?
The question is:
What outcomes does this system make likely when ordinary people operate within it?
Because systems do not require bad actors to produce bad results.
They require only:
- misaligned incentives
- partial visibility
- distributed responsibility
- reinforcing feedback
Conclusion: Rethinking Responsibility
This does not eliminate responsibility.
But it changes where we look for it.
Not only in individuals— but in structure.
Not only in decisions— but in design.
If we want different outcomes, we must change the conditions under which decisions are made.
Because good people, placed in the wrong systems, can reliably produce bad outcomes.
Sidebar: Common Patterns of Systemic Failure
- Short-term incentives undermining long-term stability
- Metrics substituting for meaning
- Fragmented responsibility reducing accountability
- Competitive pressure amplifying harmful behavior
These patterns do not require malicious intent.
They require only alignment.
Classroom Prompts
- Can you think of a situation where many reasonable decisions led to a harmful outcome?
- How do incentives shape what people do, even when they disagree with the outcome?
- What makes it difficult for individuals to act against a system’s pressures?
- How might a system be redesigned to better align individual actions with collective outcomes?
Sources (Annotated)
- Donella Meadows — Thinking in Systems Explains how system structure, not individual intent, drives outcomes.
- Charles Perrow — Normal Accidents Shows how complex systems can produce failure without clear individual fault.
- Diane Vaughan — The Challenger Launch Decision Examines how normalized risk within organizations leads to catastrophic outcomes.
- Elinor Ostrom — Governing the Commons Demonstrates how institutional design affects collective outcomes.
- Daniel Kahneman — Thinking, Fast and Slow Highlights how bounded rationality shapes decision-making within systems.
© 2026 Michael A. Pink. All Rights Reserved.
Reflection Moment
Pause and capture an insight. Your reflections are private — saved only in this browser — and they help your curiosity grow.
- ◆What surprised you most?
- ◆What does this change about how you see the world?
- ◆What other questions does this raise?
Now do something real
Notice a frustrating outcome at home or school this week, then trace which rules or setups, not people, actually caused it.
Curiosity is worth more when it leaves the screen. Try this, then come back and capture what you noticed.
Where will your curiosity go next?
Pathways branch from here. Follow one, or several — there is no wrong way.
Questions this opens
Curiosity never ends. Each answer is the start of another journey.