Darel Rex Finley in PhotoBooth

Dishonesty For the Greater Good

2010.11.13   prev     next

From Jonah Lehrer’s “Beware Our Blind Seers” (The Wall Street Journal):

[Pundits] sound as if they know what they’re talking about.

But do they? Philip Tetlock, a psychologist at the University of California, Berkeley, has spent 25 years trying to find out. ...

By the end of the study, Mr. Tetlock had quantified 82,361 predictions.

How did the experts do? When it came to predicting the likelihood of an outcome, the vast majority performed worse than random chance.

How could pundits be worse than random guessing? Lehrer’s article cites “overconfidence,” “confirmation bias,” and “preconceptions” as the explanation.

That seems a little too vague to me. Actually, now that I think about it some more, it seems impossible. How can overconfidence make you worse than random guessing? It can’t. Same with confirmation bias, or preconceptions. Any flaw in your ability to predict the future could make your predictions, on average, worse than if you didn’t have that flaw. But not worse than random guessing. The accuracy of random guessing is the absolute bottom, below which you cannot go, no matter how bad your predictive flaws may be.

So how did Tetlock get these results? Here’s my theory:

Pundits, like everyone else, have preferences of what they would like to see happen. When pundits sense that there’s a good chance that their preferred outcome will not be realized, they feel a more urgent need to persuade others that it will be. This is especially true if the outcome is determined by some sort of popular consensus, like voting in an election, or buying or selling stock in a company, or choosing which company’s products to buy — then the pundits feel they must use their influence to push the outcome in the direction they want it to fall.

Of course, few, if any, pundits have enough influence to actually prevent the outcome from falling in their non-preferred direction, so that’s what it does. And then you can chalk up another incorrect prediction.

When an outcome seems likely to go the way pundits want it to, they feel little need to push it in that direction, and so are less likely to speak out on that subject.

Pundits are actually better than chance at knowing what’s likely to happen. They appear to be worse than chance because they aren’t trying to achieve accuracy in predicting trends — instead they’re trying to use their public predictions to push against trends they can see coming, and don’t like. Overconfidence, confirmation bias, preconceptions, and all other flaws in pundits’ ability to predict the future, can only drive them down to the accuracy of random guessing. To go below that, it takes real predictive ability plus intentional dishonesty.

Capitalism

Capitalism makes a nation stronger. It makes a nation that is more easily able to fend off attacks from other nations, and that is more able to take over other nations, should it decide that it’s in its best interest to do so.

But that’s all capitalism does. Capitalism does not make people’s lives better. There are lots of people whose lives are miserable under capitalism, and the capitalists have a funny answer to that. Capitalists almost never argue in favor of capitalism on the basis of national strength or longevity or power over other nations. They almost always argue in favor of capitalism on the basis that it makes our lives better. But then when you start talking about how so many people in capitalism are extremely miserable, unhappy with their situation, with what they’re able to get under capitalism, then the capitalists have a very funny answer, and that answer is that those people aren’t supposed to be unhappy. That they’re getting exactly what they deserve, exactly what they legitimately should, as per the rules of capitalism. And that they have no right to be unhappy about that. And if they are unhappy about that, then it’s their own fault, and they deserve that unhappiness until they decide to stop feeling that way. The capitalists don’t come out and say it that bluntly, but that’s what they mean.

And this is very strange because, of course, on the one hand the capitalists are trying to say that capitalism achieves a better result, but on the other hand they dismiss any flaws in that result by simply saying that those flaws are not flaws. That when people are unhappy under capitalism, it’s a legitimate unhappiness, it’s an unhappiness they’re supposed to feel. Until they decide not to feel that way.

But what about the Soviet Union, and how much worse living conditions were there than in the USA? Doesn’t that prove capitalism makes our lives better? Wouldn’t someone who was transported from the USSR to the USA be overjoyed at their better quality of life, or traumatized if transported in the opposite direction?

Not exactly. What percentage of the USSR’s population was transported to the USA as described above? Nearly 0%. How many in the opposite direction? Nearly 0%. It’s a fantasy scenario that virtually never happened. How would a person from five hundred years ago feel about their material possessions and opportunities if transported to the present? Overjoyed, perhaps. How would a present-day person feel about their possessions and opportunities if transported to five hundred years ago? Horrified, most likely.

So were people profoundly more miserable and dissatisfied five hundred years ago than they are today? Not as far as we can tell, no. Are we all satisfied and happy with our lives because we have more possessions and opportunities than people did five hundred years ago? Hardly.

Hmmm &mdash the USSR crumbled, didn’t it? Doesn’t that count for something? It sure does. National strength and power.

There isn’t any non-circular way to justify capitalism except on national strength; the ability to fend off and/or take over other nations.

Now, capitalists generally don’t defend it that way. Why not? Well, for one, they might be repulsed by that reality. They want to believe that capitalism yields something better. But then there’s an even more important reason, and that is that they’re trying to encourage people to vote capitalist. And you can’t encourage people to vote capitalist by talking about national strength or the ability to fend off attacks, or anything like that. You have to make people think that their lives are going to be personally better.

If people don’t think their lives are going to be better, then they’re not going to vote that way. And so unless our country is under imminent threat of attack by some very powerful aggressor nation — which, ever since the fall of the USSR, it isn’t; even 9-11 was a drop in the bucket compared to World War II — then you have to ask, how do you convince people to vote for capitalism? Not by telling them they’re going to be miserable but safe. No, you convince them to vote for capitalism by telling them that they will be happier under capitalism. And by telling them that those who say they’re unhappy under capitalism are just malicious. That they shouldn’t feel that way, or that they’re lying, or that they’re telling the truth but their misery is self-created, because they ought to be happy with what they have.

Capitalists have to come up with an argument that has a decent chance of persuading people to vote capitalist, and that’s what they’re trying to do. They’re not really trying to tell the truth about capitalism — I’m telling you the truth about capitalism right here. Capitalists want capitalism. They don’t want to tell the truth that might or might not cause people to vote capitalist.

Religion and Darwinism

It’s kind-of the same thing with religion. If you believe people’s lives will be better with religion, you have to choose a specific religion and promote it exclusively. You can’t go around saying, “Join one of the major religions; your life will be better!” because that’s saying, in effect, that religions are myths; falsehoods.

And Darwinists too: There are so many people — intelligent and educated — who, when asked, “Do you believe that random mutation and natural selection produced life’s adaptive complexity that we see on Earth today?” think that they’re really being asked, “Do you believe in freedom, democracy, technology, and scientific progress?” (As opposed to theocracy, dictatorship, 1984, etc.) And so they answer accordingly.

And it’s even worse than that. If they’re asked the question in a more specific way, like, “Do you really believe that there’s strong evidence that random mutation and natural selection can do this? You’re not just saying they can because you want to promote freedom, democracy, etc.?” then they think even more that they’re being asked if they believe in freedom, democracy, etc., and so they answer even more vociferously that yes, yes, random mutation and natural selection definitely can do this, and that’s really why I’m saying they can; because they can, and did.

It’s a situation where the belief that we’re going to achieve a certain goal in society totally overwhelms the ability to speak honestly about a subject, or even the desire to.

 

Update 2011.04.01 — added “Actually, now ... these results?” and “Overconfidence, confirmation ... below that.”

 

See also:
iPhone Party-Poopers Redux
and
Silly iPad Spoilsports

 

prev     next

 

 

 

 

 

 

 

Hear, hear

prev     next

Favorite links

Starbucks

Apple

RoughlyDrafted

Daring Fireball

Joel on Software

Grupo Fantasma

Macalope

Red Meat

Despair, Inc.

The J. Peterman Company

Zombie Survival Guide plus Dawn of the Dead

Charlie Superfly Check “The First Time” to hear what she actually sang in the competition. HowardTV ripped it out and spliced in utter crap they had her sing later.

Real Solution #9 (Mambo Mania Mix) over stock nuke tests.

Ernie & Bert In Casino

Great Explanation of Star Wars

Best Superbowl 43 Commercial

Best Superbowl 45 Commercial

Best Superbowl 46 Commercial

Kirk & Spock get Closer

American football explained.

Piada. Yum. Like, Chipotle meets Italian.

TV: Survivor; Justified; Khloé & Lamar; Cash Cab

God’s kitchen

My vote for best commercial ever.

Entire site as a zip file — last updated 2012.05.02

My books

Now available on the iBookstore!

   

Previous articles

What Windows-vs.-Mac Actually Proved

A Tale of Two Logos

Microsoft’s Three Paths

Amazon Won’t Be A Big Winner In the DOJ’s Price-Fixing Suit

Infinite Sets, Infinite Authority

Strategy Analytics and Long Term Accountability

The Third Stage of Computing

Why 1 Isn’t Prime, 2 Is Prime, and 2 Is the Only Even Prime

Readability BS

Lie Detection and Psychos

Liking

Steps

Microsoft’s Dim Prospects

Humanity — Just Barely

Hanke-Henry Calendar Won’t Be Adopted

Collatz Conjecture Analysis (But No Proof; Sorry)

Rock-Solid iOS App Stability

Microsoft’s Uncreative Character

Microsoft’s Alternate Reality Bubble

Microsoft’s Three Ruts

Society’s Fascination With Mass Murder

PlaysForSure and Wikipedia — Revisionism At Its Finest

Procrastination

Patent Reform?

How Many Licks

Microsoft’s Incredible Run

Voting Socialist

Darwin Saves

Collatz Conjecture ... Not Yet

The Size of Things In the Universe

The Self-Fulfilling Prophecy That Wasn’t

Fun

Nobody Was In Love With Windows

Apples To Apples — How Anti-Apple Pundits Shoot Themselves In the Foot

No Holds Barred

Betting Against Humanity

Apple’s Premium Features Are Free

Why So Many Computer Guys Hate Apple

3D TV With No Glasses and No Parallax/Focus Issues

Waves With Particle-Like Properties

Gridlock Is Just Fine

Sex Is A Fantasy

Major Player

Why the iPad Wannabes Will Definitely Flop

Predators and Parasites

Prison Is For Lotto Losers

The False Dichotomy

Wait and See — Windows-vs-Mac Will Repeat Itself

Dishonesty For the Greater Good

Barr Part 2

Enough Information

Zune Is For Apple Haters

Good Open, Bad Open

Beach Bodies — Who’s Really Shallow?

Upgrade? Maybe Not

Eliminating the Impossible

Selfish Desires

Farewell, Pirate Cachet

The Two Risk-Takers

Number of Companies — the Idiocy That Never Dies

Holding On To the Solution

Apple Religion

Long-Term Planning

What You Have To Give Up

The End of Elitism

Good and Evil

Life

How Religion Distorts Science

Laziness and Creativity

Sideloading and the Supersized-Mastodon-In-the-Room That Snell Doesn’t See

Long-Term Self-Delusion

App Store Success Won’t Translate To Books, Movies, and Shows

Silly iPad Spoilsports

I Disagree

Five Rational Counterarguments

Majority Report

Simply Unjust

Zooman Science

Reaganomics — Like A Diet — Works

Free R&D?

Apple’s On the Right Track

Mountains of Evidence

What We Do

Hope Conquers All

Humans Are Special — Just Not That Special

Life = Survival of the Fittest

Excuse Me, We’re Going To Build On Your Property

No Trademark iWorries

Knowing

Twisted Excuses

The Fall of Google

Real Painters

The Meaning of Kicking Ass

How To Really Stop Casual Movie Disc Ripping

The Solitary Path of the High-Talent Programmer

Fixing, Not Preaching

Why Blackmail Is Still Illegal

Designers Cannot Do Anything Imaginable

Wise Dr. Drew

Rats In A Too-Small Cage

Coming To Reason

Everything Isn’t Moving To the Web

Pragmatics, Not Rights

Grey Zone

Methodologically Dogmatic

The Purpose of Language

The Punishment Defines the Crime

Two Many Cooks

Pragmatism

One Last Splurge

Making Money

What Heaven and Hell Are Really About

America — The Last Suburb

Hoarding

What the Cloud Isn’t For

Diminishing Returns

What You’re Seeing

What My Life Needs To Be

Taking An Early Retirement

Office Buildings

A, B, C, D, Pointless Relativity

Stephen Meyer and Michael Medved — Where Is ID Going?

If You Didn’t Vote — Complain Away

iPhone Party-Poopers Redux

What Free Will Is Really About

Spectacularly Well

Pointless Wrappers

PTED — The P Is Silent

Out of Sync

Stupid Stickers

Security Through Normalcy

The Case For Corporate Bonuses

Movie Copyrights Are Forever

Permitted By Whom?

Quantum Cognition and Other Hogwash

The Problem With Message Theory

Bell’s Boring Inequality and the Insanity of the Gaps

Paying the Rent At the 6 Park Avenue Apartments

Primary + Reviewer — An Alternative IT Plan For Corporations

Yes Yes Yes

Feelings

Hey Hey Whine Whine

Microsoft About Microsoft Visual Microsoft Studio Microsoft

Hidden Purple Tiger

Forest Fair Mall and the Second Lamborghini

Intelligent Design — The Straight Dope

Maxwell’s Demon — Two Real-World Examples

Zealots

Entitlement BS

Agenderle

Mutations

Einstein’s Error — The Confusion of Laws With Their Effects

The Museum Is the Art

Polly Sooth the Air Rage

The Truth

The Darkness

Morality = STDs?

Fulfilling the Moral Duty To Disdain

MustWinForSure

Choice

Real Design

The Two Rules of Great Programming

Cynicism

The End of the Nerds

Poverty — Humanity’s Damage Control

Berners-Lee’s Rating System = Google

The Secret Anti-MP3 Trick In “Independent Women” and “You Sang To Me”

ID and the Large Hadron Collider Scare

Not A Bluff

The Fall of Microsoft

Life Sucks When You’re Not Winning

Aware

The Old-Fashioned Way

The Old People Who Pop Into Existence

Theodicy — A Big Stack of Papers

The Designed, Cause-and-Effect Brain

Mosaics

IC Counterarguments

The Capitalist’s Imaginary Line

Education Isn’t Everything

I Don’t Know

Funny iPhone Party-Poopers

Avoiding Conflict At All Costs

Behavior and Free Will, Unconfused

“Reduced To” Absurdum

Suzie and Bubba Redneck — the Carriers of Intelligence

Everything You Need To Know About Haldane’s Dilemma

Darwin + Hitler = Baloney

Meta-ware

Designed For Combat

Speed Racer R Us

Bold — Uh-huh

Conscious of Consciousness

Future Perfect

Where Real and Yahoo Went Wrong

The Purpose of Surface

Eradicating Religion Won’t Eradicate War

Documentation Overkill

A Tale of Two Movies

The Changing Face of Sam Adams

Dinesh D’Souza On ID

Why Quintic (and Higher) Polynomials Have No Algebraic Solution

Translation of Paul Graham’s Footnote To Plain English

What Happened To Moore’s Law?

Goldston On ID

The End of Martial Law

The Two Faces of Evolution

A Fine Recommendation

Free Will and Population Statistics

Dennett/D’Souza Debate — D’Souza

Dennett/D’Souza Debate — Dennett

The Non-Euclidean Geometry That Wasn’t There

Defective Attitude Towards Suburbia

The Twin Deficit Phantoms

Sleep Sync and Vertical Hold

More FUD In Your Eye

The Myth of Rubbernecking

Keeping Intelligent Design Honest

Failure of the Amiga — Not Just Mismanagement

Maxwell’s Silver Hammer = Be My Honey Do?

End Unsecured Debt

The Digits of Pi Cannot Be Sequentially Generated By A Computer Program

Faster Is Better

Goals Can’t Be Avoided

Propped-Up Products

Ignoring ID Won’t Work

The Crabs and the Bucket

Communism As A Side Effect of the Transition To Capitalism

Google and Wikipedia, Revisited

National Geographic’s Obesity BS

Cavemen

Theodicy Is For Losers

Seattle Redux

Quitting

Living Well

A Memory of Gateway

Is Apple’s Font Rendering Really Non-Pixel-Aware?

Humans Are Complexity, Not Choice

A Subtle Shift

Moralism — The Emperor’s New Success

Code Is Our Friend

The Edge of Religion

The Dark Side of Pixel-Aware Font Rendering

The Futility of DVD Encryption

ID Isn’t About Size or Speed

Blood-Curdling Screams

ID Venn Diagram

Rich and Good-Looking? Why Libertarianism Goes Nowhere

FUV — Fear, Uncertainty, and Vista

Malware Isn’t About Total Control

Howard = Second Coming?

Doomsday? Or Just Another Sunday

The Real Function of Wikipedia In A Google World

Objective-C Philosophy

Clarity From Cisco

2007 Macworld Keynote Prediction

FUZ — Fear, Uncertainty, and Zune

No Fear — The Most Important Thing About Intelligent Design

How About A Rational Theodicy

Napster and the Subscription Model

Intelligent Design — Introduction

The One Feature I Want To See In Apple’s Safari.