Cover Image: March 2012 Scientific American Magazine See Inside

How We Opt Out of Overoptimism: Our Habit of Ignoring What Is Real Is a Double-Edged Sword

The willful distortion of reality to extremes can be harmful















Share on Tumblr



Image: Illustration by Francesco Bongiorni

  • The Wisdom of Psychopaths

    In this engrossing journey into the lives of psychopaths and their infamously crafty behaviors, the renowned psychologist Kevin Dutton reveals that there is a...

    Read More »

Are you better than average as a driver? I know I am. I’ll bet 90 percent of you think you are, too, because this is the well-documented phenomenon known as the above-average effect, part of the psychology of optimism.

According to psychologist Daniel Kahneman, in his 2011 book Thinking, Fast and Slow, “people tend to be overly optimistic about their relative standing on any activity in which they do moderately well.” But optimism can slide dangerously into overoptimism. Research shows that chief financial officers, for example, “were grossly overconfident about their ability to forecast the market” when tested by Duke University professors who collected 11,600 CFO forecasts and matched them to market outcomes and found a correlation of less than zero. Such overconfidence can be costly. “The study of CFOs showed that those who were most confident and optimistic about the S&P index were also overconfident and optimistic about the prospects of their own firm, which went on to take more risk than others,” Kahneman notes.

Isn’t optimistic risk taking integral to building a successful business? Yes, to a point. “One of the benefits of an optimistic temperament is that it encourages persistence in the face of obstacles,” Kahneman explains. But “pervasive optimistic bias” can be detrimental: “Most of us view the world as more benign than it really is, our own attributes as more favorable than they truly are, and the goals we adopt as more achievable than they are likely to be.” For example, only 35 percent of small businesses survive in the U.S. When surveyed, however, 81 percent of entrepreneurs assessed their odds of success at 70 percent, and 33 percent of them went so far as to put their chances at 100 percent. So what? In a Canadian study Kahneman cites, 47 percent of inventors participating in the Inventor’s Assistance Program, in which they paid for objective evaluations of their invention on 37 criteria, “continued development efforts even after being told that their project was hopeless, and on average these persistent (or obstinate) individuals doubled their initial losses before giving up.” Failure may not be an option in the mind of an entrepreneur, but it is all too frequent in reality. High-risk-taking entrepreneurs override such loss aversion, a phenomenon most of us succumb to—in which losses hurt twice as much as gains feel good—that we developed in our evolutionary environment of scarcity and uncertainty.

This loss-aversion override by those with pervasive optimistic bias seems to work because of what I call biographical selection bias: the few entrepreneurs who succeed spectacularly have biographies (and autobiographies), whereas the many who fail do not.

Think Steve Jobs, whose pervasive optimistic bias was channeled through something a co-worker called Jobs’s “reality distortion field.” According to his biographer Walter Isaacson, “at the root of the reality distortion was Jobs’s belief that the rules didn’t apply to him.... He had the sense that he was special, a chosen one, an enlightened one.” Jobs’s optimism morphed into a reality-distorting will to power over rules that applied only to others and was reflected in numerous ways: legal (parking in handicapped spaces, driving without a license plate), moral (accusing Microsoft of ripping off Apple when both took from Xerox the idea of the mouse and the graphical user interface), personal (refusing to acknowledge his daughter Lisa even after an irrefutable paternity test), and practical (besting resource-heavy giant IBM in the computer market).

There was one reality Jobs’s distortion field optimism could not completely bend to his will: cancer. After he was diagnosed with a treatable form of pancreatic cancer, Jobs initially refused surgery. “I really didn’t want them to open up my body, so I tried to see if a few other things would work,” he admitted to Isaacson. Those other things included consuming large quantities of carrot and fruit juices, bowel cleansings, hydrotherapy, acupuncture and herbal remedies, a vegan diet, and, Isaacson says, “a few other treatments he found on the Internet or by consulting people around the country, including a psychic.” They didn’t work.



Rights & Permissions

8 Comments

Add Comment
View
  1. 1. danhicksbyron 07:23 AM 2/21/12

    The tendency towards overoptimism would not be so bad if it were not for the Dunning-Kruger effect (http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect). What has been shown by Kruger, Dunning and others is that the less competent you are, the more confident you are in your abilities, while the more confident among us are better at estimating their incompetence. (This effect is apparently much stronger in the US than in Europe.)

    This, of course, bodes ill for any society, but especially in a democracy, as the incompetent will beat their chests about the righteousness of their cause while the capable will be more tentative in their assertions.

    Reply | Report Abuse | Link to this
  2. 2. NoMinorChords 11:23 PM 2/21/12

    I noticed with some amusement that the print addition of this article faces an ad for a product that promises fitness with a 4-minute a day cardio routine. "People cannot believe that our 4 minute cardio exercise is possible," it crows. "The 'experts' have the same (wrong) opinion." To believe that requires a level of "optimism" that might be better described as "gullibility."

    Reply | Report Abuse | Link to this
  3. 3. Joseph C Moore, Cpo USN Ret in reply to NoMinorChords 06:33 PM 3/14/12

    "edition"

    Reply | Report Abuse | Link to this
  4. 4. geojellyroll 07:35 PM 3/14/12

    It was an ok article until it got off on a tangent of a sample of 'one'.

    Reply | Report Abuse | Link to this
  5. 5. NoMinorChords in reply to Joseph C Moore, Cpo USN Ret 07:41 PM 3/14/12

    You are right, sir. I'd like to blame it on a psychotic spell checker but it was probably a slip of the finger/mind.

    Reply | Report Abuse | Link to this
  6. 6. rwstutler 03:26 AM 3/15/12

    Overconfidence and overoptimism rely on 'knowledge' that is false, or poor math skills. Steve Jobs was the exception to many rules, and an example that normal expectations, or probability distributions, do not apply to rule breakers. Yet overcon fidence and overoptimism can be trained, and made part of a persons self image and world view, even in the face on contradictory evidence and experience.

    Reply | Report Abuse | Link to this
  7. 7. Michael M in reply to Joseph C Moore, Cpo USN Ret 06:07 PM 3/16/12

    Thank you Mr. Moore.

    To further digress: For a number of years now, I have lost respect for the validity of writers who malappropriate words.
    Perhaps it is overoptimistic of me to believe that developed neural tissue occurs in the spellingly challenged, although NoMinorChords (how optimistic!) illustrates an astonishing juxtaposition possibly purposely made by SA magazine layout persons in high humor!

    TO reply to another commentor:
    Overoptimism occurs in those with Bipolar disorders; we do well to remember that some creative geniuses were Bipolar, sometimes in extreme.

    Reply | Report Abuse | Link to this
  8. 8. realmath 08:42 AM 5/15/12

    The last line in the article is:"Nature cannot be distorted"
    Alegoric for the word distorted:DO NOT LIE

    If the information,that we ACT ON,are false:the action is a lie as well.

    Article mention:"Chief financial officers were grossly overconfident on market forecast"

    Oscar winning ducomentary movie about the Wall Street part of the worlds finance crise mention,that: DEVIATE TRADE was like PYRAMIDE TRADE....

    I agree with the articles last line!

    Reply | Report Abuse | Link to this
Leave this field empty

Add a Comment

You must sign in or register as a ScientificAmerican.com member to submit a comment.
Click one of the buttons below to register using an existing Social Account.

More from Scientific American

Follow Us:

See what we're tweeting about

Scientific American MIND

More »

Free Newsletters


Get the best from Scientific American in your inbox

Solve Innovation Challenges

Powered By: Innocentive

  SA Digital

Latest from SA Blog Network

  SA Digital

Science Jobs of the Week

Email this Article

How We Opt Out of Overoptimism: Our Habit of Ignoring What Is Real Is a Double-Edged Sword: Scientific American Magazine

X
Scientific American Mind

Subscribe Today

Save 66% off the cover price and get a free gift!

Learn More >>

X

Please Log In

Forgot: Password

X

Account Linking

Welcome, . Do you have an existing ScientificAmerican.com account?

Yes, please link my existing account with for quick, secure access.



Forgot Password?

No, I would like to create a new account with my profile information.

Create Account
X

Report Abuse

Are you sure?

X

Institutional Access

It has been identified that the institution you are trying to access this article from has institutional site license access to Scientific American on nature.com. To access this article in its entirety through site license access, click below.

Site license access
X

Error

X

Share this Article

X