Don’t Be Too Quick to Dismiss “Soft Science”

Surprisingly, the study of leadership and management is often more reliable than much of medical research

Join Our Community of Science Lovers!

This article was published in Scientific American’s former blog network and reflects the views of the author, not necessarily those of Scientific American


Business leaders often make organizational decisions based on personal experience. Why shouldn't they? Isn't the study of leadership a soft science? Leadership is an art and can't be studied like medicine or chemistry, right?

This is perennial flawed thinking in business. The study of leadership—and management—is often more reliable and valid than much of medical research. When I worked in the biotech industry as a management consultant, it was often difficult to convince leaders that simple evidence-based principles of organizational psychology could lead to substantive business results. And of course, these were ostensibly hard scientists—many of them medical doctors—in positions of organizational leadership.

And why bother listening to organizational psychologists? The company was leading the industry in profit margin, producing cancer treatments that went through rigorous clinical trials and government approval before hitting the market. Tarceva was (and still is) used for non-small-cell lung cancer and pancreatic cancer. After six years of development, pilot testing and final Food and Drug Administration (FDA) approval, Tarceva became one of the most effective pancreatic cancer treatments available. At a cost of roughly $3,000 for a month's supply of thirty 25mg tablets, patients could expect to extend their lives by a median of two months compared with a placebo. That groundbreaking treatment based on years of hard science extended life expectancy beyond a placebo pill by 0.2 percent of total average life expectancy.


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


What about other more commonly used medicines? What's the correlation between ibuprofen, the active ingredient in Advil and Motrin, and reduction in pain? Scientific research shows the correlation to be .14, or in other words it accounts for less than 2 percent of variation in pain. How about the effectiveness of sleeping pills? The mean correlation of taking a sleeping pill with subsequent sleep quality is .3, or in terms of accounting for total variation in sleep quality, it explains 9 percent. In other words, more than 98 percent of pain is not impacted by ibuprofen and 91 percent of sleep quality is not influenced by sleeping pills (see Meyer et al., 2001 for a review). Yet in my experience most business leaders wouldn't question the efficacy of pain relievers, sleeping pills and blockbuster cancer treatments.

So how does so-called soft science compare with biotechnology and the pharmaceutical drug industry? We can look at meta-analytic studies (where researchers combine all extant individual studies on a topic to yield an overall validity coefficient) to get an overall estimate of leadership practices and business outcomes. Let's start with perhaps the most commonplace management practice of incentive pay for performance, which displays a mean correlation of .32 between pay and individual productivity.

Sure, it's barely more efficacious than your standard sleeping pill. But that's why organizational psychologists don't typically prescribe a single procedure for business leaders to enhance job performance. For example, a structured selection practice for job applicants explains roughly 40 percent of variation in job performance. Specifically, a cognitive ability assessment combined with either a work sample or structured interview is correlated with subsequent job performance at .63. This evidence is nothing new to organizational scientists. We've known for years that constructs like cognitive ability, personality and integrity predict a host of important work performance behaviors, and when used in combination they often outperform the validity coefficients of the so-called hard science.

What about the leadership practice known as Management by Objectives (MBO) wherein leaders establish specific company objectives and then set a standardized process by which employees align their individual goals with those of the company? The correlation between a leader's commitment to management by objectives and company productivity is an impressive .67. Want to engender trust, and a whole host of positive outcomes, among employees? Train leaders to enact authentic leadership. The correlation between authentic leadership and trust is .69. Likewise, leaders would do well to weed out abusive supervisors, because the correlation between abusive supervision and counterproductive workplace behavior (e.g., absenteeism, incivility, bullying, substance abuse) in the U.S. is .65. Fortunately implementing structured selection practices, enacting MBO, developing authentic leadership practices, and dissuading abusive behaviors are fairly straightforward.

Of course, this isn't to say small correlations aren't important. For example, the correlation between smoking and developing lung cancer over a 25-year period is .08. While that represents less than 1 percent of lung cancers, the Centers for Disease Control and Prevention points out that smoking is the leading cause of lung cancer in the U.S. with cigarette smoking linked to between 80 percent and 90 percent of deaths resulting from lung cancer. So of course, both efficacy and impact need to be considered.

Indeed, if the best cancer treatment extends life by an average of two months, then it's up to the individual to determine the subjective value. When it comes to raw statistics, however, the science of organizational behavior is formidable. It's time to move beyond the colloquial term "soft" science and skills when referring to organizational leadership—perhaps toward something more descriptive such as "CORE" (Competence in Organizational and Relational Effectiveness) science.

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can't-miss newsletters, must-watch videos, challenging games, and the science world's best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.

Thank you,

David M. Ewalt, Editor in Chief, Scientific American

Subscribe