App’d to Fail: Mobile Health Treatments Fall Short in First Full Checkup

Early trials using mobile technology including text messaging and apps lack rigor and show mixed results















Share on Tumblr

User Testing in Wamba

SMS messages in Africa provide reminders to patients to take antiretroviral drugs, reducing HIV virus counts. Image: Flickr/The Reboot

Health care via mobile technology is still in its infancy. Of 75 trials in which patients used mobile tech, such as text messaging and downloadable apps, to manage a disease or adopt healthier behaviors, only three showed reliable signs of success, according to a systematic survey. In an accompanying survey of medical personnel who used smart phones and other devices, to help deliver care, the same team found more success: 11 of 42 trials had positive, reliable results.

Yet mobile device-aided health care, called mHealth, attracts a lot of attention and dollars, as U.S. National Institutes of Health director Francis Collins wrote last year in Scientific American. In 2012 venture capital firms invested more than $900 million in mHealth, according to a report by Mobile Health Market News.

“There’s a lot of enthusiasm for [mHealth] but [its effectiveness] wasn’t very clear,” says epidemiologist Caroline Free of the London School of Hygiene and Tropical Medicine in England, the lead author of the reviews. In 2011, for example, the World Health Organization found that only 12 percent of mobile health initiatives included an evaluation.

So Free and colleagues conducted the reviews, which appear in PLoS Medicine, she says, to “put us in the position of knowing exactly in which areas there was good evidence where the evidence was promising.” That information could help investors and researchers make better decisions about how to identify, improve and promote the best mobile health treatments.

In the first review, the team identified 334 relevant mHealth trials in seven medical databases. Most of the trials used text messaging to interact with patients, although some interacted through dedicated applications, downloadable audio and video or the Web. Only 75 of those trials included a control group, which allows researchers to compare experimental interventions with doing nothing.

Of the 75 controlled trials, 26 sought to change patient behavior by methods that included increasing exercise and 49 sought to help patients manage diseases medically such as by taking pills on time. That may not seem like many studies, but medical doctor Rahul Chakrabarti at Monash University in Australia, co-editor of the Journal of Mobile Technology in Medicine, calls it the most comprehensive meta-analysis of mHealth evidence to date.

The bad news is that most trials had weak designs, such as failing to randomize participants in the control group and the experimental group. Others relied on participants to self-report the results, but such methods can be unreliable. Free says such trials should use biochemical tests, instead. In some cases, it’s too early to tell whether a result, such as smaller waist size, would last long enough to improve participants’ health. Most trials also neglected the developing world, where mobile phones have the most potential to improve access to health care. “This does not undermine the outcomes,” Chakrabarti says, “but shows that going forward, there is a clear need for improved methodology.”

There were a few promising, reliable trials: For instance, receiving text messages helped smokers quit in one trial that did verify its results with biochemical tests. Reminders also helped diabetics stick to their treatments in another trial. In the only successful developing-world trial, in Kenya, SMS reminders to take antiretroviral drugs helped reduce HIV virus counts.



Rights & Permissions

1 Comments

Add Comment
View
  1. 1. mragusa 02:15 PM 1/30/13

    The rapid rate of mobile health adoption reflects the convenience and utility inherent in mobile apps and devices. Health systems have an opportunity to meet patients where they are increasingly turning for health management: mobile devices. This is patient engagement at its most powerful. Engaged patients will increasingly drive a health system's success. Today that means HCAHPS and readmissions. Tomorrow that means population health and ACOs. Smart health systems understand that and are investing in mobile. For others, the window will eventually close and their patients will turn elsewhere for health management.

    http://axialexchange.com/blog/category/axial-mobile

    Reply | Report Abuse | Link to this
Leave this field empty

Add a Comment

You must sign in or register as a ScientificAmerican.com member to submit a comment.
Click one of the buttons below to register using an existing Social Account.

More from Scientific American

See what we're tweeting about

Scientific American Editors

More »

Free Newsletters


Get the best from Scientific American in your inbox

Solve Innovation Challenges

Powered By: Innocentive

  SA Digital
  SA Digital

Science Jobs of the Week

Email this Article

App’d to Fail: Mobile Health Treatments Fall Short in First Full Checkup

X
Scientific American Magazine

Subscribe Today

Save 66% off the cover price and get a free gift!

Learn More >>

X

Please Log In

Forgot: Password

X

Account Linking

Welcome, . Do you have an existing ScientificAmerican.com account?

Yes, please link my existing account with for quick, secure access.



Forgot Password?

No, I would like to create a new account with my profile information.

Create Account
X

Report Abuse

Are you sure?

X

Institutional Access

It has been identified that the institution you are trying to access this article from has institutional site license access to Scientific American on nature.com. To access this article in its entirety through site license access, click below.

Site license access
X

Error

X

Share this Article

X