A new analysis has affirmed what many in the science audience already knew; mainstream media prefer weak observational studies. It's why you're reading this article here instead of the New York Times.
And that is not just in regards to social psychology correlations made using surveys of college students or sociology mysticism, it happens in medical coverage too. The examination found that observational studies get far better coverage than actual randomized controlled trials, which are what should really be important to most people.
The authors compared the coverage of 75 medical/clinical journal articles in the top five newspapers (The Wall Street Journal, USA Today, The New York Times, Los Angeles Times, San Jose Mercury News)(1) against 75 articles in the top five medical journals by impact factor during the same period (ending 2011). They found that the preference for observational studies over clinical trials was clear; 75% versus 47%.
That's no surprise, a lot of clinical trial papers will be too boring or incremental to get press coverage - journalism costs money and editors know they need to provide bang for the buck. What was a concern was that newspaper journalists and editors seemed to really prefer studies that had weak methodology. So newspaper headlines like “Statin-takers Less Likely to Die from Cancer” failed to ever note that they were drawing dubious causal conclusions from observational data. That sort of thing is fun for social sciences but in medical coverage it can be dangerous - and with limited space, it means the public isn't getting coverage of real medicine.
Distribution of study design ratings for clinical investigations from the media and medical journals. (A) The media covers inferior quality study designs than those published in (B) high impact medical journals, p = 0.003. doi:10.1371/journal.pone.0085355
And, the authors say, it is systemic bias. Not bias as in that newspapers prefer one particular type of article but that they prefer things that make for catchy headlines, even if the methodology is suspect. They note the obvious impact; after media coverage of invasive group A streptococcal (GAS) disease, testing by worried parents for “the flesh eating bacteria” went up. We know what that does to health care costs.
It isn't just on the public side. What happens in the research community when observational studies get a lot of coverage? More people go into the area and that means more taxpayer money spent on studying Acai berries and gluten-free foods and whatever else makes the LA Times science and health section this month.
Obviously it's a tricky balance; flesh-eating bacteria is likely more interesting than lots of other studies that are released every day. But it would also help if journalists read more than press releases.
Citation: Selvaraj S, Borkar DS, Prasad V (2014) Media Coverage of Medical Journals: Do the Best Articles Make the News? PLoS ONE 9(1): e85355. doi:10.1371/journal.pone.0085355
(1) PLOS One insists its 10,000 articles per year are peer reviewed but editing, much less peer review, would have caught the mistake in calling one of those top 5 newspapers, the San Jose Mercury News, by the wrong name, the San Jose Mercury Times. At least they didn't also list the New York Today and USA Journal.
In a journal article about suspect coverage of journal articles, this is irony.
- PHYSICAL SCIENCES
- EARTH SCIENCES
- LIFE SCIENCES
- SOCIAL SCIENCES
Subscribe to the newsletter
Stay in touch with the scientific world!
Know Science And Want To Write?
- "Tommaso, This is an interesting question - thanks for sharing. I disagree with your answer to part..."
- "Hmm...a few thoughts: 1. Because, if the take-home message from this award is that people should..."
- "Hello Maurice,indeed this prize must collectively be felt as a prize to superK, I guess...."
- "There's room on this planet for quackery too, that doesn't mean it's good. It is a professional..."
- "I object to the use of western science and western medicine. It's an insult to thousands of outstanding..."
- Why Is Mother Jones So Afraid Of Science? And Journalism?
- Weight-Loss Surgery Improves Health of Some Diabetics
- Ben Carson Bungles Again, Treating Cancer with Supplements
- No Vax, No School: US Supreme Court Backs NY State
- Remaking the Peanut to Make Schools Safer
- Ancient Chinese Medicine Not Magical, Nobel Prize or Not