A new analysis has affirmed what many in the science audience already knew; mainstream media prefer weak observational studies. It's why you're reading this article here instead of the New York Times.
And that is not just in regards to social psychology correlations made using surveys of college students or sociology mysticism, it happens in medical coverage too. The examination found that observational studies get far better coverage than actual randomized controlled trials, which are what should really be important to most people.
The authors compared the coverage of 75 medical/clinical journal articles in the top five newspapers (The Wall Street Journal, USA Today, The New York Times, Los Angeles Times, San Jose Mercury News)(1) against 75 articles in the top five medical journals by impact factor during the same period (ending 2011). They found that the preference for observational studies over clinical trials was clear; 75% versus 47%.
That's no surprise, a lot of clinical trial papers will be too boring or incremental to get press coverage - journalism costs money and editors know they need to provide bang for the buck. What was a concern was that newspaper journalists and editors seemed to really prefer studies that had weak methodology. So newspaper headlines like “Statin-takers Less Likely to Die from Cancer” failed to ever note that they were drawing dubious causal conclusions from observational data. That sort of thing is fun for social sciences but in medical coverage it can be dangerous - and with limited space, it means the public isn't getting coverage of real medicine.
Distribution of study design ratings for clinical investigations from the media and medical journals. (A) The media covers inferior quality study designs than those published in (B) high impact medical journals, p = 0.003. doi:10.1371/journal.pone.0085355
And, the authors say, it is systemic bias. Not bias as in that newspapers prefer one particular type of article but that they prefer things that make for catchy headlines, even if the methodology is suspect. They note the obvious impact; after media coverage of invasive group A streptococcal (GAS) disease, testing by worried parents for “the flesh eating bacteria” went up. We know what that does to health care costs.
It isn't just on the public side. What happens in the research community when observational studies get a lot of coverage? More people go into the area and that means more taxpayer money spent on studying Acai berries and gluten-free foods and whatever else makes the LA Times science and health section this month.
Obviously it's a tricky balance; flesh-eating bacteria is likely more interesting than lots of other studies that are released every day. But it would also help if journalists read more than press releases.
Citation: Selvaraj S, Borkar DS, Prasad V (2014) Media Coverage of Medical Journals: Do the Best Articles Make the News? PLoS ONE 9(1): e85355. doi:10.1371/journal.pone.0085355
(1) PLOS One insists its 10,000 articles per year are peer reviewed but editing, much less peer review, would have caught the mistake in calling one of those top 5 newspapers, the San Jose Mercury News, by the wrong name, the San Jose Mercury Times. At least they didn't also list the New York Today and USA Journal.
In a journal article about suspect coverage of journal articles, this is irony.
- PHYSICAL SCIENCES
- EARTH SCIENCES
- LIFE SCIENCES
- SOCIAL SCIENCES
Subscribe to the newsletter
Stay in touch with the scientific world!
Know Science And Want To Write?
- Part I: Bee Deaths Mystery Solved? Neonicotinoids (Neonics) May Actually Help Bee Health
- Part II: Bee Deaths And CCD - Flawed Chensheng Lu Harvard Studies Endanger Bees
- Reasons Serious Scientists Should Not Fear The Winnower and other OA Open Review Journals.
- Education: Stop New Age Thinking, Chalk And Talk Might Be The Best Way After All
- Big Data Could Be A Big Problem For Workplace Discrimination Law
- The BPA Paradox – Too Many Studies?
- Interstellar Is A Dangerous Fantasy Of US Colonialism
- "Thanks Arthur. Twitter does indeed leave a lot to be desired in terms of precise meaning, 140 characters..."
- "Not at field realistic doses no...."
- "but there isvalid evidence of sublethal effects of neonics, no?..."
- "Henk, These have nothing to do with Lu's study...which is flawed and bad science. See Part II of..."
- "I am a Dutch toxicologist who blew the whistle in 2010 on the exceptional hazards of neonicotinoids..."
- Has a possible new lead been found in the fight against neurodegenerative diseases?
- High-dose interleukin-2 effective in mRCC pre-treated with VEGF-targeted therapies
- Discovery by NUS researchers contributes towards future treatment of multiple sclerosis
- Survivors of childhood eye cancer experience normal cognitive functioning as adults
- Important element in the fight against sleeping sickness found