Banner
    Scare Journalism And Miracle Cures: American Media Prefer Weak Observational Studies
    By Hank Campbell | January 24th 2014 09:26 AM | 2 comments | Print | E-mail | Track Comments
    About Hank

    I'm the founder of Science 2.0®.

    A wise man once said Darwin had the greatest idea anyone ever had. Others may prefer Newton or Archimedes...

    View Hank's Profile
    A new analysis has affirmed what many in the science audience already knew; mainstream media prefer weak observational studies. It's why you're reading this article here instead of the New York Times.

    And that is not just in regards to social psychology correlations made using surveys of college students or sociology mysticism, it happens in medical coverage too. The examination found that observational studies get far better coverage than actual randomized controlled trials, which are what should really be important to most people.

    The authors compared the coverage of 75 medical/clinical journal articles in the top five newspapers (The Wall Street Journal, USA Today, The New York Times, Los Angeles Times, San Jose Mercury News)(1) against 75 articles in the top five medical journals by impact factor during the same period (ending 2011). They found that the preference for observational studies over clinical trials was clear; 75% versus 47%. 

    That's no surprise, a lot of clinical trial papers will be too boring or incremental to get press coverage - journalism costs money and editors know they need to provide bang for the buck. What was a concern was that newspaper journalists and editors seemed to really prefer studies that had weak methodology. So newspaper headlines like “Statin-takers Less Likely to Die from Cancer” failed to ever note that they were drawing dubious causal conclusions from observational data. That sort of thing is fun for social sciences but in medical coverage it can be dangerous - and with limited space, it means the public isn't getting coverage of real medicine.


    Distribution of study design ratings for clinical investigations from the media and medical journals. (A) The media covers inferior quality study designs than those published in (B) high impact medical journals, p = 0.003. doi:10.1371/journal.pone.0085355

    And, the authors say, it is systemic bias. Not bias as in that newspapers prefer one particular type of article but that they prefer things that make for catchy headlines, even if the methodology is suspect. They note the obvious impact; after media coverage of invasive group A streptococcal (GAS) disease, testing by worried parents for “the flesh eating bacteria” went up. We know what that does to health care costs.

    It isn't just on the public side. What happens in the research community when observational studies get a lot of coverage? More people go into the area and that means more taxpayer money spent on studying Acai berries and gluten-free foods and whatever else makes the LA Times science and health section this month.

    Obviously it's a tricky balance; flesh-eating bacteria is likely more interesting than lots of other studies that are released every day. But it would also help if journalists read more than press releases.

    Citation: Selvaraj S, Borkar DS, Prasad V (2014) Media Coverage of Medical Journals: Do the Best Articles Make the News? PLoS ONE 9(1): e85355. doi:10.1371/journal.pone.0085355

    NOTES: 

    (1) PLOS One insists its 10,000 articles per year are peer reviewed but editing, much less peer review, would have caught the mistake in calling one of those top 5 newspapers, the San Jose Mercury News, by the wrong name, the San Jose Mercury Times. At least they didn't also list the New York Today and USA Journal.


    In a journal article about suspect coverage of journal articles, this is irony.

    Comments

    Nice media write-up of an observational study.

    Hank
    Outstanding!   :-)

    But I read more than a press release so I'm hopefully a little head of the top 5 newspapers.