Banner
    How To Not Get Blinded With Science
    By Michael White | December 2nd 2009 09:57 PM | 16 comments | Print | E-mail | Track Comments
    About Michael

    Welcome to Adaptive Complexity, where I write about genomics, systems biology, evolution, and the connection between science and literature,

    ...

    View Michael's Profile
    From The Times, a journalist global warming skeptic changes his tune:

    I thought global warming was all bog-standard, apocalyptic nonsense when it first emerged in the 1980s. People, I knew, like nothing better than an End-of-the-World story to give their lives meaning. I also knew that science is dynamic. Big ideas rise and fall. Once the Earth was the centre of the universe. Then it wasn’t. Once Isaac Newton had completed physics. Then he hadn’t. Once there was going to be a new ice age. Then there wasn’t.

    Armed with such historic reversals, I poured scorn on under-educated warmists. Scientists with access to the microphone, I pointed out, had got so much so wrong so often. This was yet another case of clever people, who should have known better, running around screaming, “End of the World! End of the World!” and of less-clever people finding reasons to tell everybody else why they were bad. And then I made a terrible mistake. I started questioning my instinct, which was to disbelieve every scare story on principle...

    ...if you suspend your prejudices and your vanity for a moment, everything changes.


    Actually, this post isn't about global warming. It's about how to figure out what to believe when it comes to science that you're not able to evaluate on your own because you lack the highly specialized technical expertise to judge that particular field. All of us, great scientists included, (Freeman Dyson, I'm looking at you) are frankly clueless about large swaths of scientific knowledge.

    So when it comes to a scientific controversy, how do we know which side to bet on? And how do we recognize a genuine scientific controversy, as opposed to a political controversy dressed up in scientific terms?

    It's not an easy problem. Cranks and pseudoscientists, not to mention many of us when we're misguided on occasion, know how to dress up completely irrational views in very scientific sounding language - what sounds, on the surface, like a scientific controversy is really a cultural one. The media sensationalizes minor findings and thus gives dazed and confused readers the impression that major scientific conclusions are completely reversed every year (especially when it comes to the connection between diet and health).

    To help you stay on Nature's good side, here are a few rules by which you can navigate the waters of scientific wrangles:

    1) Believe the mainstream consensus. I know this sounds boring, but the consensus is your best bet. Yes, it can be wrong. Often, there is no consensus to rely on; but when there is one, it's most likely the best-supported scientific position out there. The mainstream consensus takes time to build, and it is generally not overturned by a single overhyped, recently published paper. We love our underdogs, unfortunately, because we believe in being open-minded and fair. And in fact, the professional scientific community, for its own health, needs to keep them around. But unless you have the expertise to independently judge the arguments for yourself, don't bet on them - just like you don't bet on the bottom-ranked teams in March Madness unless you really know what you're doing.

    2) Learn to live with ambiguity and uncertainty. On many issues, there is no scientific consensus. That doesn't mean that you now get to pick the theory that most closely fills your emotional needs; it means that we don't know the answer. Don't take my word for it - listen to Feynman:

    We absolutely must leave room for doubt or there is no progress and no learning. There is no learning without having to pose a question. And a question requires doubt. People search for certainty. But there is no certainty. People are terrified—how can you live and not know? It is not odd at all. You only think you know, as a matter of fact. And most of your actions are based on incomplete knowledge and you really don't know what it is all about, or what the purpose of the world is, or know a great deal of other things. It is possible to live and not know... (The Pleasure of Finding Things Out, p. 112


    3) Contrarianism may be cool, but that doesn't make it right. Especially if your contrarianism violates rule #1.

    4) The side that invokes conspiracy theories in any scientific argument is pretty much almost always the wrong side. Individual labs, or, more likely, government or corporate organizations may conspire to suppress research results, but the scientific community at large is incapable of organizing a conspiracy to hide all that great evidence against evolution, global warming, the health benefits of tobacco, etc.

    5) Big scientific ideas are always supported by multiple lines of evidence, often from different disciplines. One small finding in one field doesn't take you very far. Evolution is supported by research in molecular biology, biochemistry, developmental biology, population genetics, paleontology, and many other fields. The main consensus in climate change is supported by research in geology, oceanography, atmospheric sciences, etc. These may sound like just words, but in reality, these are very different disciplines - the training is different, the vocabulary is different, the research techniques are different, and generally, an expert in one of these fields doesn't function very well in the other. This takes us back to rule #1: when competitive, obsessive, independent-minded scientists from different disciplines manage to come to a major consensus on something, it's a big deal.

    Follow these rules, and you'll go right more often than not.


    If you've got more ideas, put 'em up in the comments.


    Read the feed:

    Comments

    While cranks of all stripes love attacking the notion of scientific consensus when it comes to evolution, AGW, HIV-AIDS or whatever, well, they generally ignore that... well, there's also a scientific consensus about quantum mechanics, or the double helix structure of DNA, or the unity of electricity and magnetism.

    Off topic: the last three posts don't seem to have shown up on the front page. Not sure what's up with that.

    Wow, would I ever disagree that this is the way to "not get blinded with science". It seems that the single best way to get blinded with science is to follow your rule number 1.

    The biggest problem with rule number 1 is the long list of consensus positions that have been abandoned. You have mentioned a few, "center of the universe", "completeness of Neutonian physics", "global cooling". However the list also extends to the static universe, eather, phlogiston, and no and on.

    Rule 2, a great rule! Uncertainty, ambiguity, is the most effective tool that science has for keeping itself honest. Living in the ambiguity, not taking a hard, fast position is a wise way of avoiding getting blinded with science.

    Rule 3, well, contrarianims for contrarianism's sake is stupid. However, rule 4 is the rule that truly protects us from getting blinded with science. If a person seeks out the lines of evidence that support a theory, and finds them missing, or wanting, then contrarianism has a place -- as long as it is tempered with uncertainty.

    Rule 4, yes, this is the one rule to go by, except for rule 2 when rule 4 hasn't been proved. I accept that the world is round. Why? Because it is "the scientific consensus"? No! Because there are multiple lines of evidence, and I have checked out some of them. (Was pretty easy flying back to Canada from England in the evening. It was the longest evening of my life.)

    Though I've never been there, I guess I am from Missouri -- show me. I believe that the scientific community has an obligation to make its case to the educated public. If it truly has multiple lines of evidence, each line should be a useful tool in making the case. As such, rule 1 should be fully abandoned. (Though I do think that governments have a need to respect the scientific community. Doing so, in the oligopoly that is government almost obligates the acceptance of rule #1.)

    I look at the case for global warming. I clearly see multiple lines of evidence showing that the earth is warming. The melting of the arctic sea ice comes to mind. However, I also notice evidence of a significantly warmer climate in the not terribly recent past (tree stumps under the columbia ice fields, for instance.) I also see a clear cut case that CO2 is rising at an alarming rate. I still see a huge piece missing, however. I don't see a clear causal case that CO2 produces warming especially in light of the fact that H2O vastly ecclipses CO2 as a greenhouse gas. What I would appreciate is a nice little experiment, two "greenhouses" identical in every way including air pressure, and humidity. If one were spiked with CO2, according to the theory it should get warmer. The amount of such warming should be accurately predictable with the existing modeling software. Such an experiment would produce a compelling line of evidence right in the area of scientific weakness.

    Now, that said, I choose to exercise rule #2 on the issue of global warming. However, erring on the side of caution seems to offer a whole bunch of side benefits. If we can divest ourselves of burned fossil fuels, we will get the benefit of cleaner air. Certainly that is something we can all agree on. I disagree with those who say that the economic cost of taking on such a project is great -- too great. Again, I'm happy to err on the side of caution on this one.

    adaptivecomplexity
    The biggest problem with rule number 1 is the long list of consensus positions that have been abandoned. You have mentioned a few, "center of the universe", "completeness of Neutonian physics", "global cooling". However the list also extends to the static universe, eather, phlogiston, and no and on.


    The center of the universe and global cooling were never a scientific consensus (the one was from pre-scientific philosophy, the other was never a consensus), and Newtonian physics still does extremely well in most everyday cases, so it was a decent bet.

    It's hard (not impossible, but hard) to find a genuine major scientific consensus, one that was well-supported and not just a theory made up in the absence of evidence, that has been completely overturned. I'll agree that the luminiferous ether and phlogiston were major, mainstream ideas that were  overturned. But still, at the time they were not bad bets - phlogiston, for a long time, represented the best understanding of the process of oxidation scientists had, and the ether was an important background assumption in physics.

    More often than not, a big, well-supported mainstream consensus is right (combining rules 1 and 5). And even when the mainstream consensus turns out to be wrong, it's generally your best bet at the time. Non-experts are far more likely to go wrong picking non-consensus ideas, because there are so many bad ones.
    Mike
    From the eyes of the intelligent non-scientist, There are two additional fundimental problems with rule #1:
    1 - The public literature is painfully unclear on where consensus lies. Is there consensus about the multiverse hypothesis. Yes, its an hypothesis, so obviously not. However, when you read the public literature it isn't all that clear. What of abiogenesis? Reading the popular literature you would be pretty sure that science has a clue. Unless you watch for a while, and see the literature declare -- it must have happened around deep ocean vents, it must have come in on asteroides, we figured out how to make two of the four bases of RNA under prebiotic conditions. String theory, in the bag?
    2 - There is something painfully "us and them" about rule number 1. (in a deep authoritative voice) "We the great and wonderful scientists have come to a consensus. Don't ask us to show you the evidence because you obviously wouldn't understand. You are not a scientist. You are an idiot."

    I shall hold tightly to rule #4, and rule #2. If the scientific community can't package up logical cases, I am not ready to bet on the validity of the consensus position.

    The scientific community has a huge hole in the interface between science and society. Until the community recognizes and bridges this hole, science will not get the respect that it believes it deserves. And Richard Dawkins (whose job it is to do exactly this) isn't helping.

    Gerhard Adam
    I shall hold tightly to rule #4, and rule #2. If the scientific community can't package up logical cases, I am not ready to bet on the validity of the consensus position.
    I don't think you're really disagreeing, as much as you're acknowledging that many of the questions you mentioned don't really have a legitimate or verifiable consensus.  There may certainly be some that are more vocal than others, but it is important to consider what the basis for the consensus is (i.e. is it data, or merely the prevalence of opinions).

    If a consensus view is simply an educated guess or opinion, then regardless of its popularity, it still isn't scientific and doesn't warrant any additional weight.

    In effect, it would be better to acknowledge the questions that we don't have answers to, rather than to create the impression that answers exist when, in fact, they don't.
    if an alternate or opposing "theory" depend entirely picking at alleged holes, gaps or unknowns in the prevailing theory - then it's a clear sign that the alternate theory isn't one at all.

    Just a couple of thoughts on what you've wrote:

    On point (1), I think it's better to be clear that it's the mainstream scientific consensus which you are talking about. The popular consensus on many things can often be wrong. For instance, there was a mainstream scientific consensus that cigarettes are bad for you before there was a mainstream popular consensus that cigarettes are bad for you.

    On points (2) and (3): We'll, I think it's possible to be contrarian and propose alternative views without actually putting your views forth as the absolute truth. Being contrarian is not the problem, the problem is gullibility. You can entertain a heterodox idea without accepting it and learn a lot in the process. "It is the mark of an educated mind to be able to entertain a thought without accepting it." Being contrarian, in general, is very good. My feeling has always been that questioning things and having a working hypothesis greatly aids in the process of discovery.

    Gary Herstein

    I've been buried these last few months in the absurdity of what passes for my life, but I actually touched on this subject a little while ago. So this might actually be relevant:

    http://www.scientificblogging.com/inquiry_inquiry/what_does_real_scientific_controversy_look

    Gerhard Adam
    Well, Gary, hopefully you'll get a chance to come around more often.
    critser@earthlink.net

    One thing distinguishes this era from all others when it comes to public debate about science: the existence  of enormous media corporations that directly benefit and profit by intentionally propogating anti-science bigotry. My rule number one is: if anyone on Fox News believes it, it must be a lie. Period. I then I lick another stamp and send off another poison pen letter to Bill O'Reilly, an alleged mammal.
    On contrarianism. There was a time when a good contrarian rant might have meant something--if it came from, say, an HL Mencken or a Mark Twain. Now contrarianism has its own market niche, and its own bullshit rules: stake out a straw man, use secondary and tertiary sources to try to burn that straw man, then extrapolate as widely and indiscriminately as possible to "prove" that all the friends of the straw men ought to be burned too.
    Use mainstream scientific concensus as a place to begin forming your own ideas--it's better that starting with the ill-reasoned "mavericks" any day.

    Greg Critser

    adaptivecomplexity
    Now contrarianism has its own market niche,
    Contrarianism, counterculture, rebellion, existential angst - it all has its own market niche these days. Mencken would have had a rough time distinguishing himself in the 20th century.
    Mike
    Hank
    Gotta give it up for Critser's rant, though.  That was good stuff.
    adaptivecomplexity
    I always like Critser's stuff. And he does have the righteous rant down.
    Mike
    Amateur Astronomer
    The main stream of science doesn't advance very quickly, just enough to get by and support the down stream commercial interests. Science advances more quickly on the fringes, not all the fringes, just a few of the many. That's why most of the new science is coming from small startup companies. Big organizations do not innovate very well even when they try. Large companies buy their new technology. For environmental claims, I tend to read the technical papers and data tables, paying careful attention to design of experiments and who is being asked to bear the burden of proof. The main stream of science is not very helpful in this area.
    critser@earthlink.net

    For environmental claims, I tend to read the technical papers and data tables, paying careful attention to design of experiments and who is being asked to bear the burden of proof. The main stream of science is not very helpful in this area.

    Yes, see Bruce Cicerno's recent hand wringing in Science lead letter

    Greg Critser

    Add a comment

    The content of this field is kept private and will not be shown publicly.
    • Allowed HTML tags: <sup> <sub> <a> <em> <strong> <center> <cite><TH><ul> <ol> <li> <dl> <dt> <dd> <img> <br> <p> <blockquote> <strike> <object> <param> <embed> <del> <pre> <b> <i> <table> <tbody> <div> <tr> <td> <h1> <h2> <h3> <h4> <h5> <h6> <hr> <iframe><u><font>
    • Web page addresses and e-mail addresses turn into links automatically.
    CAPTCHA
    If you register, you will never be bothered to prove you are human again. And you get a real editor toolbar to use instead of this HTML thing that wards off spam bots.