ENCODE and the Truth

3/29/13

Constant facts of all scientific endeavors – Nature always wins. The truth will come out.

An absorbing article last month in The Scientist called The A@#hole Scientist  wondered if scientists could be a-holes, as it called them. Of course they can. Simple logic. Scientists are human and humans can be a-holes. QED.

According to the article, a-hole scientists act by “denying funding to one’s competitors, disparaging them or their results, getting them fired, delaying publication of their work—all simply for vanity, supposed superiority, or envy dressed up as rightness.”

In essence, they make it personal.

I was struck by these examples recently while watching the continuing discussions of ENCODE’s work.

And these discussions also reflect directly on something I helped write for Xconomy on ENCODE, providing us further insights into human aspects of doing science.

Let’s work our way through this.

“All simply for vanity, supposed superiority, or envy dressed up as rightness“ reminded me of Richard Feynman. Not because he was an a-hole but because he was such a keen observer of humanity.

No more so than in an influential speech he gave in 1974 entitled Cargo Cult Science.

Every scientist should read it. It does an amazing job describing the human enterprise of research.

Smart researchers get the science wrong, fool themselves into believing that what they WANT to be true IS actually true, allow their own vanity, supposed superiority or envy to impair progress:

“We’ve learned from experience that the truth will come out. Other experimenters will repeat your experiment and find out whether you were wrong or right. Nature’s phenomena will agree or they’ll disagree with your theory.  And, although you may gain some temporary fame and excitement, you will not gain a good reputation as a scientist if you haven’t tried to be very careful in this kind of work.”

Researchers can be the easiest people to fool. Feynman gives some classic examples demonstrating how scientists fooled themselves for decades, because they ‘believed’ they knew the facts. Personal hubris and ego, plus the rush to gain some fame and excitement, can be very powerful.

But Nature always wins. The truth will come out.

Researchers often make all sorts of biased decisions that have little to do with rational thinking.

They can act like the a-holes described in the Scientist article. Sometimes to support biased models as Feynman discussed.

Science is made up of people that messily move the field forward for personal reasons, often based on their own emotional needs.

It is amazing that it works at all.

Feynman provides a hint – reputation. Science works because it is not alchemy; it is the very public display of the work. With reputation on the line.

It requires publication of research, discussion of the work amongst peers and the defense of ideas. Some models wither rapidly. Others withstand the onslaughts and become powerful models of Nature.

Science is about putting research models – faulty as they are – out into the public arena to fight with other ideas. A healthy competition eventually sculpts a model with some semblance of reality, even though carved by frail humans.

To paraphrase Feynman – Nature and reality will agree or disagree within the public battle of ideas.

This brings me back to ENCODE and its work. Because there has now been a strong pushback on their model describing the transcriptional importance of genomic DNA sequences.

The discussion seems to have many aspects described in “Cargo Cult Science” and “The A@#hole Scientist” – surety of views, lack of humbleness, disparaging attacks and even a hint of workaday a-hole moves.

And one side in particular has made it personal.

Dan Graur, the lead author of a paper critical of ENCODE’s work, said: “Everything that Encode claims is wrong. Their statistics are horrible, for a start. This is not the work of scientists. This is the work of a group of badly trained technicians.”

Ouch!

Graur’s paper is a biting critique of ENCODE’s work, using words like “absurd”, “fallacy”, “transgressions” and “hype” – and that … Next Page »

Richard Gayle is the founder and president of SpreadingScience. Follow @

Single Page Currently on Page: 1 2 3

By posting a comment, you agree to our terms and conditions.

  • http://www.facebook.com/erik.nilsson.961 Erik Nilsson

    Great article on one of the most important current scientific debates.

    One lesson of biology is that it’s a lot safer to say “we don’t know what that does” than it is to say “that doesn’t do anything.” That’s one of the things that makes biology fun. Graur (the person and the article) comes across as a vicious defender of a incompletely-articulated orthodoxy. For pseudogenes, he’s sure that if he doesn’t know what they do, they don’t do anything. In the abstract, his position is implausible; in this specific case, he has to do some very fancy arguing to avoid being obviously wrong.

    I don’t really understand what Graur wants done different. How are we supposed to find his “pseudogene look-alikes” without looking at what we now think of as pseudogenes? Gayle correctly points out that Graur is moving the goal posts. His attack on people is unambiguous. His attack on ideas lacks clarity.

    Asking Graur’s question backwards is also likely to be interesting: what might be the biological importance of DNA sequences with high mutation rates? Graur seems genuinely horrified that the human genome might have *important* regions of instability. Well, nature wasn’t put here to satisfy anybody’s sense of esthetics. There is no a priori reason that DNA regions not under evolutionary pressure for a highly-conserved sequence can’t have biochemical importance. ENCODE is a reasonably cheap way to find things we otherwise won’t get much data on.

    Graur makes it easy for his critics to paint him as a dogmatic bully. In the TV movie version of history, these people lose in the end. Of course, if the dogmatic bully is right, the TV movie never gets made. As Gayle points out, we’ll get the right answer, and probably fairly soon, petty games or no.

    • http://www.facebook.com/rgayle Richard Gayle

      Erik, you make a great point about the decision regarding what to look at. The idea of purposefully looking for function in areas that do not look like they are being selected for is a wonderful paradigm-shifting way of breaking through imposed constraints in our enquiries.

      As Heisenberg said, “What we observe is not nature itself, but nature exposed to our method of questioning.” The method is as important as the question.

      The approach from some ENCODE critics seems to greatly limit the questions and perhaps constricts just what we can learn.

  • Pedro Fernandes

    This is an important article about two subjects: the attitude of scientists and the ENCODE debate itself. I was delighted to review the Richard Feynman quotations through the links, some of them I had forgotten, and I agree wit the author’s vision of the ENCODE subject. Nature itself will disentangle it,but in the meantime this article sheds some light onto important aspects of the debate.

    • http://www.facebook.com/rgayle Richard Gayle

      Pedro, Thanks for the kind words. I entered CalTech in 1974 and that commencement speech was one of the first things I read in the campus paper. It had a huge impact on me and on how to actually do science. I love excuses to connect others to his words.

  • http://twitter.com/Nanostring Nanostring Founder

    “Because Nature is always right. The truth will come out.” Yes, true, and Nature doesn’t give a rat’s twitch about much of the other stuff that you wrote prior to this statement. An ego-driven a-hole can be right or can be wrong. A humble work-a-bee can be right or wrong.

    It’s fascinating how people get carried away with all this psychological/sociological babble as if it has anything to do with the scientific argument at hand. The truth comes out, Nature wins, everything else is yadda-yadda-yadda…

    One sector that has been able to overcome getting caught in such nonsensical “shrink” talk is – you may be surprised – sports. Kobe Bryant is a recognised a-hole; Tim Duncan is the nicest guy on Earth. To basketball people they are both just great players. Ron Artest, Dennis Rodman, weird guys as they come, found work for years… Choirboy Tim Tebow is out of the NFL… And vice versa.

    I am not taking a side in the argument, at all. It’s just that you cant judge merit by how bellicose or egocentric, or nice or humble the author is. You just can’t.

    • http://www.facebook.com/rgayle Richard Gayle

      Which is exactly what I said. The personality of the researcher does not affect the data. However, science does not happen in a vacuum, Bullying behavior can be harmful because it can prevent work from being done. It can slow down how long it takes for the truth to come out.

      As Max Planck observed “A scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents eventually die and a new generation grows up that is familiar with it.” Science often advances one funeral at a time. Why? Because personalities can muck up the works.

      Feynman discussed this. He showed how simply the authority of Millikan prevented the correct value of the charge on an electron from being determined.

      The discussion is not whether we should only believe science from nice guys. It is that the behavior can affect how rapidly our investigations reveal truth.

      • http://twitter.com/Nanostring Nanostring Founder

        Oh, great points, great points. However, our generation, we have this “new age”-ism that sometimes brings the same harmful effects from the opposite direction. Where somebody’s argument can be impugned because the person is rough and uncouth.

        Let science and data speak. You have a platform the other side has a platform; leave style and personality aside, focus on substance.

        • http://www.facebook.com/rgayle Richard Gayle

          We are on the same page. Problems arise when people use purely rhetorical approaches to make their arguments. And we are a very argumentative species where winning makes more of a difference than being right. We both know that things like grants are seldom prey based on substance, for example. So we just need to recognize it and work to minimize its impact.

  • Curt Malloy

    Nicely done, Richard — thoughtful and provocative.

    • http://www.facebook.com/rgayle Richard Gayle

      Thanks, Curt. It is very hard for to be both thoughtful and provocative in just a few thousand words ;-)

  • Martin Hafner

    Aren’t you aware of ENCODE’s press releases and the interviews Ewan Birney et al gave in September 2012? Aren’t you aware of the other two papers criticizing ENCODE befor Graur et al. appeared? Didn’t you read Ford Doolittle’s PNAS paper? Without Graur’s paper they would have gone unnoticed. If you listen to Birney’s BBC interview (http://www.bbc.co.uk/iplayer/episode/b01qwhtp/Material_World_Junk_DNA_mine_fires_Homer/) you may get the feeling that he is squirming not to having agree to that ENCODE’s “no junk et all” claim was wrong, uneducated and stupid.

    • http://www.facebook.com/rgayle Richard Gayle

      I was responding to a narrow part of the matter because I only had a couple of thousand words of allotted space. So I focussed on, what in my opinion, are the faulty rhetorical points – both scientific and ad hominem – from one particular group. The article was not meant to be authoritative on the entire controversy.

      Do I believe that ENCODE is completely correct and has accurately described Nature? Unlikely, as I state in the article. Do I think that Graur and his paper is completely correct and has accurately described Nature? Unlikely, as I state in the article.

      Do I think either side of the controversy is stupid and uneducated? Do I think either are bad scientists? Or even badly trained technicians? Nope, because I feel those are inappropriate rhetorical arguments when dealing with a scientific controversy. Those arguments have nothing to do with the data, the hypothesis or the theory. I believe that those sorts of bullying approaches, using ad hominems and other logical fallacies, do little to enhance our knowledge of the world around and are, in fact, part of the tools used to diminish our understanding. They are great in a court room but not useful for those people truly interested in knowing more about the natural world around us.

      • Martin Hafner

        My impression is that you only mean Dan Graur when you refer to Asshole Scientists. Who actually claimed that textbooks have to be re-written? Actually, Nature has Junk-DNA proven right 40 years before ENCODE. Birney et al. could submit a rebutal. However, instead they are actively ingoring the four critical papers and rather try to detract from the core of the discussion by repeating again and again how important the data are. However, they still don’t accept that 80% of their data should at least be considered as noise rather than signal.

  • Roger Shrubber

    There’s a very reliable way to distinguish the hype artists from the real scientists. The hype artists never directly address their critics. The ENCODE project is trailed by a legacy is critics that cite prior work and the recent ENCODE publications have simple ignored that criticism. They don’t even seem to understand the published definition of “Junk” DNA that they claim to be overturning.

    • http://www.facebook.com/rgayle Richard Gayle

      Part of the point is that it does not matter if the work is done by hype artists or by ‘real’ scientists. Nature wins no matter who is hyping or who is a ‘real’ scientist. What does matter is whether the work, the theory or the hypothesis being examined moves our understanding forward or stops it dead. ENCODE could very well be wrong but its approach – including the controversy it may engender – moves us forward. Some of the arguments of Graur fail to do that, in my opinion.

      Whether someone responds in a proper rhetorical fashion or not – and I feel that ad hominem arguments as espoused by Graur are not a proper rhetorical response – has little real bearing on the underlying data and science.

      I tell hype artists from ‘real’ scientists partly by the types of rhetorical tools they use to make their arguments. Ad hominems, appeal to authority, ad hoc arguments and other fallacies are not the proper tools of scientists interested in understanding Nature. As the saying goes, when the law is on your side, argue the law. When the facts are on your side, argue the facts. When neither is on your side, holler. I do not value arguments that resort mostly to hollering.

      • Roger Shrubber

        I could take issue with many of your points but why quibble. The key point to consider rests on reading on understanding Feynman’s address on “Cargo Cult Science”. In particular, Feynman addresses the requirement that we first be our own harshest critic, and that we address ways we can be wrong. That is what ENCODE utterly failed to do. And more than failing to be introspective critics, they failed to, and continue to fail to, acknowledge well reasoned and thoughtful criticisms. To those _in the know_, it is so glaringly obvious that it sparks up the sort of frustration seen in Gaur’s response. And frankly, it’s time to stop putting up with Charlatans who never learned that most essential lesson that Feynman spoke of. They damage the process. People look at them and think that hyping results is OK and that ignoring your critics, and avoiding being a self-critic is OK.
        It isn’t, and they deserve a public spanking.