The Dunning-Kruger effect: deniers may “take down” what they don’t understand but at heart they are curious

Abstract: The Dunning-Kruger effect describes a cognitive bias, whereby individuals with limited skills – but with an overconfidence in their skill set – overestimate their abilities. I would contend the denial movement is rich with such individuals, who may be highly competent in other areas, but display a remarkable lack of understanding of science and the scientific method. I tested one such “denier community” for signs of Dunning-Kruger with positive results. While not an actual piece of research, I believe the responses I gathered tend to support the idea that many in the denial movement exhibit cognitive biases such as the Dunning-Kruger effect.However I also learnt that many of the “deniers” are articulate, curious about the world and actively engaged in trying to understand some of the science.

I have a confession to make: I am not qualified to discuss the intricate, technical details of climate science.

It’s beyond my capability.I can grasp the essentials, and even make sense of (some) the actual peer-reviewed research that I read. However I am very conscious that I have large gaps in my knowledge, and that crucially I am not qualified to critique the work of science.In order to have a real understanding I’d need to pursue a Bachelor of Science and post-graduate degrees to be able to speak authoritatively on climate science.

Like an avid footy fan, I understand many details of the game, but I’ve never played. However, what I’ve noticed about many deniers is their incredible confidence in being able to not only understand the science but critique it authoritatively.

Indeed, you’ll often find in both forum discussions and in person they can state with complete confidence that they have read the research, understand it and see “several crucial flaws” in it. Do they have a special insight that many of us lack? I suspect not, however there is a very good explanation for their apparent confidence.

Dunning-Kruger: how people overestimate their own abilities

The “Dunning-Kruger effect” is a form of cognitive bias which – put simply – states that unskilled people overestimate their own abilities. First published in the Journal of Personality and Social Psychology in December 1999, the author’s hypothesis is best summed up on Wikipedia:

  • Incompetent individuals tend to overestimate their own level of skill.
  • Incompetent individuals fail to recognize genuine skill in others.
  • Incompetent individuals fail to recognize the extremity of their inadequacy.
  • If they can be trained to substantially improve their own skill level, these individuals can recognize and acknowledge their own previous lack of skill.

The paper can be found here (the abstract is free, though you will have to pay for the article in full):

People tend to hold overly favorable views of their abilities in many social and intellectual domains. The authors suggest that this overestimation occurs, in part, because people who are unskilled in these domains suffer a dual burden: Not only do these people reach erroneous conclusions and make unfortunate choices, but their incompetence robs them of the metacognitive ability to realize it. Across 4 studies, the authors found that participants scoring in the bottom quartile on tests of humor, grammar, and logic grossly overestimated their test performance and ability.People tend to hold overly favorable views of their abilities in many social and intellectual domains. The authors suggest that this overestimation occurs, in part, because people who are unskilled in these domains suffer a dual burden: Not only do these people reach erroneous conclusions and make unfortunate choices, but their incompetence robs them of the metacognitive ability to realize it. Across 4 studies, the authors found that participants scoring in the bottom quartile on tests of humor, grammar, and logic grossly overestimated their test performance and ability

I believe that is sufficient to explain what Dunning-Kruger effect is. The question is, do we have examples of it from climate change deniers?

The answer is, we do.

My own experiment: Jo Nova’s blog

Jo Nova, the Perth based denier has quite active discussions on her blog site. They provide rich examples of conspiracy theories, vicious attacks on climate scientists and technical discussions on climate science.

I entered these boards to see how readily the denier community centered around this board potentially exhibited the Dunning-Kruger effect.

For my own variation of testing the Dunning-Kruger effect I engaged several posters in a discussion on the “evidence” for the relationship between the concentration of CO2 in the atmosphere and temperature. The science itself is well established, and can be easily found on the Internet.

I posted links to several peer-reviewed papers as “evidence”: in fact, this was demanded by Jo Nova and several posters.  The papers I provided this community with were sourced from AGW Observer, and relate specifically to “the correlation between carbon dioxide concentration and temperature.”

Very quickly, the forum was alive with comments. Indeed, many posters felt they could dismiss the research in a quick and easy manner:

Mike #21, I can’t look at all your articles but this one caught my eye:

A Bayesian Statistical Analysis of the Enhanced Greenhouse Effect – Tol & De Vos (1998)

In particular they provide a regression equation (2) and a graph Figure 1 that goes up to 1990 and would be interesting to apply the same equation to the years from 1990 to 2009 and see how badly it diverges.

Unfortunately, they don’t actually specify the coefficients of the FIR filter that they use for CO2 values (see Appendix B), I could take a reasonable guess at that one. They also attribute the Dust Veil Index to Lamb (from the CRU at East Anglia) and the Lamb data file is here:

ftp://cdiac.esd.ornl.gov/pub/ndp013/ndp013.dat

This is not in a suitable format (not yearly samples) and many values are missing, does not even go up to 1990. Mike Mann provides his version of the DVI here:

http://www.ncdc.noaa.gov/paleo/ei/ei_data/volcanic.dat

Which does go past 1990, but not as far as 2009. Maybe this was the file the Bayesian analysis actually used? Note that the Mann file contains values for earlier years that Lamb had no values for. Also I stumbled onto this:

http://bobtisdale.blogspot.com/2008/04/mann-et-al-weighted-dust-veil-index.html

So other people have already noted the strangeness of DVI values.

This is a typical problem with trying to reproduce even basic equations and plots in these papers — chasing up the many bits of data that are not tightly referenced and difficult to get hold of. Their conclusions were very strong probabilities of several degrees of temperature sensitivity, however their main cooling factors were DVI and ENSO and in recent 15 years I doubt that would account for the actual observed global “mean” temp, ENSO has not been spectacular in any direction and not a whole lot of volcanic dust in the air either (but there has been some).

Also, their regression between 1870 and 1990 has bigger problems if you look at the Greenland ice cores that show a brief warm period approx once every 1000 years (e.g. Roman warm period, Medieval warm period). How good is a regression that takes a little sample of time in a longer and far more complex time series? The regression can only use what it has, it can’t know there is a peak every 1000 years.

My gut feeling is that this article is flawed, but with up to date data series I could solidly prove it was flawed by observing whether their regression equation predicted the recent cooling. Maybe you can help find the data and we can nail this one good.

There’s allot to take in here, and the author of this post sounds authoritative. However, what is worth noting is how confident he is in proving how flawed a highly technical piece of research is.

I will pay that poster credit: he/she is trying to find other sources to confirm or deny the conclusions of the paper.

Most comments where more akin to this:

geronimo

mike at 9.15pm:You haven’t read the papers your referred to have you? None of them have empirical evidence of CO2 causing temperature increase. It’s too difficult to provide empirical data, which usually means it’s the wrong theory. We have plenty of ice core data showing no relationship between temperature and CO2 except for the CO2 rising in response to a temperature rise.

In this instance no sources or counter evidence is provided, just a confident dismissal of the science.

These people are not stupid, they’re curious

The first poster accepts the papers are talking about CO2 concentrations and temperature rises: they simply reject the papers conclusions. The second poster does not think contain any evidence, and easily dismisses them.

Do I regard these individuals as “stupid”, “incompetent” or “completely unskilled”? No, not at all! Actually, I did not expect them to be any of those things. The heart of the matter is this: too many people think they are qualified in areas they are not.

I came away with the conclusion that many members of this community are articulate, engaged with the debate and intellectually curious.However, like me they lack a full understanding of the science.

Untested assumptions

I will admit that I ignore several key variables in my little “experiment ” which I readily admit:

  • I do not know the educational or professional background of the posters, however the likelihood that they lack expertise in climate science is very high
  • It’s a very random sample, and in no way qualifies as actual research

In doing this have I also exhibited the Dunning-Kruger effect? Well. there’s a good question!

I will say that as a piece of research, what I’ve done is basically meaningless.Perhaps it was no more than a quasi-scientific excuse to act as a forum troll.

However, I was curious to see how this particular denier community would respond when exposed to genuine science. The results where as I expected: denial.

A long time ago I recognised the limitations of my own knowledge and understanding. I will defer to experts on highly technical subjects. What I do see in many deniers is an overconfidence in their own abilities and a complete dismissal of the abilities of climate scientists.

So, should we give up on deniers?

No we shouldn’t! I don’t believe deniers are “stupid” or “ignorant”. Many display a keen desire to understand the science and engage in discussion. Most are polite, and will happily chat to those “on the other side” of the debate.

Nor should we say to them  “just trust the scientists”. They don’t.

Conclusions

At heart many “deniers” claim to be curious individuals. I think there is some truth to that.

Helping them understand just how fiendishly complicated the science that supports climate change actually is may engender more respect for the work scientist do. I also think those in the denier community might enjoy the opportunity.

Perhaps we should be less concerned with bombarding the deniers with the results of research, but engaging them with how the science works. I actually think many of them would be fascinated.

Otherwise many of these individuals are left to the mercy of the peddlers of conspiracy theories and pseudo-science.

As Dunning-Kruger suggests:

…If they can be trained to substantially improve their own skill level, these individuals can recognize and acknowledge their own previous lack of skill

Perhaps scientists should be reaching out to the denier community and giving them an intimate insight into the scientific method and how they arrive at their conclusions.

About these ads

14 thoughts on “The Dunning-Kruger effect: deniers may “take down” what they don’t understand but at heart they are curious

  1. Bill Malcolm says:

    “The first thing you must understand is that you don’t understand.”

    The deniers have another trait: they are obsessed at letting everyone else know how brilliant they are. Never understood it myself; utter twits for some reason seem determined to argue the toss and to prove over and over again just what complete and utter idiots they are. They are oblivious of their lack of knowledge and feel they have to lecture others on that person’s inadequacies.

    So it’s a double shot fired at the competent person. First they are told they are wrong, and second, if they protest, they are subject to further harassment from the know-nothings.

    The internet has spread this phenomenon widely. Grocery-shelf stockers feel free to lecture someone with true expertise in any subject you’d care to name. Generally, it never occurs to them that they have no expertise themselves – quite where this misplaced confidence comes from is a mystery.

    So, a phenomenon I discovered quite soon after I became a manager at an electric utility and became responsible for hiring, was the huge number of people applying for jobs they felt they were competent to do, while essentially having zero clues about what the job entailed. They should have been embarrassed to apply! And this was usually from people already working at the company, whose policy was to hire internally first.

    It made you wonder if they sleep-walked through their cognitive life at work. People assured me time after time that, hey, after a couple of weeks, they’d be right up there on the competence scale. A few questions from me usually sorted the wheat from the chaff, while leaving the incompetents blissfully unaware that they had “blown” it.

    Time after time, following a position appointment, I’d get phone calls from the unsuccessful incompetents claiming they had been unfairly overlooked! They wanted to know why they didn’t get the job. My standard response: I found someone who I believe better suits the job – I’m afraid you will have to deal with that decision yourself. Feel free to apply for other jobs.

    Eventually, I got people who passed first muster to write a short essay on some subject, maybe related to the job, maybe not, by hand. Drove HR crazy.

    That essay would show: Are your thoughts organized? Do you demonstrate any flair whatsoever? Can you even spell?

    Easy to pick the best candidate from those reponses, let me tell you. The bad spellers were often the incompetent ones. Obviously their lives had been so busy and important to themselves, they hadn’t bothered to waste any time learning such mundane stuff – a clear clue their services should be avoided.

    I see there are a couple of people fitting my criteria of overconfidence posting here. Plus, the blog owner himself needs to spell “you’re” correctly. “Your” is not a satisfactory substitute. No excuses.

  2. Dave McRae says:

    Great post Mike, and I applaud your optimism, but my wee bit of experience to date is similar to ScruffyDan’s where the deniers, regardless of the evidence put to them or pleading to them to provide evidence that would pass scientific scrutiny, will remain deniers.

    I do like those that maintain that CO2 is IR-inert. I ask them how a CO2 laser works in their world and if I may attempt to burn off one of their fingers with a CO2 laser. We could televise this and they could blow open the CO2 warming scam at it’s base when the laser fails.

    I’ve tried on various blogs this challenge and finally now at this online blog http://galahs.blogspot.com/2010/04/carbon-dioxide-laser.html but still have no takers. You don’t know of any deniers that do stand by their convictions?

    • Watching the Deniers says:

      Some very good points Dave. However, I still believe there is a percentage – whatever that be – still “on the fence”. Public opinion can, and does shift, on issues such as this.

      BTW, I love the CO2 laser challenge :)

      CO2 is IR inert? Oh really – time to wheel out the laser. Shall we mount it on a shark ala Dr. Evil?

  3. ScruffyDan says:

    my experience has been different. I have enraged many deniers over the years and perhaps one or two were genuinely curious and trying to understand. Most were simply looking to support their preconceived notions by any means necessary (and frequently those means were mutually exclusive).

    Though I do agree that those who can demonstrate a genuine curiosity and desire to learn are worthwhile talking to. But I don’t call people like that deniers. Real deniers are simply not worth it, because nothing will convince them.

  4. […] Kenskingdom is a good example) may have a respect for the authority of science but thanks to the Dunning-Kruger effect, think they can do themselves. You too can be a cheeky climate denier […]

  5. Jackson says:

    Thanks for discussion of Dunning-Kruger. Sounds like “the wise man knows he has a lot to learn” aphorism…

    • Mike says:

      That’s was my take on it, and in may respects it’s like the old Socratic ida of acknowledging what you don’t know first.

  6. Mike says:

    I also hope people take the time to investiage Courtney’s status as a scientist. Given that he is not..

  7. hunter says:

    Thanks for the yucks.
    I guess Spencer and the Pielke’s are just curious little scamps.
    what aself-parody you have provided.
    Ciao,

    • Mike says:

      Thanks for stopping by hunter, and I’m very familiar with Roy Spencer. Not only does he doubt climate change, but he’s committed to creationism/intelligent design.

      Spencer is on the radar not just for his brand of climate denial, but for his support for ID. Sceptics around the world have been monitoring his anti-science activities for several years.

      Indeed one only has to read his own words at another one of his blogs, “The Evolution Crisis”:

      Yet as the 21st century dawned more and more scientists were expressing their doubts as to Darwin’s central theory. Over 700 have declared, “We are sceptical of claims for the ability of random mutation and natural selection to account for the complexity of life. Careful examination of the evidence for Darwinian theory should be encouraged.”

      And here he uses the classic creationist term “kind” to deny the evolution of different species:

      The differences between Chihuahuas and Great Danes are of a different kind altogether to the radical differences between classes like mammals, reptiles, fish, amphibians and birds. (Which is why they were classified as different classes in the first place).

      Now, many of your fellow posters are horrified to be linked to creationism. And yet “experts” such as Spencer not only seem to misrepresent climate science, but a great deal of science.

      I seriously question Spencer’s ability to objectively examine any branch of science as he starts from a creationist world view.

      I hope you take the time to critically examine the works of Roy Spencer, as they clearly indicate a world view consistent with the fundamentalist Christianity prevalent in the United States.

      As always, I hope you keep an open mind and examine both sides of the argument carefully.

  8. Baa Humbug says:

    Well that was fascinating. Now tell me, did you do the same experiment at an alarmist blog? If so, what was your conclusion? What were the differences between the two camps? If not, why not?

    I suspect, if you were to do the experiment at an alarmist site, you would necessarily reach the same conclusion (unless the alarmist blogs only host “qualified” bloggers)

    If the above is correct, what are we to believe? That we should all cease and desist from blogging about a subject that not only affects us fundamentally, but one we find interesting, enjoyable etc.
    Does the same apply to any other subject in our lives? say politics? afterall, most of us aren’t politicians. What about crime in society? We’re not cops nor are we in the judicial system.

    So what exactly are you saying? what have you achieved with your little experiment from which you “ignored several key variables”?

    Here is a thought for you. I’ll assume you are not an airline pilot. Can you tell when an airplane is being flown badly? I can. I’m not a pilot either. Nor am I a scientist, but I don’t need to take a 4 year degree to understand the difference between good/correct scientific procedure and bad/incorrect scientific procedure.

    On your blog about this experiment you state “The science itself is well established”. Well there you go you see, you’re just another lemming. THE SCIENCE IS NOT SETTLED, THAT’S WHY IT’S BEEN RAGING FOR OVER 22 YEARS.
    Did you not bother to read Richard S Courtneys post #75 before you posted your tripe at your blog? He IS a scientist. He HAS contributed to the IPCC. He IS qualified to comment about climate science and he, along with many others just like him SAY THE SCIENCE IS NOT WELL ESTABLISHED.

    Now, what does Dunning-Kruger have to say about lemmings?

    • Mike says:

      You know, your absolutely right Baa Humbug. If I conducted the same experiment on an alarmist site I’m sure I’d find many unqualified, but overly confident experts. Dunning-Kruger is not limited to those with particular world views.

      The important point is that we, as non-experts, need to recognise the limits of our own understanding.

      The individual opinion of one scientist is trivial compared to the consensus view of his colleagues. We can easily find scientists who “doubt” evolution (such as Michael Behe) or medical researchers who claimed a link between vaccines and autism (Andrew Wakefield).

      Sure there are minority opinions in science. Disagreement and debate is what science thrives on. However, being against the mainstream does not make individuals such as Behe and Wakefield brave mavericks.

      They’re wrong. And they are wrong because the overwhelming majority of science tells us that. Creationist and climate denier such Roy Spencer is wrong for the same reasons.

      Now, you can be like the creationists and anti-vaccination movements and claim the peer review system is broken and the science corrupted by vested interests… or you can acknowledge the limitations of your own knowledge and expertise.

Comments are closed.

Follow

Get every new post delivered to your Inbox.

Join 772 other followers

%d bloggers like this: