Dark Data and Open Notebook Science
I ran across an interesting Wired article discussing the merits of a new initiative: Open Notebook Science. This touches directly on the issue I brought up in a previous post.
So what happens to all the research that doesn’t yield a dramatic outcome — or, worse, the opposite of what researchers had hoped? It ends up stuffed in some lab drawer. The result is a vast body of squandered knowledge that represents a waste of resources and a drag on scientific progress. This information — call it dark data — must be set free.
It is a well written article, if a bit short, expressing why all research data should be open for public viewing. The “dark data”, results that didn’t see the limelight because they failed, were inconclusive or even contrary to the project, may be important to other research labs. Your trash may be my treasure.
In a similar vein, there is a movement called Open Notebook Science, championed by chemist Jean-Claude Bradley. This movement wants to make science completely open and transparent by having scientists post their notebooks. Complete access to notebooks, including the good, bad and ugly, would move science forward at a striking pace. I happen to agree with them. It is the next revolution in science. That said, it might take years to happen. There are a lot of politics and money tied up in the current system. Old habits die hard.
More links:
Jean-Claude Bradley’s blog
UsefulChem on Open Notebook Science
Science in the Open - blog on Open Science
Jeremiah Faith’s Open Notebook - Graduate student at Boston University
Jeremiah’s thoughts on Open Science