Nov 25 2009
The End Of The Earth Is Coming, But Scientists Cannot Write Professional Quality SW!
There is a well known problem when research scientists have to interact with the real world: they hate to be bothered with rules, regulations, laws, etc. At NASA the lowest quality code you will find is in the science processing chain. It is just not held to the same quality standards as the operational code the runs all the flight and ground HW.
For example: you can’t have PhD quality code launching massive rockets over this countries large cities running up the eastern coast. You can’t have PhD level code controlling large antennas, since you don’t want them be destroyed as you move these massive machines or fry someone by turning them on when people are working on them. You don’t want PhD quality code landing the Space Shuttle. It’s that simple and no NASA PhD will argue that point.
The truth is the science teams don’t get enough funds to do it right, but that is only half the problem. The other half is the scientists like to write crappy code only they can use – creates a lot of job security. For much of science this is a livable and reasonable arrangement. Let the PhD’s dabble in exploring the unknown, and leave the designing, operating and safety of large complex systems (which can kill lots of people if things go wrong) to lesser people – like engineers.
When the global warming canard migrated from niche research into trillions of dollars of policy changes effecting every human being on the planet, the PhD level of quality control should have been ejected immediately. With the fate of humanity at risk, it is not too much to ask for professional quality code, analysis, and a true peer review process. Not that silly science journal review process by the good ol’ PhDs network, a real review like we do when we launch people into space or build a rail system or a new airplane.
I was struck by this excellent review of how the global warming alarmists were reacting to the scientific community who were attempting to check their work, many of whom have to deal in the real world (a slightly updated version is available here). Some of the emails disclose just how unprepared these so called scientists were for the real world and its demands for quality and safety. It indicates an almost child like inexperience. This one caught my eye and caused me to write this post:
Thanks†Ben for this, hi all and happy new year. I had a similar experience– but not FOIA since we at Climatic Change are a private institution- -with Stephen McIntyre demanding that I have the Mann et al cohort publish all their computer codes for papers published in Climatic Change I put the question to the editorial board who debated it for weeks. The vast majority opinion was that scientists should give enough information on their data sources and methods so others who are scientifically capable can do their own brand of replication work, but that this does not extend to personal computer codes with all their undocumented sub routines etc. It would be odious requirement to have scientists document every line of code so outsiders could then just apply them instantly. Not only is this an intellectual property issue, but it would dramatically reduce our productivity since we are not in the business of producing software products for general consumption and have no resources to do so. The NSF, which funded the studies I published, concurred–so that ended that issue with Climatic Change at the time a few years ago.
Not to mention no ability to do so. To develop high quality, bug free and error free code takes a lot of infrastructure and training. And it does require documenting code so that teams of reviewers can sift through it and make sure there are not bad surprises. You don’t want to hit a SW “feature” in your car’s computer system as your racing 70 MPH through a turn. You also hire testers who run the code in all sorts of configurations to try and detect errors. And if humans could be hurt you hire independent reviewers and testers.
This is the real world, when hypothesis has to be implemented. This is where the alarmists can’t go and can’t be bothered. Check out this lame excuse from your classic elitist PhD:
You and I have spent over a decade of our scientific careers on the MSU issue, Tom. During much of that time, we’ve had to do science in “reactive modeâ€, responding to the latest outrageous claims and inept science by John Christy, David Douglass, or S. Fred Singer. For the remainder of my scientific career, I’d like to dictate my own research agenda. I don’t want that agenda driven by the constant need to respond to Christy, Douglass, and Singer. And I certainly don’t want to spend years of my life interacting with the likes of Steven McIntyre.
I hope LLNL management will provide me with their full support. If they do not, I’m fully prepared to seek employment elsewhere.
This poor, lazy PhD cannot be bothered, so he will quit. He should quit. He doesn’t have what it takes to develop something for real. It takes sacrifice, painful review and testing. It takes being challenged day in and day out so that what comes out is near bullet proof. It takes sweating the little stuff and attention to mind numbing detail. It takes a team because no one person can do all or see all. It takes climbing down off one’s ego-throne and doing what it takes to make a high quality, reliable and safe product.
The alarmist PhD may look impressive to those journalist majors who went into the Lame Stream media pretending they could grasp the complexity of human endeavors, but to those of us doing the endeavoring the CRU group look like a bunch of rank amateurs who got busted breaking the law trying to cover up their shoddy products.
As the author of the piece notes, if the alarmist ‘scientists’ acted like real scientists and just put out their data and methods (and produced even quasi professional code) they wouldn’t be wasting their lives defending their mistakes. Science and engineering and law are all adversarial systems which provide a crucible from which truth and real solutions can emerge. Failure to go through the crucible is not a trick – it is just failure.
AJ, you’re touching on something that has been gnawing at me for a while…a nasty suspicion that the scientific community needs engineering supervision.
As you noted, engineers are trained to Get Things Right. When I started at Virginia Tech, the first thing taught in the first engineering class was that lives will ride on your work. Error is fatal.
The scientific community has customarily enjoyed the freedom to be wrong without consequence. To theorize, have theory contradicted by fact, and come up with a better theory.
But this freedom has been misused for political purposes. Faked data, suppression of opposing theories…the sort of behavior I would associate with high school students playing popularity games, not scientists.
No. It’s time to put the scientific community under the supervision of people trained the Get Things Right. If your theory is wrong, you may not lose your job or funding…but you will most certainly explain WHY you were wrong to a Board of Supervisory Engineers.
Who will have the authority to bar you from receiving further funds, and the power to publicly denounce you as a fraud.
Considering the billions of tax dollars in research grants the global climate studies are receiving, and the trillions of dollars and radical changes to our economy, society, and national security at stake, some effort should be made to provide reasonable assurance that these analyses are done right. Perhaps the PhDs could hire some real-world production programmers to re-code their analysis algorithms to industrial standards from formula specifications and the result checked against that produced by the code the PhDs wrote. Any discrepancies would have to be tracked down to determine if they were due to coding errors or formula documentation errors. That shouldn’t cause too much hardship on the scientists, would produce a library of more usable analysis routines for future studies, and, though the process would be expensive, wouldn’t it be worth it to know the results were at least an honest product of the proposed theory?
[…] job of incompetence. I mentioned the difference between sound code and ‘PhD level’ code here and here. The best insight into the mess is the HARRY_READ_ME file, which screams out for […]