2. Credibility turns on the success or failure
of attempts to reproduce findings.
Kenneth Rogoff &
Carmen Reinhart
In economic models
âą coding errors
âą selective exclusion of available data
âą unconventional weighting of
summary statistics
Thomas Herdon, Michael Ash, & Robert Pollin (2013). Does high public debt
consistently stifle economic growth? A critique of Reinhart and Rogoff. Working
paper series 322. Political Economy Research Institute, U Mass Amherst.
3. Credibility turns on the success or failure
of attempts to reproduce findings.
Jason deBruyn (Jan 23, 2015) Trial involving disgraced scientist and
bunk Duke research to begin Monday. Triangle Business Journal.
In cancer therapy models
âą data falsification
âą retracted journal articles
âą terminated clinical trials
âą civil suit by patients
Anil Potti
4. Credibility turns on the success or failure
of attempts to reproduce findings.
1000 years of temperature variation: the
âhockey stickâ graph by Michael Mann
In climate science models
âą flawed research methods
âą evasion of FOIA requests
âą leaked emails
âą media hype
Freed Pearce (2010-02-09) Climate change debate overheated
after sceptic grasped 'hockey stickâ. The Guardian.
5. âComputational science today faces a credibility crisis.â
Victoria Stodden, UIUC
Without access to the code and
data that underlie scientific
discoveries, published findings
are all but impossible to verify.
6. What can reproducible research do for you?
Your closest collaborator
is you six months ago,
but you don't reply to emails.
Paul Wilson
Engineering Physics
UWâMadison
10. Principle 1.
Blend computing, results, and narrative.
<<>>=
hist(co2)
@
Render the text and
code outputs.
Report title
Introduction.
Some narrative.
Discuss result.
More narrative.