SlideShare ist ein Scribd-Unternehmen logo
1 von 12
Downloaden Sie, um offline zu lesen
We redo
Science !
ReScienceReproducible science is good. Replicated science is better.
K O N R A D H I N S E N N I C O L A S R O U G I E R
Once upon a time there was a model…
(Guthrie et al., 2013)
Nice paper, good results, but…
• No public repository
• No easy access
• No version control
• Model description included ambiguous information
• Sources were mixing actual computation and GUI code
• Model was split into a hundred files
• Main file was 6,000 lines long
Model was hardly reproducible.
R E S C I E N C E . G I T H U B . I O
Did you say reproducible science ?
(Crook et al., 2011)
“Reproducible experiments are the cornerstone of science:
only observations that are independently confirmed enter
the body of scientific knowledge.
Computational science should excel in reproducibility, as
simulations on digital computers avoid many of the small
variations that are beyond the control of the experimental
biologist or physicist.”
Reality is different, though.
R E S C I E N C E . G I T H U B . I O
xkcd.com
Three months of hard work for a 200 lines script...
(Topalidou et al., 2015)
Three months of hard work:
• Use of the Python language and numerical libraries
• Use of the DANA library for intuitive description
• Use of the IPython notebook for interactive sessions
Source is now a single file of ~200 readable lines.
Without this replication effort, model would have been dead
and forgotten by the community.
R E S C I E N C E . G I T H U B . I O
Bill Waterson
What is replication ?
Bob reads Alice’s paper, takes note of all model properties
and then implements the model himself using a method of his
choice.
Bob confirms Alice’s result by obtaining qualitatively the
same results.
Alice’s model is declared reproducible.
R E S C I E N C E . G I T H U B . I O
octodex.github.com
Did you say replication ?
During the course of a PhD, it is often the case that a student
will try to replicate results from the literature, possibly
interacting with the original authors.
Such replication generally lives inside the hard-drive of the
computer’s student while it would be actually useful for the
whole scientific community.
What do we do then ? Let’s review it & publish it !
R E S C I E N C E . G I T H U B . I O
octodex.github.com
Can we make such effort sustainable ?
Yes we can !™
ReScience is a peer-reviewed journal that target any
computational research and encourage the explicit
reproduction of already published research promoting new
and open-source implementations.
ReScience lives on github where each new implementation is
made available together with explanations (article)
And of course, we privilege Python replications…
R E S C I E N C E . G I T H U B . I O
Why git & github ? free & popular
GitHub offers a web-based git repository hosting service with
great specific features (issue, pull request, etc).
→ Version control
→ Public repositories
→ Transparency and verifiability
→ Easy exploration of new ideas
A kind of modern lab notebook for the computer scientist.
R E S C I E N C E . G I T H U B . I O
How to submit ?
1. Fork the ReScience-Submission repository
2. Write your code, data and article
3. Submit a pull request
4. Address reviewer’s comments and questions
5. Get published and get a DOI
R E S C I E N C E . G I T H U B . I O
octodex.github.com
Authors: Meropi Topalidou & Nicolas Rougier
Editor: Tiziano Zito
Reviewers: Mehdi Khamassi & Benoît Girard
Actual submission
(Topalidou and Rougier, 2015)
R E S C I E N C E . G I T H U B . I O
R E S C I E N C E . G I T H U B . I O
ReScience
| | |
ReScience
τ
1 × 4
4 × 1
4 × 4
1 × 4
4 × 1
4 × 4
1 × 4
4 × 1
1 × 4
4 × 1
1 × 4
4 × 1
Vi 4
(1, i) → (1, i)
(i, 1) → (i, 1)
| | |
Grand opening on September 1st 2015
Spread the word !
→ star the project on github (ReScience/ReScience)
→ follow the journal (@ReScienceEds) on twitter
→ tell your colleagues (mailing lists, blog, twitter, …)
Help the project !
→ submit articles
→ become a reviewer (contact me nicolas.rougier@inria.fr)
R E S C I E N C E . G I T H U B . I O
octodex.github.com

Weitere ähnliche Inhalte

Andere mochten auch

Predictability of popularity on online social media: Gaps between prediction ...
Predictability of popularity on online social media: Gaps between prediction ...Predictability of popularity on online social media: Gaps between prediction ...
Predictability of popularity on online social media: Gaps between prediction ...
Amit Sharma
 
Build a winning team dynamic
Build a winning team dynamicBuild a winning team dynamic
Build a winning team dynamic
Ansaar Qureshi
 

Andere mochten auch (18)

Enhancing a Social Science Model-building Workflow with Interactive Visualisa...
Enhancing a Social Science Model-building Workflow with Interactive Visualisa...Enhancing a Social Science Model-building Workflow with Interactive Visualisa...
Enhancing a Social Science Model-building Workflow with Interactive Visualisa...
 
Employee Engagement - More than just saying Thanks!
Employee Engagement - More than just saying Thanks! Employee Engagement - More than just saying Thanks!
Employee Engagement - More than just saying Thanks!
 
Winning Together - How Great Leaders Inspire Winning Teams
Winning Together - How Great Leaders Inspire Winning TeamsWinning Together - How Great Leaders Inspire Winning Teams
Winning Together - How Great Leaders Inspire Winning Teams
 
Predictability of popularity on online social media: Gaps between prediction ...
Predictability of popularity on online social media: Gaps between prediction ...Predictability of popularity on online social media: Gaps between prediction ...
Predictability of popularity on online social media: Gaps between prediction ...
 
Management Fundamentals: The Iceberg Model
Management Fundamentals: The Iceberg ModelManagement Fundamentals: The Iceberg Model
Management Fundamentals: The Iceberg Model
 
High Load Strategy 2016 - Project Management: from Stone Age to DevOps
High Load Strategy 2016 - Project Management: from Stone Age to DevOps High Load Strategy 2016 - Project Management: from Stone Age to DevOps
High Load Strategy 2016 - Project Management: from Stone Age to DevOps
 
2017 Design Innovation Project Management
2017 Design Innovation Project Management2017 Design Innovation Project Management
2017 Design Innovation Project Management
 
Cause2Create -- Updated to Project Challenge
Cause2Create -- Updated to Project ChallengeCause2Create -- Updated to Project Challenge
Cause2Create -- Updated to Project Challenge
 
Centric
CentricCentric
Centric
 
Project management presentation (power point)
Project management presentation (power point)Project management presentation (power point)
Project management presentation (power point)
 
Delivering Modern Operations on AWS
Delivering Modern Operations on AWSDelivering Modern Operations on AWS
Delivering Modern Operations on AWS
 
Team Coaching Part1
Team Coaching Part1Team Coaching Part1
Team Coaching Part1
 
Smart project management - Best Practices to Manage Project effectively
Smart project management - Best Practices to Manage Project effectivelySmart project management - Best Practices to Manage Project effectively
Smart project management - Best Practices to Manage Project effectively
 
Tech Talk: Up Your Agile Game with Predictability Metrics
Tech Talk: Up Your Agile Game with Predictability MetricsTech Talk: Up Your Agile Game with Predictability Metrics
Tech Talk: Up Your Agile Game with Predictability Metrics
 
Strategic Business Model Canvas v3
Strategic Business Model Canvas v3Strategic Business Model Canvas v3
Strategic Business Model Canvas v3
 
Build a winning team dynamic
Build a winning team dynamicBuild a winning team dynamic
Build a winning team dynamic
 
Disrupt hr presentation - jan 2017
Disrupt hr presentation - jan 2017Disrupt hr presentation - jan 2017
Disrupt hr presentation - jan 2017
 
Historia de la Informática
Historia de la InformáticaHistoria de la Informática
Historia de la Informática
 

Ähnlich wie ReScience

Reproducibility, Research Objects and Reality, Leiden 2016
Reproducibility, Research Objects and Reality, Leiden 2016Reproducibility, Research Objects and Reality, Leiden 2016
Reproducibility, Research Objects and Reality, Leiden 2016
Carole Goble
 

Ähnlich wie ReScience (20)

Berlin 6 Open Access Conference: Sergey Fomel
Berlin 6 Open Access Conference: Sergey FomelBerlin 6 Open Access Conference: Sergey Fomel
Berlin 6 Open Access Conference: Sergey Fomel
 
How2research
How2researchHow2research
How2research
 
Current Open Research Practice in Computational Biology
Current Open Research Practice in Computational BiologyCurrent Open Research Practice in Computational Biology
Current Open Research Practice in Computational Biology
 
Open science 2014
Open science 2014Open science 2014
Open science 2014
 
The culture of researchData
The culture of researchDataThe culture of researchData
The culture of researchData
 
Ngsp
NgspNgsp
Ngsp
 
Agile and a cookbook
Agile and a cookbookAgile and a cookbook
Agile and a cookbook
 
The Google Scholar Revolution: a big data bibliometric tool
The Google Scholar Revolution:  a big data bibliometric toolThe Google Scholar Revolution:  a big data bibliometric tool
The Google Scholar Revolution: a big data bibliometric tool
 
Research Objects for FAIRer Science
Research Objects for FAIRer Science Research Objects for FAIRer Science
Research Objects for FAIRer Science
 
The culture of researchData
The culture of researchData The culture of researchData
The culture of researchData
 
The Culture of Research Data, by Peter Murray-Rust
The Culture of Research Data, by Peter Murray-RustThe Culture of Research Data, by Peter Murray-Rust
The Culture of Research Data, by Peter Murray-Rust
 
杭州讲座 石田英敬
杭州讲座 石田英敬杭州讲座 石田英敬
杭州讲座 石田英敬
 
STM Innovations Seminar London
STM Innovations Seminar LondonSTM Innovations Seminar London
STM Innovations Seminar London
 
The future of scholarly publishing
The future of scholarly publishingThe future of scholarly publishing
The future of scholarly publishing
 
Scott Edmunds: Using FAIR principles for more Open & Democratic Science
Scott Edmunds: Using FAIR principles for more Open & Democratic ScienceScott Edmunds: Using FAIR principles for more Open & Democratic Science
Scott Edmunds: Using FAIR principles for more Open & Democratic Science
 
Reproducibility, Research Objects and Reality, Leiden 2016
Reproducibility, Research Objects and Reality, Leiden 2016Reproducibility, Research Objects and Reality, Leiden 2016
Reproducibility, Research Objects and Reality, Leiden 2016
 
e-Research and the Demise of the Scholarly Article
e-Research and the Demise of the Scholarly Articlee-Research and the Demise of the Scholarly Article
e-Research and the Demise of the Scholarly Article
 
Publishing Open Data: Incentivising Rigour
Publishing Open Data: Incentivising RigourPublishing Open Data: Incentivising Rigour
Publishing Open Data: Incentivising Rigour
 
Computational Reproducibility vs. Transparency: Is It FAIR Enough?
Computational Reproducibility vs. Transparency: Is It FAIR Enough?Computational Reproducibility vs. Transparency: Is It FAIR Enough?
Computational Reproducibility vs. Transparency: Is It FAIR Enough?
 
What Academia Can Learn from Open Source
What Academia Can Learn from Open SourceWhat Academia Can Learn from Open Source
What Academia Can Learn from Open Source
 

Mehr von Nicolas Rougier

Mehr von Nicolas Rougier (10)

Neural fields, a cognitive approach
Neural fields, a cognitive approachNeural fields, a cognitive approach
Neural fields, a cognitive approach
 
SIGGRAPH 2018 - Digital typography
SIGGRAPH 2018 - Digital typographySIGGRAPH 2018 - Digital typography
SIGGRAPH 2018 - Digital typography
 
Machine learning
Machine learningMachine learning
Machine learning
 
Modern OpenGL scientific visualization
Modern OpenGL scientific visualizationModern OpenGL scientific visualization
Modern OpenGL scientific visualization
 
On ne voit que ce que l’on regarde (French)
On ne voit que ce  que l’on regarde (French)On ne voit que ce  que l’on regarde (French)
On ne voit que ce que l’on regarde (French)
 
Cybercriminalité (French)
Cybercriminalité (French)Cybercriminalité (French)
Cybercriminalité (French)
 
Where is my mind?
Where is my mind?Where is my mind?
Where is my mind?
 
Computational neuroscience
Computational neuroscienceComputational neuroscience
Computational neuroscience
 
Scientific visualization
Scientific visualizationScientific visualization
Scientific visualization
 
One critic, two actors, one decision
One critic, two actors, one decisionOne critic, two actors, one decision
One critic, two actors, one decision
 

Kürzlich hochgeladen

POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.
Silpa
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
1301aanya
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptx
Silpa
 

Kürzlich hochgeladen (20)

POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learning
 
GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)
 
Introduction of DNA analysis in Forensic's .pptx
Introduction of DNA analysis in Forensic's .pptxIntroduction of DNA analysis in Forensic's .pptx
Introduction of DNA analysis in Forensic's .pptx
 
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
 
FAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceFAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical Science
 
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 
Chemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdfChemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdf
 
Selaginella: features, morphology ,anatomy and reproduction.
Selaginella: features, morphology ,anatomy and reproduction.Selaginella: features, morphology ,anatomy and reproduction.
Selaginella: features, morphology ,anatomy and reproduction.
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptx
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort ServiceCall Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
 
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICEPATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
 
Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspects
 
Exploring Criminology and Criminal Behaviour.pdf
Exploring Criminology and Criminal Behaviour.pdfExploring Criminology and Criminal Behaviour.pdf
Exploring Criminology and Criminal Behaviour.pdf
 
Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.Proteomics: types, protein profiling steps etc.
Proteomics: types, protein profiling steps etc.
 

ReScience

  • 1. We redo Science ! ReScienceReproducible science is good. Replicated science is better. K O N R A D H I N S E N N I C O L A S R O U G I E R
  • 2. Once upon a time there was a model… (Guthrie et al., 2013) Nice paper, good results, but… • No public repository • No easy access • No version control • Model description included ambiguous information • Sources were mixing actual computation and GUI code • Model was split into a hundred files • Main file was 6,000 lines long Model was hardly reproducible. R E S C I E N C E . G I T H U B . I O
  • 3. Did you say reproducible science ? (Crook et al., 2011) “Reproducible experiments are the cornerstone of science: only observations that are independently confirmed enter the body of scientific knowledge. Computational science should excel in reproducibility, as simulations on digital computers avoid many of the small variations that are beyond the control of the experimental biologist or physicist.” Reality is different, though. R E S C I E N C E . G I T H U B . I O xkcd.com
  • 4. Three months of hard work for a 200 lines script... (Topalidou et al., 2015) Three months of hard work: • Use of the Python language and numerical libraries • Use of the DANA library for intuitive description • Use of the IPython notebook for interactive sessions Source is now a single file of ~200 readable lines. Without this replication effort, model would have been dead and forgotten by the community. R E S C I E N C E . G I T H U B . I O Bill Waterson
  • 5. What is replication ? Bob reads Alice’s paper, takes note of all model properties and then implements the model himself using a method of his choice. Bob confirms Alice’s result by obtaining qualitatively the same results. Alice’s model is declared reproducible. R E S C I E N C E . G I T H U B . I O octodex.github.com
  • 6. Did you say replication ? During the course of a PhD, it is often the case that a student will try to replicate results from the literature, possibly interacting with the original authors. Such replication generally lives inside the hard-drive of the computer’s student while it would be actually useful for the whole scientific community. What do we do then ? Let’s review it & publish it ! R E S C I E N C E . G I T H U B . I O octodex.github.com
  • 7. Can we make such effort sustainable ? Yes we can !™ ReScience is a peer-reviewed journal that target any computational research and encourage the explicit reproduction of already published research promoting new and open-source implementations. ReScience lives on github where each new implementation is made available together with explanations (article) And of course, we privilege Python replications… R E S C I E N C E . G I T H U B . I O
  • 8. Why git & github ? free & popular GitHub offers a web-based git repository hosting service with great specific features (issue, pull request, etc). → Version control → Public repositories → Transparency and verifiability → Easy exploration of new ideas A kind of modern lab notebook for the computer scientist. R E S C I E N C E . G I T H U B . I O
  • 9. How to submit ? 1. Fork the ReScience-Submission repository 2. Write your code, data and article 3. Submit a pull request 4. Address reviewer’s comments and questions 5. Get published and get a DOI R E S C I E N C E . G I T H U B . I O octodex.github.com
  • 10. Authors: Meropi Topalidou & Nicolas Rougier Editor: Tiziano Zito Reviewers: Mehdi Khamassi & Benoît Girard Actual submission (Topalidou and Rougier, 2015) R E S C I E N C E . G I T H U B . I O
  • 11. R E S C I E N C E . G I T H U B . I O ReScience | | | ReScience τ 1 × 4 4 × 1 4 × 4 1 × 4 4 × 1 4 × 4 1 × 4 4 × 1 1 × 4 4 × 1 1 × 4 4 × 1 Vi 4 (1, i) → (1, i) (i, 1) → (i, 1) | | |
  • 12. Grand opening on September 1st 2015 Spread the word ! → star the project on github (ReScience/ReScience) → follow the journal (@ReScienceEds) on twitter → tell your colleagues (mailing lists, blog, twitter, …) Help the project ! → submit articles → become a reviewer (contact me nicolas.rougier@inria.fr) R E S C I E N C E . G I T H U B . I O octodex.github.com