RepliCHI 2012 SIG @ CHI2012
•
0 gefällt mir•432 views
slides from the RepliCHI SIG @ #chi2012 talking about Replication at #chi2013 onwards
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Ähnlich wie RepliCHI 2012 SIG @ CHI2012
Ähnlich wie RepliCHI 2012 SIG @ CHI2012 (20)
Mehr von Max L. Wilson
Mehr von Max L. Wilson (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
RepliCHI 2012 SIG @ CHI2012
- 1. CHI2011 Panel CHI2012 SIG CHI2013 ? CHI2014 RepliCHI ? How to tackle replication of HCI research. Thinking forward. CHI2015 ? Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 2. CHI2011 Panel Why discuss replication? CHI2012 SIG • Replication is a corner-stone of good science CHI2013 We’re not all ? scientists tho! CHI2014 ? CHI2015 ? • We should facilitate it - but we do not (do we?) Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 3. CHI2011 Panel Why discuss replication? CHI2012 SIG • We live in a global community - but run studies locally CHI2013 ? CHI2014 ? CHI2015 ? • Does all research apply cross-culturally? Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 4. CHI2011 Panel Why discuss replication? CHI2012 SIG • Technology moves fast - duh. CHI2013 ? CHI2014 ? CHI2015 ? • Do all findings still apply? Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 5. CHI2011 Panel But its a problem CHI2012 SIG • Data, software, and people might be CHI2013 proprietary ? • Minor differences in study CHI2014 methods or tools might ? create an effect • Methods and tools are hard to reproduce exactly CHI2015 ? • There may be no benefit / outcome Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 6. CHI2011 Panel But its a problem CHI2012 SIG CHI2013 • Can you imaging publishing a paper thats not novel work? ? • Can you imagine getting a review saying: incremental CHI2014 • Novelty and significance are key review criteria ? • TOCHI “publishes only original and significant research CHI2015 papers.” ? Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 7. CHI2011 Panel It’s a bit scary too CHI2012 SIG CHI2013 ? CHI2014 ? CHI2015 ? • Can create conflict, and doubt Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 8. CHI2011 Panel We should talk about it CHI2012 SIG CHI2013 ? CHI2014 ? CHI2015 ? • So we did - we are - and hopefully we will Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 9. CHI2011 Panel The 2011 panel CHI2012 SIG CHI2013 ? CHI2014 ? - Most Importantly - • We had an excellent audience and lots of questions CHI2015 • but not enough discussion ? Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 10. CHI2011 Panel Today CHI2012 SIG • We want to talk to you more • And we’ve got some important people to listen CHI2013 ? • CHI2012 Program co-chair CHI2014 • CHI2013 Conference Chair ? • TOCHI Information Director CHI2015 • CHI2014 Conference co-chair ? • SIGCHI VP Publications Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 11. CHI2011 Panel The future? CHI2012 SIG • A route to publication - extended abstract CHI2013 ? • A venue to talk about replication - openly CHI2014 • Motivation / Reason / Reward for replicating research ? • A mature community that checks / validates itself CHI2015 • A place where people look to for updates ? RepliCHI Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 12. CHI2011 Panel CHI2012 SIG CHI2013 ? CHI2014 ? CHI2015 ? RepliCHI Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 13. CHI2011 Panel CHI2012 RepliCHI SIG • Invites Extended Abstracts CHI2013 ? • About the attempt (more so than the research) • Submitted around time of alt.chi CHI2014 ? • Presented discussed in a whole day event (like DocCon) • Some portion presenting in the main proceedings CHI2015 ? Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 14. CHI2011 Panel CHI2012 RepliCHI SIG • Invites Extended Abstracts CHI2013 ? • About the attempt (more so than the research) • Submitted around time of alt.chi CHI2014 ? • Presented discussed in a whole day event (like DocCon) • Some portion presenting in the main proceedings CHI2015 ? Now: we break/improve the idea Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 15. CHI2011 Panel Questions? CHI2012 SIG CHI2013 ? CHI2014 ? CHI2015 ? Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12
- 16. CHI2011 Panel Today then CHI2012 SIG CHI2013 • ~10 mins - an intro ? • ~10 mins - the questions CHI2014 ? • ~30 mins - in working groups • ~20 mins - feedback/discussion CHI2015 ? • ~10 mins - wrap up Dr Max L. Wilson drmaxlwilson@gmail.com Tuesday, 29 May 12