SlideShare ist ein Scribd-Unternehmen logo
1 von 61
Downloaden Sie, um offline zu lesen
Mini-Viva
Presentation
Duygu Simsek
duygu.simsek@open.ac.uk
Supervisors: Prof. Simon Buckingham Shum, Dr. Anna De Liddo & Dr. Rebecca Ferguson
Examiners: Prof. Steve Swithenby & Prof. Denise Whitelock
The Open
Science
Laboratory
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Research Aim
• To investigate
• Whether or not computational techniques can automatically
identify attributes of good scholarly writing
• What is the potential of these techniques for student essay
analysis?
• How we can best feedback the results of such analysis in a way
that learners can value to improve the quality of their writing.
• How educators can use these results for automatic or semi-
automatic assessment of their students writing.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Good Scholarly Writing?
Quality of Writing?
• Signalled by the use of
metadiscourse markers in
the text.
• Metadiscourse:
• Linguistic cues in the text
• Expresses a viewpoint, the problem, claim, argument, the
evidence and the implications
• Engages the readers, and signals the writer's stance.
Italicised words are example metadiscourse markers
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Xerox Incremental Parser (XIP)
• Automatic processing of scientific documents
• Recognition of the rhetorically significant sentences
• 8 categories of Rhetorical Moves
• Background Knowledge
• Summarising
• Tendency
• Novelty
• Significance
• Surprise
• Open Question
• Contrasting Ideas
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Xerox Incremental Parser (XIP)
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Original Contribution of PhD
• Carrying XIP into the education field
• For professional scientific articles written by experienced
researchers
• But now for analysis of student essays
• Hypothesis: An outcome of the XIP processed scientific
documents can demonstrate the quality of the author’s written
discourse; and therefore can be used to scaffold and assess
scholarly writing.
• First in depth opportunity to
• Assess a state of the art language technology
• Integrate its services into software tools for academic writing
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Research Questions
• Main Research Question
• How can we support students’ scholarly writing skills to improve the
quality of their writing through automated metadiscourse analysis?
• Sub-Question 1
• How reliable and sufficient are the automated discourse analysis tools
for finding good attributes of scholarly writing within student essays?
• Sub-Question 2
• To what extent is there a relation between the existences of various
kinds of argumentative discourse moves in student essays with final
grades?
• Sub-Question 3
• To what extent automated metadiscourse analysis of discipline-
independent student essays can be used to provide formative feedback?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Academic
Writing
Where this research sits?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Computational
Linguistics
Academic
Writing
Where this research sits?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Learning
Analytics
Computational
Linguistics
Academic
Writing
Where this research sits?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Learning
Analytics
Computational
Linguistics
Academic
Writing
Where this research sits?
Scientific
Writing
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Learning
Analytics
Computational
Linguistics
Academic
Writing
Where this research sits?
Scientific
Writing
Rhetorical
Parsers
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Learning
Analytics
Computational
Linguistics
Academic
Writing
Where this research sits?
Scientific
Writing
Rhetorical
Parsers
Discourse
Centric
Learning
Analytics
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Learning
Analytics
Computational
Linguistics
Academic
Writing
Where this research sits?
Scientific
Writing
Rhetorical
Parsers
Discourse
Centric
Learning
Analytics
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Computational Linguistics:
Possible automated analysis of
scientific & technical writing but
barely deployed in educational
context!
• Need: XIP output is not
educator/learner friendly.
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Computational Linguistics:
Possible automated analysis of
scientific & technical writing but
barely deployed in educational
context!
• Need: XIP output is not
educator/learner friendly.
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Computational Linguistics:
Possible automated analysis of
scientific & technical writing but
barely deployed in educational
context!
• Need: XIP output is not
educator/learner friendly.
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Computational Linguistics:
Possible automated analysis of
scientific & technical writing but
barely deployed in educational
context!
• Need: XIP output is not
educator/learner friendly.
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Computational Linguistics:
Possible automated analysis of
scientific & technical writing but
barely deployed in educational
context!
• Need: XIP output is not
educator/learner friendly.
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Computational Linguistics:
Possible automated analysis of
scientific & technical writing but
barely deployed in educational
context!
• Need: XIP output is not
educator/learner friendly.
• Learning Analytics: Promising
potential of automated, timely
& formative feedback.
• Unresolved Question: “What does
analytics look like for a higher
order skill such as communicating
ideas in scientific writing, with a
primary focus on assessing
students?”
Literature Review Journey
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
• Academic Writing: Writers
signal argumentative moves by
using well-established patterns
• Debate on whether these
patterns are discipline
independent or not
• Computational Linguistics:
Possible automated analysis of
scientific & technical writing but
barely deployed in educational
context!
• Need: XIP output is not
educator/learner friendly.
• Run XIP on essays from different
disciplines
• Validate XIP in educational
context
• If we can show there is a value
for learners & educators then it
has a potential for formative
assessment of writing.
Pilot Work: XIP Dashboard
• Aim: Visualise XIP output
• Question in mind: Can visual XIP analysis of literature help
users to assess current state of the art in terms of trends,
patterns, gaps, and connections?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Pilot Work: XIP Dashboard
• Aim: Visualise XIP output
• Question in mind: Can visual XIP analysis of literature help
users to assess current state of the art in terms of trends,
patterns, gaps, and connections?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Data Set
Proceedings of the Learning Analytics and
Knowledge (LAK) conferences and a journal
special issue, and the Educational Data
Mining (EDM) conferences and journal.
Pilot Work: XIP Dashboard
• Aim: Visualise XIP output
• Question in mind: Can visual XIP analysis of literature help
users to assess current state of the art in terms of trends,
patterns, gaps, and connections?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Data Set
Proceedings of the Learning Analytics and
Knowledge (LAK) conferences and a journal
special issue, and the Educational Data
Mining (EDM) conferences and journal.
Pilot Work: XIP Dashboard
• Aim: Visualise XIP output
• Question in mind: Can visual XIP analysis of literature help
users to assess current state of the art in terms of trends,
patterns, gaps, and connections?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
XIP Analysis
All of the papers (66 LAK and 239 EDM
papers 305 in total) were analysed
using XIP, extracting 7847 sentences
and 40163 concepts.
Data Set
Proceedings of the Learning Analytics and
Knowledge (LAK) conferences and a journal
special issue, and the Educational Data
Mining (EDM) conferences and journal.
Pilot Work: XIP Dashboard
• Aim: Visualise XIP output
• Question in mind: Can visual XIP analysis of literature help
users to assess current state of the art in terms of trends,
patterns, gaps, and connections?
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
XIP Analysis
All of the papers (66 LAK and 239 EDM
papers 305 in total) were analysed
using XIP, extracting 7847 sentences
and 40163 concepts.
Data Set
Proceedings of the Learning Analytics and
Knowledge (LAK) conferences and a journal
special issue, and the Educational Data
Mining (EDM) conferences and journal.
Pilot Work: XIP Dashboard
• Aim: Visualise XIP output
• Question in mind: Can visual XIP analysis of literature help
users to assess current state of the art in terms of trends,
patterns, gaps, and connections?
XIP Output: Not learner friendly
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
XIP Analysis
All of the papers (66 LAK and 239 EDM
papers 305 in total) were analysed
using XIP, extracting 7847 sentences
and 40163 concepts.
Data Set
Proceedings of the Learning Analytics and
Knowledge (LAK) conferences and a journal
special issue, and the Educational Data
Mining (EDM) conferences and journal.
Pilot Work: XIP Dashboard
• XIP Dashboard is a set of visual analytics modules built on XIP
output.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Pilot Work: XIP Dashboard
• XIP Dashboard is a set of visual analytics modules built on XIP
output.
Paper Prototype & User Evaluation
6 user sessions were conducted with
1st year PhD students from OU
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Pilot Work: XIP Dashboard
• XIP Dashboard is a set of visual analytics modules built on XIP
output.
Paper Prototype & User Evaluation
6 user sessions were conducted with
1st year PhD students from OU
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Pilot Work: XIP Dashboard
• XIP Dashboard is a set of visual analytics modules built on XIP
output.
Paper Prototype & User Evaluation
6 user sessions were conducted with
1st year PhD students from OU
XIP Dashboard
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Dissemination of Work
• Various poster presentations & talks.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Dissemination of Work
• Various poster presentations & talks.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Dissemination of Work
• Various poster presentations & talks.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Dissemination of Work
• Various poster presentations & talks.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Dissemination of Work
• Various poster presentations & talks.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Dissemination of Work
• Various poster presentations & talks.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Dissemination of Work
• Various poster presentations & talks.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Dissemination of Work
• Various poster presentations & talks.
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
What are the Next Plans?
• Design refinements to the XIP Dashboard
• User evaluations
• XIP as an API, Web Service
• Integrate to software tools, XIP Dashboard
• Test XIP’s power on student essays
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Data Collection & Analysis
What? When? How? Why?
Student Essays
of OU’s S288
S288-12B (2012
Course)
• Analysis of student essays
through XIP
• Comparison of XIP findings
with final grades
• To see whether XIP can identify
important parts of student
essays
• To see whether or not we can
correlate XIP results with final
grades
Student Essays
of OU’s S288
S288-13B (2013
Course)
Same as two above
• Use of Google Docs for
collaboratively written report
where we back up the
revision history & analyse
through XIP
Same as two above
• To see whether XIP can reveal
interesting predictive patterns
about the quality of the end
document and the final grade.
Student Essays
of OU’s S288
S288-14B (2014
Course)
Same as above
• Develop software with XIP
Visual Analytics Dashboard
integrated
• Get users’ reactions
Same as above
• Analyses student essays &
provide real-time analytics of
students’ essays as a feedback to
students.
Student Essays
(soft domains)
N/A Same as above Same as above
• Test the discipline independency
of XIP
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
Data Collection & Analysis
What? When? How? Why?
Student Essays
of OU’s S288
S288-12B (2012
Course)
• Analysis of student essays
through XIP
• Comparison of XIP findings
with final grades
• To see whether XIP can identify
important parts of student
essays
• To see whether or not we can
correlate XIP results with final
grades
Student Essays
of OU’s S288
S288-13B (2013
Course)
Same as two above
• Use of Google Docs for
collaboratively written report
where we back up the
revision history & analyse
through XIP
Same as two above
• To see whether XIP can reveal
interesting predictive patterns
about the quality of the end
document and the final grade.
Student Essays
of OU’s S288
S288-14B (2014
Course)
Same as above
• Develop software with XIP
Visual Analytics Dashboard
integrated
• Get users’ reactions
Same as above
• Analyses student essays &
provide real-time analytics of
students’ essays as a feedback to
students.
Student Essays
(soft domains)
N/A Same as above Same as above
• Test the discipline independency
of XIP
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
RQ1: How reliable and
sufficient are the automated
discourse analysis tools for
finding good attributes of
scholarly writing within
student essays?
Data Collection & Analysis
What? When? How? Why?
Student Essays
of OU’s S288
S288-12B (2012
Course)
• Analysis of student essays
through XIP
• Comparison of XIP findings
with final grades
• To see whether XIP can identify
important parts of student
essays
• To see whether or not we can
correlate XIP results with final
grades
Student Essays
of OU’s S288
S288-13B (2013
Course)
Same as two above
• Use of Google Docs for
collaboratively written report
where we back up the
revision history & analyse
through XIP
Same as two above
• To see whether XIP can reveal
interesting predictive patterns
about the quality of the end
document and the final grade.
Student Essays
of OU’s S288
S288-14B (2014
Course)
Same as above
• Develop software with XIP
Visual Analytics Dashboard
integrated
• Get users’ reactions
Same as above
• Analyses student essays &
provide real-time analytics of
students’ essays as a feedback to
students.
Student Essays
(soft domains)
N/A Same as above Same as above
• Test the discipline independency
of XIP
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
RQ1: How reliable and
sufficient are the automated
discourse analysis tools for
finding good attributes of
scholarly writing within
student essays?
RQ2: To what extent is there
a relation between the
existences of various kinds
of argumentative discourse
moves in student essays
with final grades?
Data Collection & Analysis
What? When? How? Why?
Student Essays
of OU’s S288
S288-12B (2012
Course)
• Analysis of student essays
through XIP
• Comparison of XIP findings
with final grades
• To see whether XIP can identify
important parts of student
essays
• To see whether or not we can
correlate XIP results with final
grades
Student Essays
of OU’s S288
S288-13B (2013
Course)
Same as two above
• Use of Google Docs for
collaboratively written report
where we back up the
revision history & analyse
through XIP
Same as two above
• To see whether XIP can reveal
interesting predictive patterns
about the quality of the end
document and the final grade.
Student Essays
of OU’s S288
S288-14B (2014
Course)
Same as above
• Develop software with XIP
Visual Analytics Dashboard
integrated
• Get users’ reactions
Same as above
• Analyses student essays &
provide real-time analytics of
students’ essays as a feedback to
students.
Student Essays
(soft domains)
N/A Same as above Same as above
• Test the discipline independency
of XIP
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
RQ1: How reliable and
sufficient are the automated
discourse analysis tools for
finding good attributes of
scholarly writing within
student essays?
RQ2: To what extent is there
a relation between the
existences of various kinds
of argumentative discourse
moves in student essays
with final grades?
RQ3: To what extent
automated metadiscourse
analysis of discipline-
independent student
essays can be used to
provide formative
feedback?
Data Collection & Analysis
What? When? How? Why?
Student Essays
of OU’s S288
S288-12B (2012
Course)
• Analysis of student essays
through XIP
• Comparison of XIP findings
with final grades
• To see whether XIP can identify
important parts of student
essays
• To see whether or not we can
correlate XIP results with final
grades
Student Essays
of OU’s S288
S288-13B (2013
Course)
Same as two above
• Use of Google Docs for
collaboratively written report
where we back up the
revision history & analyse
through XIP
Same as two above
• To see whether XIP can reveal
interesting predictive patterns
about the quality of the end
document and the final grade.
Student Essays
of OU’s S288
S288-14B (2014
Course)
Same as above
• Develop software with XIP
Visual Analytics Dashboard
integrated
• Get users’ reactions
Same as above
• Analyses student essays &
provide real-time analytics of
students’ essays as a feedback to
students.
Student Essays
(soft domains)
N/A Same as above Same as above
• Test the discipline independency
of XIP
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation
RQ1: How reliable and
sufficient are the automated
discourse analysis tools for
finding good attributes of
scholarly writing within
student essays?
RQ2: To what extent is there
a relation between the
existences of various kinds
of argumentative discourse
moves in student essays
with final grades?
RQ3: To what extent
automated metadiscourse
analysis of discipline-
independent student
essays can be used to
provide formative
feedback?
How can we support
students’ scholarly
writing skills to
improve the quality
of their writing
through automated
metadiscourse
analysis?
Validation of XIP
XIP
Quality
Grades
Science
Social
Sciences
Art
History
Marking Rubrics
Representations
Educators
Tutors
Students
10/09/2013,Tuesday,TheOpen
University
MiniVivaPresentation

Weitere ähnliche Inhalte

Was ist angesagt?

Seminaar on meta analysis
Seminaar on meta analysisSeminaar on meta analysis
Seminaar on meta analysis
Preeti Rai
 
Presentation of PhD Research Proposal (Format).ppt
Presentation of PhD Research Proposal (Format).pptPresentation of PhD Research Proposal (Format).ppt
Presentation of PhD Research Proposal (Format).ppt
HassanRashid51
 

Was ist angesagt? (20)

6. referencing styles
6. referencing styles6. referencing styles
6. referencing styles
 
Seminaar on meta analysis
Seminaar on meta analysisSeminaar on meta analysis
Seminaar on meta analysis
 
Clinical prediction models
Clinical prediction modelsClinical prediction models
Clinical prediction models
 
Introduction to prediction modelling - Berlin 2018 - Part II
Introduction to prediction modelling - Berlin 2018 - Part IIIntroduction to prediction modelling - Berlin 2018 - Part II
Introduction to prediction modelling - Berlin 2018 - Part II
 
Presentation of PhD Research Proposal (Format).ppt
Presentation of PhD Research Proposal (Format).pptPresentation of PhD Research Proposal (Format).ppt
Presentation of PhD Research Proposal (Format).ppt
 
Thesis Defense Presentation
Thesis Defense PresentationThesis Defense Presentation
Thesis Defense Presentation
 
Forest plot interpretation
Forest plot interpretationForest plot interpretation
Forest plot interpretation
 
Writing of Research protocol
Writing of Research protocol Writing of Research protocol
Writing of Research protocol
 
Introduction to research
Introduction to researchIntroduction to research
Introduction to research
 
Research methodology
Research methodologyResearch methodology
Research methodology
 
Limitation of the Study
Limitation of the Study   Limitation of the Study
Limitation of the Study
 
Literature review
Literature reviewLiterature review
Literature review
 
Research in healthcare
Research in healthcareResearch in healthcare
Research in healthcare
 
Research gap
 Research gap Research gap
Research gap
 
Publishing: Everything you wanted to know but were afraid to ask
Publishing: Everything you wanted to know but were afraid to askPublishing: Everything you wanted to know but were afraid to ask
Publishing: Everything you wanted to know but were afraid to ask
 
Literature Review
Literature ReviewLiterature Review
Literature Review
 
Systematic review
Systematic reviewSystematic review
Systematic review
 
case report
case report case report
case report
 
Research proposal final pptx 1
Research proposal final pptx 1Research proposal final pptx 1
Research proposal final pptx 1
 
2. Case study and case series
2. Case study and case series2. Case study and case series
2. Case study and case series
 

Andere mochten auch

PhD Viva voce Presentation 19012015 (1)
PhD Viva voce Presentation 19012015 (1)PhD Viva voce Presentation 19012015 (1)
PhD Viva voce Presentation 19012015 (1)
Sudhir Sawant
 
Klink-2: integrating multiple web sources to generate semantic topic networks
 Klink-2: integrating multiple web sources to generate semantic topic networks Klink-2: integrating multiple web sources to generate semantic topic networks
Klink-2: integrating multiple web sources to generate semantic topic networks
Francesco Osborne
 
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
Francesco Osborne
 
M.Sc. VIVA UPM - NURHAFZAN ANIS ISMAIL
M.Sc. VIVA UPM - NURHAFZAN ANIS ISMAILM.Sc. VIVA UPM - NURHAFZAN ANIS ISMAIL
M.Sc. VIVA UPM - NURHAFZAN ANIS ISMAIL
Saiful Irwan Zubairi
 

Andere mochten auch (12)

Towards Visual Analytics to Improve Scientific Reading & Writing
Towards Visual Analytics to Improve Scientific Reading & WritingTowards Visual Analytics to Improve Scientific Reading & Writing
Towards Visual Analytics to Improve Scientific Reading & Writing
 
PhD Viva voce Presentation 19012015 (1)
PhD Viva voce Presentation 19012015 (1)PhD Viva voce Presentation 19012015 (1)
PhD Viva voce Presentation 19012015 (1)
 
Course Pathways: Making the right choices for the right reasons
Course Pathways:  Making the right choices for the right reasonsCourse Pathways:  Making the right choices for the right reasons
Course Pathways: Making the right choices for the right reasons
 
Klink-2: integrating multiple web sources to generate semantic topic networks
 Klink-2: integrating multiple web sources to generate semantic topic networks Klink-2: integrating multiple web sources to generate semantic topic networks
Klink-2: integrating multiple web sources to generate semantic topic networks
 
Study and experiments of a framework for disseminating semantic annotations i...
Study and experiments of a framework for disseminating semantic annotations i...Study and experiments of a framework for disseminating semantic annotations i...
Study and experiments of a framework for disseminating semantic annotations i...
 
Making Thinking Visible in Complex Times
Making Thinking Visible in Complex TimesMaking Thinking Visible in Complex Times
Making Thinking Visible in Complex Times
 
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
 
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014
 
BCII 2016 - Visualizing Complexity
BCII 2016 - Visualizing ComplexityBCII 2016 - Visualizing Complexity
BCII 2016 - Visualizing Complexity
 
M.Sc. VIVA UPM - NURHAFZAN ANIS ISMAIL
M.Sc. VIVA UPM - NURHAFZAN ANIS ISMAILM.Sc. VIVA UPM - NURHAFZAN ANIS ISMAIL
M.Sc. VIVA UPM - NURHAFZAN ANIS ISMAIL
 
Thesis powerpoint
Thesis powerpointThesis powerpoint
Thesis powerpoint
 
Powerpoint Presentation of PhD Viva
Powerpoint Presentation of PhD VivaPowerpoint Presentation of PhD Viva
Powerpoint Presentation of PhD Viva
 

Ähnlich wie PhD Mini Viva Talk

presentationlitreview-2ND COT PR2.pdf
presentationlitreview-2ND COT PR2.pdfpresentationlitreview-2ND COT PR2.pdf
presentationlitreview-2ND COT PR2.pdf
AnalieCabanlit1
 
Literate environment analysis presentation
Literate environment analysis presentationLiterate environment analysis presentation
Literate environment analysis presentation
pmuniru
 
Think Tank Meet the Teacher Presentation 2012-13
Think Tank Meet the Teacher Presentation 2012-13Think Tank Meet the Teacher Presentation 2012-13
Think Tank Meet the Teacher Presentation 2012-13
powersa14
 
Showcase AP Research to Students
Showcase AP Research to StudentsShowcase AP Research to Students
Showcase AP Research to Students
Serena Magrogan
 

Ähnlich wie PhD Mini Viva Talk (20)

Publication workshop
Publication workshopPublication workshop
Publication workshop
 
Are your students college-ready? Start by ensuring they're research ready.
Are your students college-ready? Start by ensuring they're research ready.Are your students college-ready? Start by ensuring they're research ready.
Are your students college-ready? Start by ensuring they're research ready.
 
Evidence-Based Practice for School Libraries
Evidence-Based Practice for School LibrariesEvidence-Based Practice for School Libraries
Evidence-Based Practice for School Libraries
 
Doing better things: transforming how we use Turnitin for learning
Doing better things: transforming how we use Turnitin for learningDoing better things: transforming how we use Turnitin for learning
Doing better things: transforming how we use Turnitin for learning
 
Reach for excellence: information literacy supports widening participation. S...
Reach for excellence: information literacy supports widening participation. S...Reach for excellence: information literacy supports widening participation. S...
Reach for excellence: information literacy supports widening participation. S...
 
Action-Oriented Research Agenda on Library Contributions to Student Learning ...
Action-Oriented Research Agenda on Library Contributions to Student Learning ...Action-Oriented Research Agenda on Library Contributions to Student Learning ...
Action-Oriented Research Agenda on Library Contributions to Student Learning ...
 
Action-Oriented Research Agenda on Library Contributions to Student Learning ...
Action-Oriented Research Agenda on Library Contributions to Student Learning ...Action-Oriented Research Agenda on Library Contributions to Student Learning ...
Action-Oriented Research Agenda on Library Contributions to Student Learning ...
 
Revisiting the One-Minute Paper: Personal Reflections, Student Engagement and...
Revisiting the One-Minute Paper: Personal Reflections, Student Engagement and...Revisiting the One-Minute Paper: Personal Reflections, Student Engagement and...
Revisiting the One-Minute Paper: Personal Reflections, Student Engagement and...
 
Communicating Their Stories: Strategies to Help Students Write Powerful Colle...
Communicating Their Stories: Strategies to Help Students Write Powerful Colle...Communicating Their Stories: Strategies to Help Students Write Powerful Colle...
Communicating Their Stories: Strategies to Help Students Write Powerful Colle...
 
Wk7 assgncrowj powerpoint
Wk7 assgncrowj powerpointWk7 assgncrowj powerpoint
Wk7 assgncrowj powerpoint
 
Are They Being Served? Reference Services Student Experience Project, UCD Lib...
Are They Being Served? Reference Services Student Experience Project, UCD Lib...Are They Being Served? Reference Services Student Experience Project, UCD Lib...
Are They Being Served? Reference Services Student Experience Project, UCD Lib...
 
Are they being served? Reference Services Student Experience Project - Jenny ...
Are they being served? Reference Services Student Experience Project - Jenny ...Are they being served? Reference Services Student Experience Project - Jenny ...
Are they being served? Reference Services Student Experience Project - Jenny ...
 
presentationlitreview-2ND COT PR2.pdf
presentationlitreview-2ND COT PR2.pdfpresentationlitreview-2ND COT PR2.pdf
presentationlitreview-2ND COT PR2.pdf
 
Literature Review (Review of Related Literature - Research Methodology)
Literature Review (Review of Related Literature - Research Methodology)Literature Review (Review of Related Literature - Research Methodology)
Literature Review (Review of Related Literature - Research Methodology)
 
Literate environment analysis presentation
Literate environment analysis presentationLiterate environment analysis presentation
Literate environment analysis presentation
 
Think Tank Meet the Teacher Presentation 2012-13
Think Tank Meet the Teacher Presentation 2012-13Think Tank Meet the Teacher Presentation 2012-13
Think Tank Meet the Teacher Presentation 2012-13
 
Faculty Workshop 2014
Faculty Workshop 2014Faculty Workshop 2014
Faculty Workshop 2014
 
Showcase AP Research to Students
Showcase AP Research to StudentsShowcase AP Research to Students
Showcase AP Research to Students
 
Qualitative analysis
Qualitative analysisQualitative analysis
Qualitative analysis
 
Fianl presentation
Fianl presentationFianl presentation
Fianl presentation
 

Kürzlich hochgeladen

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 

Kürzlich hochgeladen (20)

ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptx
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 

PhD Mini Viva Talk

  • 1. Mini-Viva Presentation Duygu Simsek duygu.simsek@open.ac.uk Supervisors: Prof. Simon Buckingham Shum, Dr. Anna De Liddo & Dr. Rebecca Ferguson Examiners: Prof. Steve Swithenby & Prof. Denise Whitelock The Open Science Laboratory 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 2. Research Aim • To investigate • Whether or not computational techniques can automatically identify attributes of good scholarly writing • What is the potential of these techniques for student essay analysis? • How we can best feedback the results of such analysis in a way that learners can value to improve the quality of their writing. • How educators can use these results for automatic or semi- automatic assessment of their students writing. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 3. Good Scholarly Writing? Quality of Writing? • Signalled by the use of metadiscourse markers in the text. • Metadiscourse: • Linguistic cues in the text • Expresses a viewpoint, the problem, claim, argument, the evidence and the implications • Engages the readers, and signals the writer's stance. Italicised words are example metadiscourse markers 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 4. Xerox Incremental Parser (XIP) • Automatic processing of scientific documents • Recognition of the rhetorically significant sentences • 8 categories of Rhetorical Moves • Background Knowledge • Summarising • Tendency • Novelty • Significance • Surprise • Open Question • Contrasting Ideas 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 5. Xerox Incremental Parser (XIP) 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 6. Original Contribution of PhD • Carrying XIP into the education field • For professional scientific articles written by experienced researchers • But now for analysis of student essays • Hypothesis: An outcome of the XIP processed scientific documents can demonstrate the quality of the author’s written discourse; and therefore can be used to scaffold and assess scholarly writing. • First in depth opportunity to • Assess a state of the art language technology • Integrate its services into software tools for academic writing 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 7. Research Questions • Main Research Question • How can we support students’ scholarly writing skills to improve the quality of their writing through automated metadiscourse analysis? • Sub-Question 1 • How reliable and sufficient are the automated discourse analysis tools for finding good attributes of scholarly writing within student essays? • Sub-Question 2 • To what extent is there a relation between the existences of various kinds of argumentative discourse moves in student essays with final grades? • Sub-Question 3 • To what extent automated metadiscourse analysis of discipline- independent student essays can be used to provide formative feedback? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 8. Academic Writing Where this research sits? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 9. Computational Linguistics Academic Writing Where this research sits? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 10. Learning Analytics Computational Linguistics Academic Writing Where this research sits? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 11. Learning Analytics Computational Linguistics Academic Writing Where this research sits? Scientific Writing 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 12. Learning Analytics Computational Linguistics Academic Writing Where this research sits? Scientific Writing Rhetorical Parsers 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 13. Learning Analytics Computational Linguistics Academic Writing Where this research sits? Scientific Writing Rhetorical Parsers Discourse Centric Learning Analytics 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 14. Learning Analytics Computational Linguistics Academic Writing Where this research sits? Scientific Writing Rhetorical Parsers Discourse Centric Learning Analytics 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 20. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 21. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 22. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 23. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 24. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 25. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not
  • 26. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not
  • 27. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not
  • 28. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not
  • 29. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not
  • 30. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not • Computational Linguistics: Possible automated analysis of scientific & technical writing but barely deployed in educational context! • Need: XIP output is not educator/learner friendly.
  • 31. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not • Computational Linguistics: Possible automated analysis of scientific & technical writing but barely deployed in educational context! • Need: XIP output is not educator/learner friendly.
  • 32. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not • Computational Linguistics: Possible automated analysis of scientific & technical writing but barely deployed in educational context! • Need: XIP output is not educator/learner friendly.
  • 33. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not • Computational Linguistics: Possible automated analysis of scientific & technical writing but barely deployed in educational context! • Need: XIP output is not educator/learner friendly.
  • 34. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not • Computational Linguistics: Possible automated analysis of scientific & technical writing but barely deployed in educational context! • Need: XIP output is not educator/learner friendly.
  • 35. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not • Computational Linguistics: Possible automated analysis of scientific & technical writing but barely deployed in educational context! • Need: XIP output is not educator/learner friendly.
  • 36. • Learning Analytics: Promising potential of automated, timely & formative feedback. • Unresolved Question: “What does analytics look like for a higher order skill such as communicating ideas in scientific writing, with a primary focus on assessing students?” Literature Review Journey 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation • Academic Writing: Writers signal argumentative moves by using well-established patterns • Debate on whether these patterns are discipline independent or not • Computational Linguistics: Possible automated analysis of scientific & technical writing but barely deployed in educational context! • Need: XIP output is not educator/learner friendly. • Run XIP on essays from different disciplines • Validate XIP in educational context • If we can show there is a value for learners & educators then it has a potential for formative assessment of writing.
  • 37. Pilot Work: XIP Dashboard • Aim: Visualise XIP output • Question in mind: Can visual XIP analysis of literature help users to assess current state of the art in terms of trends, patterns, gaps, and connections? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 38. Pilot Work: XIP Dashboard • Aim: Visualise XIP output • Question in mind: Can visual XIP analysis of literature help users to assess current state of the art in terms of trends, patterns, gaps, and connections? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation Data Set Proceedings of the Learning Analytics and Knowledge (LAK) conferences and a journal special issue, and the Educational Data Mining (EDM) conferences and journal.
  • 39. Pilot Work: XIP Dashboard • Aim: Visualise XIP output • Question in mind: Can visual XIP analysis of literature help users to assess current state of the art in terms of trends, patterns, gaps, and connections? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation Data Set Proceedings of the Learning Analytics and Knowledge (LAK) conferences and a journal special issue, and the Educational Data Mining (EDM) conferences and journal.
  • 40. Pilot Work: XIP Dashboard • Aim: Visualise XIP output • Question in mind: Can visual XIP analysis of literature help users to assess current state of the art in terms of trends, patterns, gaps, and connections? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation XIP Analysis All of the papers (66 LAK and 239 EDM papers 305 in total) were analysed using XIP, extracting 7847 sentences and 40163 concepts. Data Set Proceedings of the Learning Analytics and Knowledge (LAK) conferences and a journal special issue, and the Educational Data Mining (EDM) conferences and journal.
  • 41. Pilot Work: XIP Dashboard • Aim: Visualise XIP output • Question in mind: Can visual XIP analysis of literature help users to assess current state of the art in terms of trends, patterns, gaps, and connections? 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation XIP Analysis All of the papers (66 LAK and 239 EDM papers 305 in total) were analysed using XIP, extracting 7847 sentences and 40163 concepts. Data Set Proceedings of the Learning Analytics and Knowledge (LAK) conferences and a journal special issue, and the Educational Data Mining (EDM) conferences and journal.
  • 42. Pilot Work: XIP Dashboard • Aim: Visualise XIP output • Question in mind: Can visual XIP analysis of literature help users to assess current state of the art in terms of trends, patterns, gaps, and connections? XIP Output: Not learner friendly 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation XIP Analysis All of the papers (66 LAK and 239 EDM papers 305 in total) were analysed using XIP, extracting 7847 sentences and 40163 concepts. Data Set Proceedings of the Learning Analytics and Knowledge (LAK) conferences and a journal special issue, and the Educational Data Mining (EDM) conferences and journal.
  • 43. Pilot Work: XIP Dashboard • XIP Dashboard is a set of visual analytics modules built on XIP output. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 44. Pilot Work: XIP Dashboard • XIP Dashboard is a set of visual analytics modules built on XIP output. Paper Prototype & User Evaluation 6 user sessions were conducted with 1st year PhD students from OU 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 45. Pilot Work: XIP Dashboard • XIP Dashboard is a set of visual analytics modules built on XIP output. Paper Prototype & User Evaluation 6 user sessions were conducted with 1st year PhD students from OU 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 46. Pilot Work: XIP Dashboard • XIP Dashboard is a set of visual analytics modules built on XIP output. Paper Prototype & User Evaluation 6 user sessions were conducted with 1st year PhD students from OU XIP Dashboard 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 47. Dissemination of Work • Various poster presentations & talks. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 48. Dissemination of Work • Various poster presentations & talks. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 49. Dissemination of Work • Various poster presentations & talks. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 50. Dissemination of Work • Various poster presentations & talks. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 51. Dissemination of Work • Various poster presentations & talks. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 52. Dissemination of Work • Various poster presentations & talks. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 53. Dissemination of Work • Various poster presentations & talks. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 54. Dissemination of Work • Various poster presentations & talks. 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 55. What are the Next Plans? • Design refinements to the XIP Dashboard • User evaluations • XIP as an API, Web Service • Integrate to software tools, XIP Dashboard • Test XIP’s power on student essays 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 56. Data Collection & Analysis What? When? How? Why? Student Essays of OU’s S288 S288-12B (2012 Course) • Analysis of student essays through XIP • Comparison of XIP findings with final grades • To see whether XIP can identify important parts of student essays • To see whether or not we can correlate XIP results with final grades Student Essays of OU’s S288 S288-13B (2013 Course) Same as two above • Use of Google Docs for collaboratively written report where we back up the revision history & analyse through XIP Same as two above • To see whether XIP can reveal interesting predictive patterns about the quality of the end document and the final grade. Student Essays of OU’s S288 S288-14B (2014 Course) Same as above • Develop software with XIP Visual Analytics Dashboard integrated • Get users’ reactions Same as above • Analyses student essays & provide real-time analytics of students’ essays as a feedback to students. Student Essays (soft domains) N/A Same as above Same as above • Test the discipline independency of XIP 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation
  • 57. Data Collection & Analysis What? When? How? Why? Student Essays of OU’s S288 S288-12B (2012 Course) • Analysis of student essays through XIP • Comparison of XIP findings with final grades • To see whether XIP can identify important parts of student essays • To see whether or not we can correlate XIP results with final grades Student Essays of OU’s S288 S288-13B (2013 Course) Same as two above • Use of Google Docs for collaboratively written report where we back up the revision history & analyse through XIP Same as two above • To see whether XIP can reveal interesting predictive patterns about the quality of the end document and the final grade. Student Essays of OU’s S288 S288-14B (2014 Course) Same as above • Develop software with XIP Visual Analytics Dashboard integrated • Get users’ reactions Same as above • Analyses student essays & provide real-time analytics of students’ essays as a feedback to students. Student Essays (soft domains) N/A Same as above Same as above • Test the discipline independency of XIP 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation RQ1: How reliable and sufficient are the automated discourse analysis tools for finding good attributes of scholarly writing within student essays?
  • 58. Data Collection & Analysis What? When? How? Why? Student Essays of OU’s S288 S288-12B (2012 Course) • Analysis of student essays through XIP • Comparison of XIP findings with final grades • To see whether XIP can identify important parts of student essays • To see whether or not we can correlate XIP results with final grades Student Essays of OU’s S288 S288-13B (2013 Course) Same as two above • Use of Google Docs for collaboratively written report where we back up the revision history & analyse through XIP Same as two above • To see whether XIP can reveal interesting predictive patterns about the quality of the end document and the final grade. Student Essays of OU’s S288 S288-14B (2014 Course) Same as above • Develop software with XIP Visual Analytics Dashboard integrated • Get users’ reactions Same as above • Analyses student essays & provide real-time analytics of students’ essays as a feedback to students. Student Essays (soft domains) N/A Same as above Same as above • Test the discipline independency of XIP 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation RQ1: How reliable and sufficient are the automated discourse analysis tools for finding good attributes of scholarly writing within student essays? RQ2: To what extent is there a relation between the existences of various kinds of argumentative discourse moves in student essays with final grades?
  • 59. Data Collection & Analysis What? When? How? Why? Student Essays of OU’s S288 S288-12B (2012 Course) • Analysis of student essays through XIP • Comparison of XIP findings with final grades • To see whether XIP can identify important parts of student essays • To see whether or not we can correlate XIP results with final grades Student Essays of OU’s S288 S288-13B (2013 Course) Same as two above • Use of Google Docs for collaboratively written report where we back up the revision history & analyse through XIP Same as two above • To see whether XIP can reveal interesting predictive patterns about the quality of the end document and the final grade. Student Essays of OU’s S288 S288-14B (2014 Course) Same as above • Develop software with XIP Visual Analytics Dashboard integrated • Get users’ reactions Same as above • Analyses student essays & provide real-time analytics of students’ essays as a feedback to students. Student Essays (soft domains) N/A Same as above Same as above • Test the discipline independency of XIP 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation RQ1: How reliable and sufficient are the automated discourse analysis tools for finding good attributes of scholarly writing within student essays? RQ2: To what extent is there a relation between the existences of various kinds of argumentative discourse moves in student essays with final grades? RQ3: To what extent automated metadiscourse analysis of discipline- independent student essays can be used to provide formative feedback?
  • 60. Data Collection & Analysis What? When? How? Why? Student Essays of OU’s S288 S288-12B (2012 Course) • Analysis of student essays through XIP • Comparison of XIP findings with final grades • To see whether XIP can identify important parts of student essays • To see whether or not we can correlate XIP results with final grades Student Essays of OU’s S288 S288-13B (2013 Course) Same as two above • Use of Google Docs for collaboratively written report where we back up the revision history & analyse through XIP Same as two above • To see whether XIP can reveal interesting predictive patterns about the quality of the end document and the final grade. Student Essays of OU’s S288 S288-14B (2014 Course) Same as above • Develop software with XIP Visual Analytics Dashboard integrated • Get users’ reactions Same as above • Analyses student essays & provide real-time analytics of students’ essays as a feedback to students. Student Essays (soft domains) N/A Same as above Same as above • Test the discipline independency of XIP 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation RQ1: How reliable and sufficient are the automated discourse analysis tools for finding good attributes of scholarly writing within student essays? RQ2: To what extent is there a relation between the existences of various kinds of argumentative discourse moves in student essays with final grades? RQ3: To what extent automated metadiscourse analysis of discipline- independent student essays can be used to provide formative feedback? How can we support students’ scholarly writing skills to improve the quality of their writing through automated metadiscourse analysis?
  • 61. Validation of XIP XIP Quality Grades Science Social Sciences Art History Marking Rubrics Representations Educators Tutors Students 10/09/2013,Tuesday,TheOpen University MiniVivaPresentation