A key challenge facing commerce students on graduation is the ability to demonstrate industry ready capabilities such as critical analysis, and problem solving (Bolton 2018). To prepare for this challenge, higher education needs to design assessments that prepare students for corporate expectations. However, many students struggle with the presenting the critical analysis needed for commerce assessments. Dashboards are widely used within industry as tools to draw together volumes of information from diverse sources, track performance and make strategic decisions (Grewal, Motyka & Levy 2018; Schlee & Karns 2017). Adapting this idea, we have developed assessment tasks that utilise a dashboard design to help students structure their research, present analysis and develop insight as a way to articulate their professional capabilities. The dashboards are embedded in an early assessment in a first year University commerce course and provide visual layouts that guide students to manage the research and analysis.
Using Dashboards to Enhance Authentic Professional Learning Capabilities Dr Marion Steel Dr Micaela Spiers
1. Dr Marion Steel
Dr Micaela Spiers
Deakin University CRICOS Provider Code: 00113B
Using Dashboards to
Enhance Authentic Learning
1
2. Overview/Problem
Deakin University CRICOS Provider Code: 00113B
• First year core unit in the Bachelor of Commerce
• Aim is to develop preparedness for commerce careers
A key challenge facing students on graduation is the ability to demonstrate industry
ready capabilities such as critical analysis, and problem solving (Bolton, 2018)
“Most dynamic dashboards are dedicated to tutors and researchers while most
simple dashboards are supplied to learners. Learners have no means to self-regulate
their activities and to build metacognitive skills.” (Ji, Michel, Lavoué & George, 2014)
How do we improve these capabilities?
3. Overview/Problem
Deakin University CRICOS Provider Code: 00113B
‘Typical’ student is
• 19-22 years old,
• Has completed four first year core units of their degree
• Has some part time work experience, generally not in a marketing field
Or
• 22+ years old
• Articulated from a diploma pathway
• May have 1-2 years full time work experience (not necessarily in a marketing
field)
4. Original Student Information
Deakin University CRICOS Provider Code: 00113B
Research and critically analyse industry trends for your selected target industry. Forecast potential changes for the
next 5 years. What are the factors causing change at the moment?
What jobs are expected to change or disappear?
Why is this happening?
What changes do you forecast for the next 5 years?
You should expect that you will need a minimum of 5-6 references for this sections. Please make sure that the
references are current. News articles and academic journal articles from the last 24 months are recommended.
Suggested word count: 400 - 500 words
Review your current capabilities, discipline knowledge and areas where you are developing skills or knowledge.
Using a series of tests you will evaluate and discuss your current professional personality, your learning style and
your resilience.
Suggested word count: 600 – 700 words. Use Appendices to present detailed information or test results.
5. Original Student Approach
Deakin University CRICOS Provider Code: 00113B
Hello, I understand that we need to
summarise our test results into
tables and then discuss our overall
findings.
I was just wondering if it would
instead be adequate to provide a
very IN DEPTH analysis of each key
finding within the tables
• How do I answer….
• I cannot find any references…
• Can I write in first person?
• Skimming 1-2 references
• Summarising source material
• Difficulties comparing
information from different
sources
Common Questions Common Problems
6. Common Problems
Deakin University CRICOS Provider Code: 00113B
Teaching Skills - Variable Focus
teaching
research
and analysis
skills
Providing
‘answers’
7. Common Problems
Deakin University CRICOS Provider Code: 00113B
Find, collate and analyse data from
multiple sources
Ability to critically analyse and integrate
findings
Industry expectations
Actively participate in and
develop strategy and
organisational plans. Track and
report on organisational activities
both internally and externally
Teaching Skills - Variable Focus
teaching
research
and analysis
skills
Providing
‘answers’
8. Dashboards in Industry
Deakin University CRICOS Provider Code: 00113B
A dashboard is a visual display of the most important information needed to achieve one or
more objectives; consolidated and arranged on a single screen so the information can be
monitored at a glance.
(Stephen Few, 2004, “Dashboard Confusion”. Intelligent Enterprise)
Small collection of interconnected key performance metrics and underlying performance drivers
that reflects both short and long term interests……
What is particularly challenging about a marketing application of a dashboard is
a) the integration of diverse business activities some qualitative, with performance
outcomes
b) the need to measure short term results of marketing and long term health of the
marketing asset
c) the challenge of isolating the effect of marketing actions from other influences
(Pauwels et al – 2008 MSI paper)
9. Design Approach
Deakin University CRICOS Provider Code: 00113B
Data collection
–primary and
secondary
Collation and
integration
Create
Dashboard
Analysis –
relate inputs
to outputs
Developing
insights
Dashboard
creation
10. Design Approach
Deakin University CRICOS Provider Code: 00113B
Data collection
–primary and
secondary
Collation and
integration
Create
Dashboard
Analysis –
relate inputs
to outputs
Developing
insights
Blooms
Taxonomy
Dashboard
creation
Remember Understand Apply Analysis Create
11. Design Approach
Deakin University CRICOS Provider Code: 00113B
Data collection
–primary and
secondary
Collation and
integration
Create
Dashboard
Analysis –
relate inputs
to outputs
Developing
insights
My Skills and
Capabilities
Industry
Requirements and
Trends
Identify Graduate careers and
requirements of the future
• Personal Gaps
• Develop Action Plan
Blooms
Taxonomy
Dashboard
creation
Assessment
Remember Understand Apply Analysis Create
14. Outcomes – Students overall grade improvement
Deakin University CRICOS Provider Code: 00113B
0
5
10
15
20
25
30
35
40
45
N P C D HD
T1 2018 T1 2019
Clear increase in the number of
Distinctions and High Distinctions
across the cohort
Increase in overall cohort average
from 60.72% in T1 2018 to
61.92% in T1 2019
15. Deakin University CRICOS Provider Code: 00113B
Outcomes – Students criteria improvement
0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
Poor Does not
meet ind
stds
Meets few
ind stds
Meets
some ind
stds
Meets
most ind
stds
Meets
industry
standards
Industry Overview
T1 2018 T1 2019
16. Deakin University CRICOS Provider Code: 00113B
Outcomes – Students criteria improvement
0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
Poor Does not
meet ind
stds
Meets few
ind stds
Meets
some ind
stds
Meets
most ind
stds
Meets
industry
standards
Industry Overview
T1 2018 T1 2019
0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
40.00
45.00
Poor Does not
meet ind
stds
Meets few
ind stds
Meets
some ind
stds
Meets
most ind
stds
Meets
industry
standards
Capabilities Overview
T1 2018 T1 2019
17. Outcomes – discussion forum posts
Deakin University CRICOS Provider Code: 00113B
0
2
4
6
8
10
12
My Industry Referencing Components
of report
Formatting Analysis
T1 2018
T2 2018
0
2
4
6
8
10
12
14
16
Required tests Calculate
results
Formatting Analysis
T1 2018
T2 2018
Industry Dashboard Posts Professional Dashboard Posts
18. What we learnt
Deakin University CRICOS Provider Code: 00113B
The introduction of dashboards:
Increased the overall quality of students work through:
• Improved understanding by students of assessment expectations
• Improved students’ ability to compare information from various sources
• Improved research skills as the dashboards give students direction in their research
• Improved student critical analysis and decision making skills
Changed the type of questions that students ask
Developed students understanding of professional expectations through the implementation
of an authentic business tool
19. Future Plans
Deakin University CRICOS Provider Code: 00113B
• Fully integrate the dashboards into all seminar activities – so they
become a ‘living document’
• Longer term plan to create online interactive personal dashboards
that students can continually update throughout their student career
journey and beyond
• Reviewing portfolio tools for collection and management of data
for students