1. #jiscassess
www.jisc.ac.uk/assessmentandfeedback
JISC Assessment and Feedback
Programme Meeting
5th October 2011
2. Welcome
A special welcome to project representatives, programme
support team, JISC Advance and JISC RSC’s, The Higher
Education Academy
Housekeeping
– 13.00 – 14:00 Lunch in the restaurant
– 16:00 Close
Wireless access and extension cables
Delegate packs
– Agenda, guide to the wiki spaces, programme calendar,
Making Connections session handout
– Feedback please – online evaluation forms!
Publications from the e-Learning team
3. Agenda
10.00 – 10.30: Overview of programme and expectations
10.30 – 11.00: Project Elevator Pitches
11.00 – 11.15: Tea and coffee
11.15 – 11.45: Project Elevator Pitches (continued)
11.45 – 13.00: Poster Networking
13.00 – 14.00: Lunch
14.00 – 15.00: Parallel sessions:
» Strand A – main room (Expand Suite)
» Strand B – breakout room (Advance 2)
» Strand C – breakout room (Advance 3)
15.00 – 16.00: Change Activity (The Higher Education Academy)
4. Aims for today
Introduce the JISC Assessment and Feedback programme, team,
structure and expectations
Provide an opportunity for projects to hear about each others’ work
and to identify connections and common themes
Facilitate networking between projects, and cluster level discussions
Initiate discussions relating to this phase of project planning
5. Programme overview and expectations
Overview of the programme structure
Summary of expectations for each strand
Reporting and other programme requirements
Introduction to the support team
Wiki spaces and useful resources
6. Overview
Overview of programme,
strands, deliverables and
reporting expectations
www.jisc.ac.uk/assessmentandfeedback
#JISCASSESS
7. Programme overview
Strand A Strand B Strand C
8 Projects 8 projects 4 projects
6 months 9 months
3 years
2011-2014 to 2 years to 2 years
2011-2013 2011-2013
Support and Synthesis Project
8. Programme level outcomes
Increased usage of appropriate technology-enhanced
assessment and feedback, leading to:
– Change in the nature of assessment
– Efficiencies, and improvement of assessment quality
– Enhancement of the student and staff experience
Clearly articulated business cases
Models of sustainable institutional support, and guidance on
costs and benefits
Evidence of impact – on staff and students, workload and
satisfaction
9. JISC requirements
Core reporting requirements:
– Project plans – 1st November 11
– Baseline reports (Strand A) – 3rd January 2012
– Consortium agreements – 3rd January 2012
– Interim reports – 1st March 2012, 3rd Sept 2012, 1st March 2013
– Final reports – drafts and final versions – see calendar
– Completion survey – by 31st Aug 2014 (A), 31st Aug 2013 (B&C)
Plus
– Representing your work through the Design Studio
– Engagement with the programme through the programme wiki,
monthly online sessions, project visits (Strand A), programme
meetings and external events
– And additional deliverables....
10. Deliverables
A B C
Baseline Description of user
Evaluation scenarios
report
report
Descriptions of the
Summary of technical model
previous work
in the area Range of Open source
assets - widgets and code
Evaluation evidence of
report impact Developer
guidelines
Range of
assets - Short briefing
Documentation for
users
evidence of paper
impact summarising
Active community
the of users
Guidance and innovation
support and benefits Short summary of
materials the innovation
12. Programme Support Team
Critical
Friends
Support
Programme Co- Evaluation
Team Support
ordinator
Synthesis
13. Meet the team
Programme Managers
– Lisa Gray – managing Strands A and B
– Paul Bailey – managing Strand C
JISC Advance Support Team
– JISC InfoNet – Marianne Sheppard
– JISC Cetis – Wilbert Kraan and Rowin Young
– JISC TechDis – Terry McAndrew
Support Associates
– Synthesis consultants – Gill Ferrell, David Nicol, Ros Smith
– Evaluation consultants – Rachel Harris
– Critical friends – Strand A only – Peter Bullen and Peter Chatterton
– Expert associates – David Nicol and Aaron Porter
14. Synthesis support - roles
Programme facing
Jointly develop the Project facing
programme synthesis /
Through review of plans
evaluation framework
and reports, provide
Provide regular reviews ongoing support around
of emerging themes, the development and
issues and messages showcasing of outputs
Provide outward facing
communications including
Design Studio pages
15. Evaluation support - roles
Programme facing Project facing
Develop a programme- To provide feedback on
level evaluation / evaluation plans and
synthesis framework reports through the wiki
alongside synthesis team
Offer individual support to
Surface at a programme clusters / projects as
level examples of good required
practice in evaluation
methods and practices
Make connections
between related areas of
work
16. Critical friends – Strand A
Peter Chatterton
Cluster co-ordination
Project level support
Peter Bullen
17. Wiki spaces and key
resources
www.jisc.ac.uk/assessmentandfeedback
#JISCASSESS
21. Types of Resources
Methods and
Structured Case protocols Models and
Studies Frameworks
How-to-guides
Findings, lessons Learning designs Evidence e.g.
and key Learning video clips,
messages resources quotes
Staff
Transformation
development
stories
resources
23. Project Elevator Pitches - 2 mins...
1. The Market: who are the key stakeholders and
beneficiaries?
2. Value: what is the value of your project to them?
3. Offering: what are you aiming to achieve?
4. Benefits: what are the potential benefits of your
offering?
5. Proof: what kind of evidence will there be by the end of
the project to substantiate your value proposition?
www.jisc.ac.uk/assessmentandfeedback
#JISCASSESS
24. Poster networking session..
1. Based on the previous session, please identify up to 5
projects you’d like to talk to further
2. Spend 10 minutes exploring all poster and finalising
your choices
3. You’ll have 10 minutes for each project, will will signal
when you need to rotate
4. Place post-its on each poster – with
• Your project name
• Summary of the connection
www.jisc.ac.uk/assessmentandfeedback
#JISCASSESS
Editor's Notes
The outcomes of the programme would be widely communicated and disseminated to colleges and universities – with opportunities to work with professional and sector bodies to use their networks. The programme aims to have practical and tangible outputs which other colleges and universities can gain value from and use in their own contexts.
Assessment, as we all know, lies at the heart of the heart of the learning experience. Over the last couple of years JISC recognised the importance of this area in it being a key driver to change in institutions, as well the enormous potential technology has to transform assessment practices, proven by previous programmes of work including the Curriculum Design and Curriculum Delivery programmes which have recently completed. We have recently launched a new guide Effective Assessment in a Digital Age, which showcases some of the excellent work that has gone before, as well as run a number of national workshops taking this work into institutions. This programme builds on all of this past work, aiming to take us forward in new ways. Strand A: Institutional change. These projects will redesign assessment and feedback processes and practices, making best use of technology to deliver significant change at programme, school or institutional level.(15 months – 2 years funded, £100-£200k per project)Strand B: Evidence and evaluation. These projects will evaluate assessment-and feedback-related innovations which are already underway in a faculty or institution, and report on lessons for the sector.(6 months – 2 years, £20k per project) Strand C: Technology transfer. These projects will package a technology innovation in assessment and feedback for re-use (with associated processes and practice), and support its transfer to two or more named external institutions.(9 months – 2 years, £40k per project)Support projectA Support and Synthesis project led by JISC infoNet and in partnership with JISC-CETIS will co-ordinate a support and synthesis team to provide support to projects across all strands hrough a range of mechanisms including Elluminate workshops, access to sector expertise and peer support through CAMEL networks. I’ll say a little more about that later.
These dates are all in your calendars, but just to summarise the core reporting requirements are:Reports – we’ll be asking you to complete all future reports in the wiki, further information on this process will provided. All comments on your project plans for example will be shared through the wiki. Project plans – all strands - drafts should now be in, and final versions need to be completed by 1st November. Please let me know if there’s likely to be any delays, and we can look to accommodate those where possible. There is one to one support around the evaluation planning available from our evaluation expert – which I’ll mention later. Also cluster level and critical friend support for Strand A plans. Interim reports – six monthlyFinal report – telling the story of your project to the wider community, what you have done, how and why, and what you have learnt. Completion survey is a confidential official sign off of the project.ALL DOCS WILL BE AVAILABLE FROM THE PUBLIC JISC PAGES as well as the programme wiki space. HOWEVER if there is sensitive information to be shared you’ll also be able to do so through the wiki, and this won’t be shared more widely. ALL PROJECTS will also be expected to engage with the Design Studio which I’ll mention a little later as a programme level route to disseminating your project outputs. AND engage with the programme through the programme wiki, online Collaborate sessions, face to face programme meetings, and other external events as required. All strand A projects will also have a project visit. Each strand is also expected to deliver on a set of specific deliverables.....
JISC Assessment pagesProvides:Background to JISC’s activities with technology enhanced assessment Link to the latest JISC publication on assessment – Effective assessment in a digital age Information on previous projects and activities in the assessment spaceResources including activities to run with stakeholder groups developed as part of a series of national workshops
Programme space Share reports, receive feedback, work in shared spaces with other projects Project pages – will be prepopulated by us from information in your project plans. All project plans will be uploaded here, and all future reports you’ll be expected to either create in the wiki, or upload as a document. Using the wiki will mean we will be able to have separate sections for different topics, and collate them in different ways for different purposes. Will be a private space for any sensitive information just shared between you and the programme team. All reports will be also wrapped up as documents and shared on the JISC project pages as a formal record. Closed to the programme community including support team Links to further relevant resources provided here – e.g. Collated resources around evaluation and project management, programme calendar etc Collating project blogs Further information on accessing the wiki and your project pages will be sent round next week.
What types of resources will you find here?A range of different types of tools, case studies, models, learning design, lessons learned etc which support teams in designing, developing and delivering curriculum in their institutions
Sustainability Toolkit. Developed as a result of the programmes experiences, built on at JIF and the JISC online conference. Includes sections on: Changing people and cultureInfluencing organisational changeEmbedding or aligning innovations Creating tools and resources commercial and open approaches to innovationCritical friends resource A resource for future critical friends, on the process, examples, and benefits of the approach.
Our first activity are the project elevator pitches – we’ve asked all projects to prepare a 2 minute ‘elevator pitches’ imagining your are in a lift with some very important people, and have only a limited time to let them know succintly what the value is of your project, and to who. We’ve asked you to think about the following: You’ll have 2 minutes each, plus one minute for one questionPLEASE USE YOUR CONNECTIONS SHEET TO START MAKING NOTES ON THE PROJECTS YOU IDENTIFY CONNECTIONS WITH, to inform who you might like to network with in the next session.
We asked you to prepare a poster providing a visual representation of your project – so thank you all very much for the excellent posters we have today. Based on the information you’ve received so far, please identify up to 5 projects you’d like to spend time talking to. We’ll sound a buzzer after 10 mins and ask you to rotate. Try to include at least 2 projects from different strands. If you are the only representative from your project, please stay with your poster if you have interested parties, but ensure you move round too. PLEASE ENSURE THAT YOU PLACE A POST-IT ON EACH PROJECT YOU’ve identified a connection with your project name , and summary of the connection.