1) The document discusses the concept of performance-feedback-revision (PFR) which involves using feedback on previous work to improve current and future performance. 2) Students in the module are asked to frequently provide feedback on each other's work to develop critical evaluation skills. They must complete private study tasks each week and receive feedback. 3) An "after action review" process is used to analyze what should have happened, what actually happened, why there was a difference, and how to ensure it doesn't happen again in the future. This approach could work for any module requiring private study tasks.

1. Performance-Feedback-RevisionPeter Cruickshank / Hazel HallSchool of Computing

2. PFRPerformance-Feedback-Revision Using feedback on earlier work to revise current output and enhance future performance Explained to the students in the context of biological evolution, where the processes of P-F-R are continuous in the first formal lecture of the module the students watch Baba Brinkman’s Performance-Feedback-Revision rap …in the context of the development of academic work

3. Students need to understand basis for feedback...

6. ...and how they will be performing

10. When you participate you can learn a lot in classes. The revision at home is much easier.

15. Quick feedback is essential

16. Report structure

17. Report content

18. Use feedback!

19. Value and impact of course work set-up Classes Excellent attendance Highly participative sessions Advanced, engaged discussion of the research literature Student performance Obvious lack of leeway for extensions due to tight module structure, and the staged nature of the activities that build up to the assessment tasks, will encourage you to get your work completed on time The high level of engagement will improve your confidence to be critical in your evaluation of the material that we cover in the module Excellent assessment results in both the course work and the exam The impact of the approach that we use in this module should be felt in other modules, e.g. Honours projects

20. But we get feedback too

21. Feedback – impact of the course work approach Now I can evaluate papers and assess them. I no longer read something and take it as truth. Having tasks set for each week forces me to study. The content of the module was really learned during the semester instead of being learned right before the exam. You are actually made to do work… As a result I feel confident about passing the module. This is a module where I feel like I have been able to achieve a great deal… I feel that I have developed a ‘deep’ understanding of the topic and this is very satisfying. Class participation helps with understanding of difficult topics. [Group work in class] is valuable, occasionally very entertaining, and worthwhile to have the experience because this is how work is often done in industry. Support from the lecturers and the weekly reading made the module rewarding and interesting. Interesting module, thoroughly enjoyed as all efforts will be well rewarded at the end. Private study tasks keep you on track and help with exam study and assessments. All students are prepared so group work is effective.

22. Fingers crossed for more happy “customers” Now I feel confident about most topics and have a good understanding about KM – a good reflection! Very good feedback before and after assignments. One of the best modules. It is an interesting module that has provided me with new information and techniques that help in managing lots of things to do with knowledge management. The module adds another dimension to one’s own personal view of society and organisations. Challenging and interesting – it has increased my interests. I just like everything about the module. I liked the module very much. Very good teaching style. I find this module helps in understanding previous modules better. Overall it is a module that everyone should participate in – covers a wide range of interesting subjects. Very good. It should be core to all Business and Information Systems programmes. An interesting module. Lecturers are kind and helpful. I really enjoyed this module – Thanks! This module has proven the most rewarding of all modules taken. Absolutely superb! Excellent module – very useful for the real world. Enthusiasm all the way! Encouragement all the way! I learnt a whole lot!

23. A recurring theme Some examples

24. Acquisition of knowledge, skills, understanding, behaviour and values Something is learned if a person or collective respond differently to a task at first hand The more you know, the more you can learn Learning is? 24 INF10102

25. Three ways of learning (Confucianism) 25 INF10102

26. OADI cycle of individual learning Observe-Asses-Design-Implement cycle (Kofmann in Kim 1993) 26 INF10102

27. The Deming cycle Management & planning process Operative process 27 INF10102

28. The Deming cycleSeems familiar? …it’s the Observe-Asses-Design-Implement cycle from earlier 28 INF10102

29. The fifth discipline Personal mastery Organisations learn only through individuals who learn, therefore individuals need to commit to learn. “People with high levels of personal mastery are continually expanding their ability to create the results in life they truly seek” Personal vision Checking & re-checking if vision is ambitious & realistic Current reality 29 INF10102

30. KM strategy evaluation

31. The Five Levels of Process Maturity 31 CSN11113

32. COBIT Framework BUSINESS OBJECTIVES AND GOVERNANCE OBJECTIVES INFORMATION C O B I T F R A M E W O R K ME1 Monitor and evaluate IT performance. ME2 Monitor and evaluate internal control. ME3 Ensure compliance with external requirements. ME4 Provide IT governance. PO1 Define a strategic IT plan. PO2 Define the information architecture. PO3 Determine technological direction. PO4 Define the IT processes, organisation and relationships. PO5 Manage the IT investment. PO6 Communicate management aims and direction. PO7 Manage IT human resources. PO8 Manage quality. PO9 Assess and manage IT risks. PO10 Manage projects. Integrity Efficiency Effectiveness Availability Compliance Confidentiality PLAN AND ORGANISE MONITOR AND EVALUATE Reliability IT RESOURCES DS1 Define and manage service levels. DS2 Manage third-party services. DS3 Manage performance and capacity. DS4 Ensure continuous service. DS5 Ensure systems security. DS6 Identify and allocate costs. DS7 Educate and train users. DS8 Manage service desk and incidents. DS9 Manage the configuration. DS10 Manage problems. DS11 Manage data. DS12 Manage the physical environment. DS13 Manage operations. Applications Information Infrastructure People DELIVER AND SUPPORT AI1 Identify automated solutions. AI2 Acquire and maintain application software. AI3 Acquire and maintain technology infrastructure. AI4 Enable operation and use. AI5 Procure IT resources. AI6 Manage changes. AI7 Install and accredit solutions and changes. ACQUIRE AND IMPLEMENT

33. Business Objectives: Goals of the organisation Business Security Policy Business Context: Laws, Risks, Costs IS or Computer Security Policy Computer Environment: Functions, Threats, Costs… Security audit in context You’ll remembers the computer security policy and practices should be the end result of a business driven process Computer Security Practices 33 CSN11113

34. Business Objectives: Goals of the organisation Business Security Policy Business Context: Laws, Risks, Costs IS or Computer Security Policy Computer Environment: Functions, Threats, Costs… Security audit in context Audit closes the loop by testing whether actual practise reflect policies , and that policies support business objectives You’ll remembers the computer security policy and practices should be the end result of a business driven process Computer Security Practices 34 CSN11113

35. KM strategy evaluation Post-implementation output indicators Increased financial return Higher volume of knowledge-based transactions Transformation of (information) content Increase in use of organisational knowledge Growth of knowledge resources Higher project survival/success rates Increased customer satisfaction What have we learned? What do we do next? Deming cycle

36. Performance-Feedback-RevisionConclusions The frequency with which students are asked to provide feedback on one another’s work encourages the development of skills in critical evaluation The main challenge is to persuade the students to adopt the system from the start some come to class in the second week not having prepared the private study exercise …and are sent away An “after action review” exercise is then held to consider (a) what should have happened (b) what actually happened (c) the reasons why (a) and (b) did not match (d) how to ensure that this does not happen again in the future This process could work for any module that requires the completion of private study tasks

37. Performance-Feedback-Revision rap Next slide: Baba Brinkman and the http://www.youtube.com/watch?v=hod20AzYB4o

38. Thank You