Tara Lee presentation

1. Transparency of Impact
Measurement
Tara Lee – Upshot Senior Consultant
@upshotsystem

2. Agenda
• Challenges of impact measurement
• What lessons we’ve learnt
• Challenges of implementing changes
• Case study with London Legacy Development
Corporation (LLDC)
@upshotsystem

3. The Football Foundation
UK’s largest
sports
charity
Giving grants
totalling £50m
per year
Increase
participation
in Sport
Fund a range
of community
& sports
organisations
Develop sport
facilities &
infrastructure

4. Our Need
Easy to enter, up to date and complete information.Evidence
All data stored in one place.
Online - automated and real-time data.
Collate, analyse and report.
Meet internal needs while reducing costs.
Outsourcing
Efficient
Impact
Cost- Saving

5. Upshot- Our own impact system
In 2012, Upshot was launched.
• Solution was to build our own system to
cater for all our needs
• Helps the Foundation manage, monitor and
evidence our community projects and
demonstrate impact.
• Launched in 2012 and was made available
to not-for-profit organisations
Internal insight
External impact

6. “Many charities think they are
measuring their impact by reporting
that they have helped huge numbers
of people. But what does this
actually mean? Are they just saying a
couple of kind words to somebody, or
are they truly making a change in
their life?”
Matt Stevenson-Dodd – Chief
Executive, Street League

7. Reference:
• Are charities doing as much good as they say or are
they telling tales?
• The Guardian online
• 7 November 2016

8. Outcome 2
Increase positive attitudes
amongst young people
Outcome 3
Increase diversity and
productivity among
volunteers
Outcome 1
Increase activity of
inactive people
Outcomes and strategies
To reducing obesity
To reduce regional health
inequalities
To develop individuals
To promote respect
To improve education
To reduce offending
To improve mental health
Football Foundation

9. Achieve economic well-
being
Make a positive
contribution
Stay safe
Enjoy and achieve
Be healthy
Outcome 2
Increase positive attitudes
amongst young people
Outcome 3
Increase diversity and
productivity among
volunteers
Outcome 1
Increase activity of
inactive people
Outcomes and strategies
Every Child Matters

10. Economic development
Social & Community
Development
Mental wellbeing
Individual development
Physical wellbeing
Outcome 2
Increase positive attitudes
amongst young people
Outcome 3
Increase diversity and
productivity among
volunteers
Outcome 1
Increase activity of
inactive people
Outcomes and strategies
DCMS

11. DCMS 2
DCMS 3
DCMS 4
DCMS 1
DCMS 1

12. Economic development
Social & Community
Development
Mental wellbeing
Individual development
Physical wellbeing
Outcome 2
Increase positive attitudes
amongst young people
Outcome 3
Increase diversity and
productivity among
volunteers
Outcome 1
Increase activity of
inactive people
Outcomes and strategies
DCMS

13. Outcome 2
Increase positive attitudes
amongst young people
Outcome 3
Increase diversity and
productivity among
volunteers
Outcome 1
Increase activity of
inactive people
Activity 5
Taster festival
Activity 6
Activity 4
Mentoring programme
Activity 2
Skills workshops
Activity 3
Volunteer education
programme
Activity 1
Rugby sessions

14. 2
ttitudes
people
3
y and
mong
1
ty of
ple
Activity 5
Taster festival
Activity 6
Activity 4
Mentoring programme
Activity 2
Skills workshops
Activity 3
Volunteer education
programme
Activity 1
Rugby sessions
PI 5
Number of people
participating regularly
PI 4
Quality of coach
observations
PI 3
Quality of feedback
from young people
PI 2
Number of session hours
delivered
PI 1
Number of people
attending sessions
PI 6
Number of people going
into formal training or
education following
programmes

15. vity 5
festival
vity 6
vity 4
programme
vity 2
orkshops
vity 3
r education
ramme
vity 1
sessions
PI 5
Number of people
participating regularly
PI 4
Quality of coach
observations
PI 3
Quality of feedback
from young people
PI 2
Number of session hours
delivered
PI 1
Number of people
attending sessions
PI 6
Number of people going
into formal training or
education following
programmes
Target 6
25% are no longer NEET within six months
of programme starting
Target 4
50% of coaches reported an increase in
confidence in the young people
Target 3
75% feel it was a positive experience
Target 2
20 sessions held in 3 months, attended by
20 x 16-18 yrs olds on average
Target 1
100 women over 40 yrs attend
at least 10 sessions
Target 5
30% of previously inactive people have
taken part in 9 sessions in a 12 week period

16. PI 5
Number of people
participating regularly
PI 4
Quality of coach
observations
PI 3
Quality of feedback
from young people
PI 2
umber of session hours
delivered
PI 1
Number of people
attending sessions
Target 5
30% of previously inactive people have
taken part in 9 sessions in a 12 week period
Target 4
50% of coaches reported an increase in
confidence in the young people
Target 3
75% feel it was a positive experience
Target 2
20 sessions held in 3 months, attended by
20 x 16-18 yrs olds on average
Target 1
100 women over 40 yrs attend
at least 10 sessions
Attendance report
Registers
Videos
Questionnaires
Oral testimonials
Written testimonials
PI 6
umber of people going
nto formal training or
education following
programmes
Target 6
25% are no longer NEET within six months
of programme starting
‘Year later’ survey

17. DCMS 2
DCMS 3
DCMS 4
DCMS 5
DCMS 1

18. London Legacy Development
Corporation – case study

19. Problems faced in 2015
• Current systems used by partners were not fit for
purpose or affordable
• Complicated systems had put partners off of reporting
• Reporting seen as too time consuming
• Keeping track of participation figures
• Pulling together 30+ partners figures/reports

20. Teething issues
• Challenging perceptions on what a good monitoring
system can offer partners
• Partners learning to use a new system
• Amalgamating data fields for 30+ partners (such as
lists of disabilities and long term health conditions)

21. What was learnt along the way?
• Partners will use the system if they feel it is of use
• When partners are listened to, engagement is better
• Dictating from the top rarely works
• Targets should be collaborative
• Numbers don’t tell the whole picture

22. How has this helped the
programme?
• Deeper analysis
• Makes partner’s and funder’s lives easier
• Partners want more information
• Better communication with participants
• Helps to measure further qualitative impact – telling the story
• Greater insight into the programme

25. Challenges still to face
• A lot of organisations use multiple systems
• Open data
• Measuring soft outcomes

26. Thanks for listening – any
questions?
@upshotsystem