1. 1

2. Today’s Presenters
Suzanne
Barnard,
Annie E.
Casey
Foundation
Kevin
Haggerty,
Social
Development
Research
Group
Margaret
Flynn-Khan,
Mainspring
Consulting
Rebecca
Boxx,
Providence
Children and
Youth
Cabinet
2

3. I. Evidence2Success and how it works
II. What we’re looking for in new Evidence2Success
communities
III. The role of prevention science and proven programs
IV. How Evidence2Success helps communities invest in what
works
V. Evidence2Success progress in Providence
VI. Your questions via the Q&A window
Webinar Overview
3

4. Communicate with us using the Q&A window at the
right of the presentation window.
• Type questions for the panel at any time during the
webinar.
• Use the box to let us know if you are having technical
difficulties.
Communicating During the Webinar
4

5. Introducing Evidence2Success
Suzanne Barnard
5

6. The Annie E. Casey Foundation
develops solutions to
build a brighter future for
children, families
and communities.
6

7. Lessons from Research:
What is Required for Young People to Be Successful?
Community
School
Individual and Peer
Family
Child Well-
being
Positive
Relationships
Behavior
EducationPhysical Health
Emotional
Well-being
7

8. The Evidence2Success Framework
Governance
structure
including public
systems and
community
Strategic use of
data
Comprehensive
financing
strategies
Implementation
of evidence-
based programs
(EBPs)
Performance
measures
8

9. Evidence2Success:
Shared responsibility and shared accountability
Priority
Outcome
Areas
Child Welfare
Service Providers
Public Health
Community
Representatives
Education
System
Juvenile Justice
System
Mental Health
Elected LeadersRisk and protective factors
9

10. Evidence2Success Communities
Designated site
coordinator and
implementation
oversight of evidence-
based practices
Commitment to provide
and shift public funding
and to share funding
data
Commitment of school
system to administer surveys
and provide data
Partnership of
government systems,
elected officials and
residents
• Locality with at least 100,000
residents
• Focus neighborhoods where
significant financial resources
are spent on children
Ability or willingness to
use and share data
across systems
10

11. Governance Structure:
Evidence2Success is Community-Owned
Evidence2Success
Governance Structure
• Local site coordinator
• Fiscal agent
• Lasting local home
Ongoing local capacity
• Dedicated staff liaison
to communities
• Tools and technical
assistance
Community leaders ● System leaders ● Residents
11

12. Governance Structure
Their Charge:
• Select local site coordinator
• Review and understand data
• Set priorities
• Select programs
• Develop and review RFPs
• Monitor implementation progress and
outcomes
• Develop finance plan and scale plan
12

13. The local site coordinator (100%
FTE) is a senior-level executive in
the Evidence2Success community
who will ensure successful
implementation of the
Evidence2Success framework and
build necessary capacities. May serve
as finance lead.
Ongoing Local Capacity:
Local Site Coordinator
13

14. Ongoing Local Capacity:
System Partner Commitments
• Commit resources to support the work and commit to redirecting
an increasing amount of public resources toward evidence-based
programs over time
– Commit $150,000 cash at the outset for evidence-based programs,
to be matched by the Foundation
• Designate a finance lead, along with finance experts from
participating public departments
• Complete a fund map – an analysis of how key funding streams are
invested
• Develop a collaborative strategic financing plan
• Pool a portion of resources dedicated to this effort that the
partnership will determine how best to spend based on local needs
14

15. Annie E. Casey Foundation Support Structure
Evidence2Success Site Manager
Works with local site coordinator
Tools and Technical Assistance
Survey * Online tools * In-person
consulting * Financing toolkit * Program
database * Evaluation dashboard
15

16. Evidence2Success Phases
Phase 1:
Build
Partnership
Capacity
Phase 2:
Select
Priorities and
Proven
Programs
Phase 3;
Prepare to
Install
Programs
Phase 4:Install
Programs, Align
Practice,
Evaluate, Adapt
• Fund and implement evidence-based programs city or state–wide
• Ongoing monitoring, tracking and adapting using survey data and
dashboard
• Re-administer youth survey and continue to use fund-mapping tools
16

17. Prevention Science and
Proven Programs
Kevin Haggerty
17

18. 1. Use local data to prioritize underlying factors
that contribute to well-being
2. Make decisions about which proven
programs to use
3. Discuss decisions with confidence, knowing
that they are grounded in solid research
The Role of Prevention Science in Evidence2Success
18

19. Why Proven (Evidence-Based) Programs?
• More consistent positive outcomes
• Strong ethical argument
• Cost savings to taxpayers
• Ability to address multiple risk, protective factors and
outcomes
• Higher certainty of achieving the intended impact when
implemented with fidelity
19

20. Essential Characteristics of Proven Programs
Impact
Evaluation
Quality
System
Readiness
Intervention
Specificity
 Positive impact on
child well-being
outcomes
 Absence of any
negative effects
 One randomized
controlled trial OR two
quasi-experimental
trials without design
flaws
 Population of focus
is clearly defined
 Risk and protective
factors that a program
seeks to change are
identifiable
 Training materials are
available
 Information provided on
the financial and human
resources required
 Cost-benefit analysis

21. Investing Smarter
for Greater Returns
Margaret Flynn-Khan
21

22. • Achieving better outcomes from your investments
• Coordinating investments in shared priorities
• Reducing remedial spending by investing on front end
• Leveraging new public and private dollars to scale and
sustain programs and infrastructure
Investing Smarter for Greater Returns
22

23. How Do You Invest Smarter for Greater Returns?
$54,890,000 annual
spending for children
and families in one
community
Program Total
Investment
(per year)
Incredible Years
BASIC
$127,386
Promoting Alternative
Thinking Strategies
$50,773
(for 3 years)
Life Skills Training $14,280
Functional Family
Therapy (FFT)
$287,100
Nurse Family
Partnership (NFP)
$103,631
(for 2 years)
Total shift in
spending $583,170
Redirect 1 percent to
proven programs
23

24. Developing a Strategic Financing Plan
What are your
financing goals?
What resources do
you have?
What financial
resources do you
need?
What financing
strategies will you
implement?
What financing
structures will you
implement?

25. Support for Strategic Financing in Evidence2Success
• Connection with national technical assistance
consultants
– Act as coach to the finance lead
– Support the development of the fund map and strategic
financing plan
• Access to online strategic financing toolkit
• Participation in a peer technical assistance network
– In-person training
– Ongoing information sharing and opportunities to connect
with peers
25

26. Evidence2Success in Providence
Rebecca Boxx
26

27. • Providence Children and Youth Cabinet serves as the
convener of cross-sector and cross-system efforts in the city
• Early exploration of the Evidence2Success framework
identified clear synergy with existing city priorities:
– Use strong data on well-being of children and youth
– Deploy resources more effectively for children and youth
– Implement the highest quality programs
– Collaborate across sectors and systems
• Public system executives provide ongoing leadership:
education, child welfare, public health
Evidence2Success and Providence
27

28. Priority Outcomes for Providence Youth
28

29. • Outcomes chosen through
community-driven process
• Six proven programs selected
Providence Progress to Date
• Finance plan: Public system dollars
and Health Equity Zone grant
• Implementation underway, serving
more than 2,000 children 29

30. How does a program earn the distinction of being proven?
Develop a
strong
program
design
Attain strong
evidence of
positive program
outcomes
• Carry out
evaluation with
a comparison
group
• Conduct
regression
analysis (quasi-
experimental
design )
• Perform
multiple pre-
and post -
evaluations
• Meta-analysis
Produce
indicators
of
positive
outcomes
• Conduct evaluation
with random
assignment
(experimental
design)
• Carry out multiple
evaluations with
strong comparison
group (quasi-
experimental
design)
• Conduct
pre- and
post-
interventi
on
evaluation
• Evaluate
program
quality and
process
• Establish
continuous
improvement
system
Ensure
fidelity of
Implement-
ation
Obtain
evidence of
positive
program
outcomes
• Create logic
model and
replication
materials
30

31. Projected Program Targets:
First Year of Implementation in One Site
Program How Much? How Well? What difference will it
make?
Incredible Years 503
children
$107,572 Redirected 15% increase in social
competence
Cognitive Behavioral
Intervention for Trauma in
Schools (CBITS)
40 children $ 32,825
Redirected
10% decrease in
depression
Positive Action 2,141 children $ 96,044
Redirected
15% decrease in problem
behavior
31

32. Please use the Q&A function on your screen to
submit questions.
For additional information after the webinar:
Mildred Johnson, mjohnson@aecf.org
Proposal due date:
May 28, 2015
For supplemental materials and more information about
Evidence2Success: www.aecf.org
Questions?
32