Many of us know the value of our work in the community, and investors and supporters think they know the value of our work in the community. Having an established method to collect and assess data that measures this value is a powerful tool. Participants will learn to anticipate which types of data they should collect, how to collect and assess it, and how to use it to improve productivity and show off their accomplishments.

1. Success Measures:
Transforming Outcome Evaluation
Presentation to the National Rural Housing Conference
December 6, 2012
Nancy Kopf, Senior Manager,
Success Measures Evaluation Services
nkopf@nw.org

2. Success Measures is. . .
 Participatory outcome evaluation
approach
 Data collection tools measuring
range of outcomes
 Web-based data system
 Training and TA program

3. Let’s change the conversation!
 What are some ways you can think
about, talk about, and implement data
collection that creates value for your
organization?
 What are some practical ways you can
begin to create value from information?

4. Evaluation is in your interest!
 Capitalize on the information you already
collect—quality is critical.
 Data that you collect should be useful for your
organization and for engaging funders.
 Determine how you are going to use data
before you start collecting.
 Think about how to communicate your value
to different types of audiences.

5. Outputs/Production/Performance
Measurement
 What you do
 How you spend your funding
 Types of people you are serving
 Participation rates for programs

6. Success Measures is Outcome
Evaluation
 Outcomes are the benefits that occur as a result
of our work.
 Outcomes can be changes in:
Attitudes or values
Knowledge
Skill
Behavior
Conditions
Policies, laws, regulations, practices

7. Outcomes
Programs can have outcomes for
Individuals
 Groups of people/families
 Communities
 Organizations

8. Categories of Change in Our Work
 Change in physical conditions
 Observations of buildings, infrastructure, public
spaces
 Change in quality of life for individuals and the
community
 Surveying residents who live in your properties,
broader community
 Key informant interviews
 Economic impact
 Calculation tools

10. Use
To identify where to focus resources
To demonstrate accomplishments
To look at “spillover” effect

12. Samples from Community Survey

15. A sample of data
from the Wells
Fargo evaluation
effort.
Success Measures at NeighborWorks America

16. ¿Cree usted que los siguientes son los problemas de su
comunidad?
Do you think the following are issues in the community?
Tráfico/exceso de velocidad-Traffic/Speeding
Graffiti
Basura - Trash
Las drogas - Drugs
Vandalismo - Vandalism
Iluminación de las calles - Street Lighting
Gatos callejeros / perros-Stray Cats/Dogs
Dumping
0% 10% 20% 30% 40% 50% 60% 70%

17. Is there Confidence in the Community’s Future?

19. Calculation: Local Economic Impact
of New Construction/Renovation
What does the tool do?
 Estimates the total economic impact of a housing project as each dollar spent on
construction or rehabilitation flows through the local economy
How does it work?
 Uses mathematical calculations to trace the original investment through the
purchase of goods and services by the developer, construction workers, residents
and the local government
Why use the tool?
 Demonstrate the benefits of community development efforts in housing projects
to the locality and society
Where did the tool’s framework and multiplier come from?
 National Association of Homebuilders
 Multipliers used are from economic modeling done in 2002
 Numbers were re-validated in 2008

20. Exple
In 2007, within Randolph County, we built 10 units serving households
with an average income of just over $11,000 each. Click each module
to view the results.
Module A Module B Module C
Through the construction of those 10 units we:
Contributed $790,000 to the local economy
Supported $430,000 in local business wages
Generated $62,148 in local government taxes and fees
paid.
20 of
20 of
16
16

21. Example
In 2007, within Randolph County, we built 10 units serving households
with an average income of just over $11,000 each. Click each module
to view the results.
Module A Module B Module C
The local government received more than $4000 in fees from
the home sales transaction and sales generated $12,877 in
local income to businesses.
21 of
21 of
16
16

22. Example
In 2007, within Randolph County, we built 10 units serving households
with an average income of just over $11,000 each. Click each module
to view the results.
Module A Module B Module C
In their first year as homeowners, it is estimated these 10 low-
income households generated income to the local economy of
more than $11,000.
Total local business income from
construction, sales, and first year…
22 of
22 of
16
16

23. Ways to Use Findings
 Demonstrate the local economic contributions of building or
rehabbing affordable housing. – results can be analyzed by
council district, ward, congressional district, etc.
 Create a compelling case to a local jurisdiction considering
new nonprofit development.
 Demonstrate economic contribution of low income
homeowners to the community.
 Disseminate at press events such as groundbreaking
ceremonies, in stakeholder communications, and annual
reports.