2. Who We Are
Brent GivensKristina (Cragg) Powers, Ph.D.
OCTOBER 2018 SAIR
NORFOLK, VA
2
3. WHY
Employment and Salary Data?
COMPARE
Available Data Sources
THE SOLUTION
The i3 Group Approach
QUESTIONS
THE RESULTS
For Institutional Effectiveness and
ReportingAgenda
3
5. Why employment and salary data?
• This data is becoming the “gold standard,” rather than
graduation rates
• Stakeholders (all types) are calling for this information
• Momentum is building for granular data by program
• Employment and salary info collected for decades
Institutional leaders are asking for the data
5
6. Access
Institutions
applauded for
providing
access.
Graduation
Access does not
mean success.
Thus, a focus on
graduation rates.
2000s
Employment
& Salary
Graduation does not
mean a student will
obtain a job or sufficient
salary to repay loans and
live. Thus, a focus on
employment and salary.
2010s1990s
How has the demand changed?
6
7. Key stakeholders want this information
Students
& Families
Federal & State
GovernmentAccreditors
7
8. Momentum & requirements are building
FEDERAL SURVEYS
• National Survey of Earned Doctorates
• National Survey of Graduates and Post-
Doctorates
• National Survey of Recent College Graduates
INSTITUTIONAL ALUMNI
SURVEYS
Institutional surveys of alumni
NACE
National Association of Colleges and Employers
developed recommended data collection and
data analysis methodologies for uniformity
GAINFUL EMPLOYMENT
REPORTING
Federal requirements for two types of programs:
1. all for-profits and
2. certificate programs receiving Title IV aid
(including public and not-for-profit)
STATE REPORTING
Select states (California, Tennessee) require
select institutions provide student level
employment information. Other states (New
Jersey, Missouri, etc.) are considering it
8
9. Institutional leaders want to…
to create more successful graduates
Improve academic programs
a competitive advantage
Build and maintain
ahead of the momentum
Respond to and stay
9
11. - National sample
Limited use to institutions
- Limited analyses
Conducted for public
reports
- Restricted access
Difficult to gain access to
data
Federal Surveys
Trend data
Multiple data collections
allow for trend data
Publicly Available
Federal data studies and results
are made available to the
public
11
12. - Response rates
Vary from 2-3% to 75+%
- Sensitive topic
Alumni may not answer
questions
- Limited benchmarking
Surveys differ across
institutions
Alumni Surveys
Inexpensive
Relatively inexpensive to
conduct an online
survey
Institutional control
Can decide which questions
to ask and the order
12
13. - Low response rates
Poor information or call
times
- Lack of motivation
Difficulty of obtaining a
response may deter desire to
call alumni
Alumni Phone Calls
From an institution
employee or student
Institutional knowledge can
build rapport with alumni
13
14. - Institutional collection
Each institution must still
collect employment data and
submit summary information
- Misinterpreted directions
Inconsistent data collection
results in differences between
institutions
NACE
Standard methodology
Establishes a standard set of
instructions for institutions to
follow
Benchmarking
available
Can compare to summary data
analyses that are made public
14
15. - Limited information
1) All for-profits and 2) Public
and private not for profits with
Title IV certificate programs
- Limited set of students
Only Title IV students; military
loan deferment students are
excluded
Gainful Employment
Institution & program
data
Salary data available by
required institutions and
programs
- No detailed salary info
Institutions cannot access SSA
data
15
16. - Differing requirements
Institutions serving multiple states
have to submit similar, yet different
information
• Florida: Job placement and wage info 1
to 5 years after graduation
• Tennessee: Job placement data at the
student-level
• California: Job placement and salary
info, in and out of field employment
• Colorado: Employment rate for ROI
• Missouri: The number and percentage
of graduates working in-field within
year of graduation for the five most
recent graduating classes
State Reporting
Data publicly available
Generally required by states,
which could be used for
benchmarking
16
17. - Institutional expertise
i3 Group has worked closely
with institutional experts to
develop standard calling
scripts and questions to
meet institutional needs
i3 Group
Can find alumni
Accurate contact info
and time of day to
reach alumni
Collect & report
key data
Institutions receive
student level data on a
daily basis
And more…
17
19. Why i3 Group?
Nearly 10 years of experience working
with nearly 3 million students
Representing over 1200 campuses
High Quality, High Touch Services
Our team is trained for quality and customer
service, nothing has a higher priority when
speaking to your students
Knowledgeable Partner
Today we perform employment data collection
for higher education institutions with
unmatched results
Our services are designed to comply with all
relevant state, federal, and local regulations
Dedication to Building Relationships
By reaching out directly to students on behalf of your
school, we expand awareness of your focus on student
success and help support future engagement
Our counselors can connect students directly with your
team via 3-way conference calling to immediately
resolve any questions or concerns that come up
during a contact
19
20. location-discovery: Tracing someone who is not findable using last known information.
Location-Discovery
i3 Group uses sophisticated location-discovery technology.
address, email and phone
numbers (including cell) and
time of
day to call
Find Best Information
continuously evaluate
purchased vendors for quality
and new vendors offering
better services
Continuous Evaluation
public and purchased data
sources
Over 30
20
21. “What data are provided to the
institution?”
• Results for each survey question
• Earnings can be converted into annual salaries for
easier analysis
• Updated contact information found through
contact with the graduate and location-discovery
21
22. “Can alumni take the survey online?”
Yes – the i3 Group offers alumni the option to take
the survey online via email or by phone when
contact is made.
22
23. “Can you describe the survey
software?”
Computer-assisted telephone interviewing (CATI)
• Survey and script presented dynamically on screen for each call to
allow counselors to easily flow through survey campaign
• Real-time annotation of student contacts with notes that can be
shared and/or used in future outreach campaigns to make calls
more effective
23
24. “Who calls alumni and when?”
Contact center
• Experienced student loan counselors provide telephone surveys
• Domestic call center providing quality and supervision
• Hours of operation: Monday-Thursday 8am-8pm CST, Friday 8am-
5pm CST
• Use of local numbers, which results in 30-40% higher contact rates
24
27. Survey Completion Date
Data collected by i3
Student Level
Responses
Numerical & Categorical
Responses
Updated Student Contact
Information
Data updates are provided to the institution on a
daily basis – so you can monitor progress.
27
28. Survey questions vary by institutional need
• Are you currently employed?
• If you are not employed, why? (grad school, not seeking a job, etc.)
• Name of current/recent employer and contact info (address, phone
number, website, etc.)
• Most recent position
• Is the position in your field of study?
• What is your salary/hourly wage? [Numbers provided as reported and
annualized for institutional use.]
• Number of hours worked (full vs part-time)
What are some sample analyses I can use for my
institution? 28
29. How does the average
salary of XXX
program graduates
differ based on
employment type?
How can career
services help increase
the % of graduates
getting jobs in their
field?
Employed Out of Field
Employed In Field
$53,337
$63,498
29
30. What % of graduates
are employed in
their field of study in
XXX program?
What are the
characteristics of grads
employed in and out of
field?
Employed Out of
Field
Employed In Field
56%
41%
30
31. In which industries
are most of our
graduates employed?
Business, Admin
& Management
Education &
Training
Gov’t & Public
Administration
Human
Services
18% 15%
15% 11%
How does this
composition compare to
our current programs?
Should we change our
offerings?
31
32. What % of graduates
are continuing their
education and are
unemployed?
How can we better
understand the category
“Other?”
Active
Military Duty
Continuing
Education
Int’l Students
Unable to Work in
US
Other
2%
25%
0%
73%
32
33. What is our Net
Promoter Score
(NPS) among
employed graduates?
In what ways can we
increase the promoters of
unemployed graduates?
Rating Percentage
NPS
Categories
0 7
30%
1 1
2 2
3 2
4 3
5 9
6 6
7 11
29%8 18
9 9
41%10 33
Rating Percentage
NPS
Categories
0 9
35%
1 2
2 3
3 3
4 3
5 11
6 5
7 9
22%8 13
9 6
43%10 36
Employed Unemployed
33
34. What are salary
gains of graduates
who are employed
in their field?
How can we help
students choose a
degree that most closely
aligns with their desired
field of employment? NA
$23,485
Does Not Relate
Doesn’t Really Relate
Not Sure
Somewhat Related
Very Closely Related
$18,962
$3,524
$14,857
$15,062
($22,963)
34
35. Summary Key Points
i3 Group can provide:
Unparalleled response rates due to location-discovery technology and
experience counseling staff.
Data to answer internal questions, required compliance requests, for
continuous improvement, and accreditation needs.
Cost effective and efficient solution.
Obtain information on sensitive employment topics.
35
36. More Information: Contact us via email
or visit the GradSTAT website
Brent Givens Jim Crone Kristina (Cragg) Powers, Ph.D.
i-3group.com
36
Hinweis der Redaktion
Below are the RGBs for the primary colors used. For some of the other shades, we adjusted the opacity, and you can see that if you right click on the object and select Format Shape.
Green: R (148), G (197), B (59)
Blue: R (0), G (174), B (239)
Gray: R (63), G (81), B (91)
Let me know if you have any questions.
Thanks,
Naznin
You might be interested in this session if:
You are looking for employment and salary data of your alum.
You have been tasked with identifying available methods for collecting employment and salary data.
You want to understand the current literature and research to date on alum employment and salary data.
Senior level administrators, Boards of Trustees/Regents are asking for employment and salary information to respond to/stay ahead of the momentum.
Academic leaders want to improve programs and position graduates to be highly sought after by employers.
Leaders want to maintain a competitive advantage with the information.
National Sample – Limited use to institutions since it is a national focus.
Limited Analyses – Data analysis is limited analyses conducted for public reports.
Restricted Access – In some cases, researchers may be able to obtain permission to the data, but after a lot of effort.
Limited Benchmarking – Other institutions may not ask questions in a similar way that allows for benchmarking.
Call from an Institution Employee or Student – Staff who know the institution are making calls..
Low Response Rates - Poor information or call times may cause low response rates.
Phone Calling is Difficult – Employees with other job responsibilities or student workers may not want to call alum due to difficulty of obtaining a response.
Standardized Methodology/ Instructions – Establishes a standard set of methodology and instructions for institutions to follow.
Benchmarking Available – Can compare to summary data analyses that are made public.
Institutional Collection Needed – Each institution must still collect employment data and submit summary information.
Misinterpretation of Directions – Instructions could be subject to misinterpretation with each institution conducting the collection, resulting in some differences between institutions.
No Detailed Salary Info – Institutions are not permitted access to data provided by SSA.
Data Publicly Available – States generally require institutions make the data publicly available, which could be used for benchmarking.
Speak about other states with similar or same requirements as CA & TN – Get states from Taylore.
Ex. California BPPE – if the student does not respond, must be counted as unemployed
Tennessee:
- require an institution receiving optional expedited authorization "job placement data" instead of "gainful employment data" and "student-level data on enrollment and credential attainment" instead of "statistics on credential attainment". This amendment also requires the institution to provide a comprehensive list of all programs offered at the institution.
- web site a direct link to the commission's web site so that consumers and prospective enrollees may become better informed about the institution by evaluating the information required
Colorado:
- The department of higher education shall Prepare The return on investment report must include the employment rate of undergraduate degree or graduates certificate program.
- The number of individual graduates that are not included in the employment rate, with an explanation of why the graduates are excluded from the employment rate.
Florida:
- job placement and wages 1 to 5 years after graduation percentage of graduates who have attained employment, percentage of graduates enrolled in continued education, licensure passage, average wages of employed graduates
Missouri:
- coordinating board for higher education shall provide common areas of employment for people who have earned the credential, including estimates of the numbers and types of jobs available in the professions or industries in which people who have earned the credential usually work
- The number and percentage of graduates who earned the credential who were working in a field related to their educational program within one year of graduation for the five most recent graduating classes and, for the graduates so employed, their average income
- The number of academic years likely required to earn the credential based on statistics for recent graduates
Can Find Alum – Using existing innovative technology and data, i3 can find accurate contact info and time of day to reach the alum.
Collect and Report Key Employment and Salary Info by Alum – Institutions receive student level data for all items asked on a daily basis.
Institutional Expertise – While the i3 Group may not be institutional experts, i3 Group works closely with institutional experts to develop the calling script and questions to meet institutional needs.
Upon placement of graduates demographic information our outbound call center activities will be initiated to verify existing telephone numbers and email addresses provided.
Should a telephone number be disconnected or an email address undeliverable additional location-discovery efforts will be initiated
I3 uses a proprietary skip tracing process involving numerous data sources and dedicated skip tracing staff.
The power behind our locate process is the variety of mutually exclusive data sources used to continually cleanse and verify information.
From a roster of over 25 data vendors we continuously evaluate data integrity and cycle accounts with missing or invalid information to the most efficient sources available.The cycle is perpetual and the skip vendors appendPotential locates daily.
Choice of variables in upload file (major, race/ethnicity, SAT/ACT etc.)
Get rates from operations-macklin
Institution has the ability to include any variables it would like in the upload file (major, race/ethnicity, SAT/ACT, entry year, etc.)
Results for each survey question.
Earnings are also converted into annual salaries for easier analysis.
Updated contact information found through skip tracing.