SlideShare ist ein Scribd-Unternehmen logo
1 von 8
Downloaden Sie, um offline zu lesen
Developing, Validating, and
Analyzing Structured Interviews



BCGi: Adverse Impact & Test
Validation Book Series
What are Structured Interviews
and How are they Scored and Analyzed?

• Structured Interviews are oral interview sessions for hiring or
  promotional selection processes
• They are different than many ad-hoc, informal interviews in both
  the way they are given and how they are scored
• Structured Interviews can include several types of questions:
   – Situational questions
   – Behavioral questions
   – Competency-based questions
• And typically involve several raters and pre-defined scoring
  routines


                      www.BCGinstitute.org
Why is this Topic Important to HR/EEO Professionals?
• Why do I need to know about this topic?
  – Yes… Interviews are “tests” and they are also subject to Title
    VII validation laws and are frequently litigated
  – Informal, ad-hoc interviews are generally not as effective as
    validated, structured interviews
  – There is a process for building and developing strong
    interviews, but many employers don’t take the time
• What are the key essentials I need to know about this topic?
  – Structured interviews are not too difficult to develop
  – Using multiple raters and rating scales can improve the
    effectiveness and validity of your interview process
• What are the consequences surrounding these issues?
  – Ad-hoc, informal interviews can possibly introduce liability and
    lower the quality of your workforce
  – The “start up” cost of a validation case is $30k to $80k
                      www.BCGinstitute.org
Presentation Overview


• Overview & Background
• Methods for Improving the Interview Process
• Types of Questions to Include in Structured
  Interviews
• Steps for Developing Situational Questions
• Administering and Scoring an Interview




                www.BCGinstitute.org
Presentation Overview

• Methods for Improving the Interview Process
  – How valid and reliable the interview is may be highly
    specific to both the situation and to the rater.
• Types of Questions to Include in Structured
  Interviews
  – Situational questions
  – Behavioral questions
  – Competency-based questions


                 www.BCGinstitute.org
Presentation Overview

• Steps for Developing Situational Questions
  – We’ll cover 13 steps that are typically involved in the
    Interview development process
• Administering and Scoring an Interview
  –   Selecting raters
  –   Training raters
  –   Assembling panels
  –   Administering/scoring the interview
  –   Combining applicant scores from multiple panels


                   www.BCGinstitute.org
Resources
• Adverse Impact and Test Validation: A Practitioner's
  Handbook by Daniel A. Biddle, Ph.D.
   – Purchase online at www.BCGinstitute.org

• Adverse Impact and Test Validation Book Series Webinars
   – Recordings available online for all BCGi Platinum Members
   – Webinar slides available online to all BCGi Standard & Platinum
     Members

• BCGi Membership
   – Free Standard Membership
   – Premium Platinum Membership



                        www.BCGinstitute.org
About Our Sponsor: Biddle Consulting Group (BCG)
 BCG is an HR firm dedicated to providing the highest products and services related to
 Equal Employment Opportunity (EEO), Affirmative Action and Employee Selection.
 • BCG’s Consulting Services
     ― Affirmative Action Plan Outsourcing
     ― Compensation Analysis
     ― EEO/AA Litigation Support (Plaintiff and Defendant)
     ― Job Analysis
     ― Test Development and Test Validation
 • BCG’s Software Products
     ― Adverse Impact Toolkit™
     ― AutoAAP® affirmative action plan development software
     ― AutoGOJA® job analysis software
     ― C4 call center testing software
     ― COMPARE™ compensation analysis software
     ― CritiCall® dispatcher/call-taker personnel selection software
     ― ENCOUNTER soft skills video situational judgment testing software
     ― OPAC® office skills testing software
     ― TVAP™ Test Validation & Analysis Program software
                                www.Biddle.com

Weitere ähnliche Inhalte

Was ist angesagt?

Effects of Teachers Teaching Strategies and the Academic Performance at Grad...
Effects of  Teachers Teaching Strategies and the Academic Performance at Grad...Effects of  Teachers Teaching Strategies and the Academic Performance at Grad...
Effects of Teachers Teaching Strategies and the Academic Performance at Grad...Brandon King Albito
 
Educational measurement, assessment and evaluation
Educational measurement, assessment and evaluationEducational measurement, assessment and evaluation
Educational measurement, assessment and evaluationBoyet Aluan
 
Why study attitude?
Why study attitude?Why study attitude?
Why study attitude?leahamper29
 
Researh design and conceptual framework
Researh design and conceptual frameworkResearh design and conceptual framework
Researh design and conceptual frameworkAchyut Raj Pandey
 
Guidelines for Constructing Effective Test Items
Guidelines for Constructing Effective Test ItemsGuidelines for Constructing Effective Test Items
Guidelines for Constructing Effective Test ItemsKimverly Torres
 
Student Response Systems Presentation Final
Student Response Systems Presentation FinalStudent Response Systems Presentation Final
Student Response Systems Presentation FinalSue Miller
 
Preparing and implementing research instruments
Preparing and implementing research instrumentsPreparing and implementing research instruments
Preparing and implementing research instrumentsLeah Condina
 
Purpose of the e portfolio
Purpose of the e portfolioPurpose of the e portfolio
Purpose of the e portfolioSonya Price
 
Types of Assessment Maximum and Typical performance
Types of Assessment Maximum and Typical performanceTypes of Assessment Maximum and Typical performance
Types of Assessment Maximum and Typical performanceHadeeqaTanveer
 
The Fundamentals of Conducting Research
The Fundamentals of Conducting ResearchThe Fundamentals of Conducting Research
The Fundamentals of Conducting Researchaucawarc
 
Report writing Rubrics.docx
Report writing Rubrics.docxReport writing Rubrics.docx
Report writing Rubrics.docxazharudinali1
 

Was ist angesagt? (20)

Effects of Teachers Teaching Strategies and the Academic Performance at Grad...
Effects of  Teachers Teaching Strategies and the Academic Performance at Grad...Effects of  Teachers Teaching Strategies and the Academic Performance at Grad...
Effects of Teachers Teaching Strategies and the Academic Performance at Grad...
 
Educational measurement, assessment and evaluation
Educational measurement, assessment and evaluationEducational measurement, assessment and evaluation
Educational measurement, assessment and evaluation
 
Using Standardized Instruments
Using Standardized InstrumentsUsing Standardized Instruments
Using Standardized Instruments
 
Why study attitude?
Why study attitude?Why study attitude?
Why study attitude?
 
Lesson 1 values of research to man
Lesson 1   values of research to manLesson 1   values of research to man
Lesson 1 values of research to man
 
BUDGET PROPOSAL SBM.pdf
BUDGET PROPOSAL SBM.pdfBUDGET PROPOSAL SBM.pdf
BUDGET PROPOSAL SBM.pdf
 
Researh design and conceptual framework
Researh design and conceptual frameworkResearh design and conceptual framework
Researh design and conceptual framework
 
Validity
ValidityValidity
Validity
 
Guidelines for Constructing Effective Test Items
Guidelines for Constructing Effective Test ItemsGuidelines for Constructing Effective Test Items
Guidelines for Constructing Effective Test Items
 
Aspects of Validity
Aspects of ValidityAspects of Validity
Aspects of Validity
 
WPA 2015 Proposal
WPA 2015 ProposalWPA 2015 Proposal
WPA 2015 Proposal
 
Student Response Systems Presentation Final
Student Response Systems Presentation FinalStudent Response Systems Presentation Final
Student Response Systems Presentation Final
 
Preparing and implementing research instruments
Preparing and implementing research instrumentsPreparing and implementing research instruments
Preparing and implementing research instruments
 
Purpose of the e portfolio
Purpose of the e portfolioPurpose of the e portfolio
Purpose of the e portfolio
 
Item analysis
Item analysisItem analysis
Item analysis
 
Resume
ResumeResume
Resume
 
The Research Problem
The Research ProblemThe Research Problem
The Research Problem
 
Types of Assessment Maximum and Typical performance
Types of Assessment Maximum and Typical performanceTypes of Assessment Maximum and Typical performance
Types of Assessment Maximum and Typical performance
 
The Fundamentals of Conducting Research
The Fundamentals of Conducting ResearchThe Fundamentals of Conducting Research
The Fundamentals of Conducting Research
 
Report writing Rubrics.docx
Report writing Rubrics.docxReport writing Rubrics.docx
Report writing Rubrics.docx
 

Ähnlich wie Developing, Validating, and Analyzing Structured Interviews (Overview)

Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAnanya Pani
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAnanya Pani
 
Benchmarking for hrd professionals
Benchmarking for hrd professionalsBenchmarking for hrd professionals
Benchmarking for hrd professionalsSorab Sadri
 
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...Texavi Innovative Solutions
 
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'Emma Mirrington
 
ORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxHR Spot
 
90 days to make a difference - approach
90 days to make a difference - approach90 days to make a difference - approach
90 days to make a difference - approachStuart Creasey
 
Use of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentUse of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentCCH iFirm
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality productCarmen Brion
 
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerImproving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerEdward Byers, PMP, SSGB
 
R a ci & innovation
R a ci & innovationR a ci & innovation
R a ci & innovationAlan Culler
 
Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Abdel-Halim Mahmoud
 
Recruiting 101
Recruiting 101Recruiting 101
Recruiting 101Meemz11
 
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, SonruEmma Mirrington
 

Ähnlich wie Developing, Validating, and Analyzing Structured Interviews (Overview) (20)

Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Benchmarking for hrd professionals
Benchmarking for hrd professionalsBenchmarking for hrd professionals
Benchmarking for hrd professionals
 
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
 
Sanitized tb swstmppp1516july
Sanitized tb swstmppp1516julySanitized tb swstmppp1516july
Sanitized tb swstmppp1516july
 
Vijay Sharma
Vijay SharmaVijay Sharma
Vijay Sharma
 
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
 
Beginning auditor (1)
Beginning auditor (1)Beginning auditor (1)
Beginning auditor (1)
 
Business Analysis.pdf
Business Analysis.pdfBusiness Analysis.pdf
Business Analysis.pdf
 
ORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptx
 
90 days to make a difference - approach
90 days to make a difference - approach90 days to make a difference - approach
90 days to make a difference - approach
 
Use of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentUse of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitment
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerImproving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
 
R a ci & innovation
R a ci & innovationR a ci & innovation
R a ci & innovation
 
Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model"
 
Recruiting 101
Recruiting 101Recruiting 101
Recruiting 101
 
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
 
360 performance appraisal
360 performance appraisal360 performance appraisal
360 performance appraisal
 
Ch06
Ch06 Ch06
Ch06
 

Developing, Validating, and Analyzing Structured Interviews (Overview)

  • 1. Developing, Validating, and Analyzing Structured Interviews BCGi: Adverse Impact & Test Validation Book Series
  • 2. What are Structured Interviews and How are they Scored and Analyzed? • Structured Interviews are oral interview sessions for hiring or promotional selection processes • They are different than many ad-hoc, informal interviews in both the way they are given and how they are scored • Structured Interviews can include several types of questions: – Situational questions – Behavioral questions – Competency-based questions • And typically involve several raters and pre-defined scoring routines www.BCGinstitute.org
  • 3. Why is this Topic Important to HR/EEO Professionals? • Why do I need to know about this topic? – Yes… Interviews are “tests” and they are also subject to Title VII validation laws and are frequently litigated – Informal, ad-hoc interviews are generally not as effective as validated, structured interviews – There is a process for building and developing strong interviews, but many employers don’t take the time • What are the key essentials I need to know about this topic? – Structured interviews are not too difficult to develop – Using multiple raters and rating scales can improve the effectiveness and validity of your interview process • What are the consequences surrounding these issues? – Ad-hoc, informal interviews can possibly introduce liability and lower the quality of your workforce – The “start up” cost of a validation case is $30k to $80k www.BCGinstitute.org
  • 4. Presentation Overview • Overview & Background • Methods for Improving the Interview Process • Types of Questions to Include in Structured Interviews • Steps for Developing Situational Questions • Administering and Scoring an Interview www.BCGinstitute.org
  • 5. Presentation Overview • Methods for Improving the Interview Process – How valid and reliable the interview is may be highly specific to both the situation and to the rater. • Types of Questions to Include in Structured Interviews – Situational questions – Behavioral questions – Competency-based questions www.BCGinstitute.org
  • 6. Presentation Overview • Steps for Developing Situational Questions – We’ll cover 13 steps that are typically involved in the Interview development process • Administering and Scoring an Interview – Selecting raters – Training raters – Assembling panels – Administering/scoring the interview – Combining applicant scores from multiple panels www.BCGinstitute.org
  • 7. Resources • Adverse Impact and Test Validation: A Practitioner's Handbook by Daniel A. Biddle, Ph.D. – Purchase online at www.BCGinstitute.org • Adverse Impact and Test Validation Book Series Webinars – Recordings available online for all BCGi Platinum Members – Webinar slides available online to all BCGi Standard & Platinum Members • BCGi Membership – Free Standard Membership – Premium Platinum Membership www.BCGinstitute.org
  • 8. About Our Sponsor: Biddle Consulting Group (BCG) BCG is an HR firm dedicated to providing the highest products and services related to Equal Employment Opportunity (EEO), Affirmative Action and Employee Selection. • BCG’s Consulting Services ― Affirmative Action Plan Outsourcing ― Compensation Analysis ― EEO/AA Litigation Support (Plaintiff and Defendant) ― Job Analysis ― Test Development and Test Validation • BCG’s Software Products ― Adverse Impact Toolkit™ ― AutoAAP® affirmative action plan development software ― AutoGOJA® job analysis software ― C4 call center testing software ― COMPARE™ compensation analysis software ― CritiCall® dispatcher/call-taker personnel selection software ― ENCOUNTER soft skills video situational judgment testing software ― OPAC® office skills testing software ― TVAP™ Test Validation & Analysis Program software www.Biddle.com