Psychometrics Seminar

Session 1: June 1 – 5, 2020
Albuquerque, NM – Embassy Suites


FAQVenue Info – Hotel Booking
$1,895 Faculty/Professional or $1,145 Student/Post-Doc

Payment Options
Details Per Course Select Option
Professionalshow details + $1,895 (USD)  
Studentshow details + $1,145 (USD)  

Seminar fee includes all materials, downloads, software access, training, refreshments and access to a recorded video of seminar:

Enrollment is open to public, students, graduates and professionals. Save a seat today, pay later.

Statistics Seminar Objectives

This comprehensive 5-day statistics training institute on the fundamentals of Psychometrics will enable you to:

  • Apply a latent variable perspective to psychometrics
  • Examine how psychometrics fits into the scientific enterprise and educational policy
  • Identify construct validity as the “one ring to rule them all” and where other dimensions of validity fit in
  • Examine why Cronbach’s Alpha is biased (a recent article was titled “Thanks Coefficient Alpha, we’ll take it from here”)
  • Understand why other reliability estimates (e.g., mean inter-item correlations, Coefficient H, Omega total) are preferred, and how to calculate and interpret them
  • Code, analyze, and interpret exploratory factor analyses (EFA)
  • Code, analyze, and interpret confirmatory factor analyses (CFA)
  • Synthesize the preceding ideas to understand the instrument development & validation process
  • Understand the difference between “true score” bias and item bias
  • Code, analyze, and interpret Multiple Indicator and Multiple Causes (MIMIC) models
  • Code, analyze, and interpret measurement invariance analyses
  • Understand the differences between configural, metric & scalar invariance
  • Understand why Item Response Theory (IRT) is useful to assess ability & shorten scales
  • Code, analyze, and interpret 1PL, 2PL, 3PL IRT models
  • Use figures to communicate the psychometric properties of measures

Seminar Syllabus

Summer Stats Camp 2020: Psychometrics
Monday  June 1, 2020
9:00-9:30 Welcome and introduction.
9:30-10:30 A latent variable modeling perspective on psychometrics.
10:30-10:45 Snack and Refreshment Break.
10:45-12:30 Coefficient Alpha: Widely known, poorly understood
12:30-1:30 Lunch Break
1:30-3:00 Intro to MPlus code.

Bringing latent variables into focus: Exploratory Factor Analyses (EFA).

3:00-3:15 Snack and Refreshment Break
3:15-5:00 Construct validity: “One ring to rule them all”
5:30~7:30 Social “hour” for all Stats Campers
Tuesday  June 2, 2020
9:00-10:45 Testing hypothesized factor structures: Confirmatory Factor Analyses (CFA)
10:45-11:00 Snack and Refreshment Break
11:00-12:30 CFA: Hands-on practice & statistical power
12:30-1:30 Lunch Break
1:30-3:00 Bias & Fairness in Psychometrics: Multiple Indicators and Multiple Causes (MIMIC) models
3:00-3:15 Snack and Refreshment Break
3:15-4:00 Review, integration & catch-up time
4:00-5:00 Individual Consultations
Wednesday  June 3, 2020
9:00-10:30 Multi-group models & Measurement Invariance
10:30-10:45 Snack and Refreshment Break
10:45-12:30 Measurement Invariance (continued)
12:30-1:30 Lunch Break
1:30-3:00 Best practices: Instrument development & validation
3:00-3:15 Snack and Refreshment Break
3:15-4:00 Review, integration & catch-up time
4:00-5:00 Individual Consultations
Thursday  June 4, 2020
9:00-10:45 Introduction to Item Response Theory (IRT)
10:45-11:00 Snack and Refreshment Break
11:00-12:30 IRT: Discrimination (1PL), Difficulty (2PL) & Guessing (3PL) models
12:30-1:30 Lunch Break
1:30-3:00 IRT: The Graded Response Model
3:00-3:15 Snack and Refreshment Break
3:15-4:00 Review, integration & catch-up time
4:00-5:00 Individual Consultations
Friday  June 5, 2020
9:00-10:30 Missing data: Focus on the auxiliary variables strategy
10:30-10:45 Snack and Refreshment Break
10:45-12:00 Individual consultation
12:00 End of Workshop
12:30-1:30 Lunch Break

Overview

Psychometrics is the science of how we measure things, such as the psychological attributes of people. These psychological attributes include abilities, aptitudes, achievement, attitudes, interests, personality traits, cognitive functioning, and mental health. Psychometrics, theoretically-informed and precise measurement, is an essential component of many of the things we hold dear. Scientific advances (e.g., can I make a claim that I am measuring what I purport to measure?), educational placement decisions (e.g., should a child be placed into a gifted program?), statistical power (e.g., is my measure precise enough to suggest that X predicts Y?), and other key considerations are all affected by psychometrics. This seminar emphasizes the conceptual understanding of and the application of psychometric principles.

Topics:

  • Measurement and statistical concepts specific to psychometrics
  • The latent variable modeling perspective
  • Reliability – classical and modern approaches
  • Validity – conceptual and statistical aspects
  • Factor analysis – exploratory and confirmatory
  • Instrument development & validation process
  • Measurement bias & strategies to address bias (e.g., MIMIC models)
  • Multi-group analyses & measurement invariance testing
  • Missing data
  • Item Response Theory: 1PL (Rasch) & 2PL & 3PL models
  • How to use MPlus for psychometric analyses

An introductory 5-day seminar taught by Matthew Diemer, Ph.D. in the foundations of psychometrics. Participants should have the equivalent of a two-semester graduate-level social science statistics course sequence.

Participants will receive an electronic copy of all course materials, including lecture slides, practice datasets, software scripts, relevant supporting documentation, and recommended readings. Participants are strongly encouraged to bring their own data for “hands on” practice. Participants will also have access to a video recording of the course.

Instructor: Matthew A. Diemer Ph.D.

Matthew Diemer is a Professor in the Combined Program in Education & Psychology (CPEP) and Educational Studies programs at the University of Michigan. Diemer harnesses advanced quantitative methods to examine how young people develop critical consciousness – the capacity to reflect on, negotiate, and challenge racial, ethnic, socioeconomic and other constraints in school, college, work, and civic/political institutions. His research is currently funded by the Spencer Foundation, William T Grant Foundation, Institute for Education Sciences, National Institute of Health, National Science Foundation, and the Corporation for National and Community Service.

Diemer teaches Psychometrics and Structural Equation Modeling courses and provides statistical consultation to the campus community at the University of Michigan. He has delivered invited lectures and workshops on these and other quantitative topics domestically and internationally. He also serves as the Statistical Consultant for the Psychology of Women Quarterly.

Diemer was nominated for the “Golden Apple” teaching award and in 2019, received the Provost’s Teaching Innovation Prize for Advancing Diversity, Equity & Inclusion via Advanced Quantitative Methods, both at the University of Michigan.

Software and Computer Support

Participants need to bring a laptop computer with Wi-Fi capabilities. Students should have access to IBM SPSS, version 21.0 or higher and Mplus, version 7.1 or higher.

All statistical software used at Stats Camp with the exception of SPSS will be available, free to participants, on our SMORS (statistical modeling on remote servers) system for the duration of camp.

Seminar Prerequisites

Required:

  • Intermediate proficiency in basic statistical theory as would be gained in a 1st year graduate course.

Not required but advantageous:

  • Limited experience (e.g., graduate-level course) with classical measurement theory and concepts.

No level of proficiency beyond basic awareness is assumed for skills related to:

  • Advanced mathematical or statistical topics such as matrix algebra.

Seminar Files

Below are links to seminar files for those who enrolled in the seminar. Please download these files onto your computer on the first day of the seminar. The files are password protected to respect the intellectual property rights of the instructors. By using your login information, you agree not to share your login information or the content protected by it.

Seminar files and downloads will be posted on the first day of class.

Why Should You Attend?

  • Get 1 on 1 Consultation with Instructor
  • Professional Networking
  • Peer Socializing
  • Collaboration
  • All Seminar Resources
  • Breakfast (guests), Lunches, & Snacks Daily