Individual differences at play: An investigation into measuring Big Five personality facets with game‐based assessments

Abstract

Using game‐based assessments (GBAs) to assess and select job applicants presents the dual challenges of measuring intended job‐relevant constructs while analyzing GBA data that contain more predictors than observations. Exploring those challenges, we analyzed two GBAs that were designed to measure conscientiousness facets (i.e., achievement striving, self‐discipline, and cautiousness). Scores on traditional measures of personality and cognitive ability were modeled using either a restricted set of GBA predictors using cross‐validated ordinary least squares (OLS) regression or by the fuller set (p = 248) using random forests regression. Overall, the prediction of personality was near‐zero; but the latter approach explained 14%–30% of the variance in predicting cognitive ability. Our findings warn of GBAs potentially measuring unintended constructs rather than their intended constructs.

Document Details

Document Type
Pub Defense Publication
Publication Date
Dec 05, 2021
Source ID
10.1111/ijsa.12360

Entities

People

  • Andrea L. Sinclair
  • Evan Mulfinger
  • Felix Y. Wu
  • Frederick L. Oswald
  • Leo Alexander
  • Rodney A. McCloy

Organizations

  • Human Resources Research Organization
  • Rice University
  • U.S. Army Research Institute for the Behavioral and Social Sciences

Tags

Fields of Study

  • Psychology

Readers

  • Instructional Design and Training Evaluation.
  • Psychological Intervention/Treatment for Stress, Anxiety, PTSD, and Related Emotional and Cognitive Health Symptoms.
  • Theoretical Analysis.