Analysis of the ILR "Can Do Statements" as a SOFTS Placement Tool

Abstract

As part of an ongoing Special Operations Forces Tele-training System (SOFTS) training evaluation project, the Special Operations Forces Language Office (SOFLO) requested that SWA Consulting Inc. investigate the effectiveness of the Interagency Language Roundtable (ILR) "Can Do Statements" as a placement tool for SOFTS courses. Researchers asked the following questions: (1) Are the "Can Do Statements" measuring perceived language speaking proficiency consistently and accurately for all students?, and (2) Are the "Can Do Statements" related to similar constructs such as students' confidence in their ability to perform language tasks? The SOFTS "Can Do Statements" measure perceived speaking proficiency, which is an individual's perception of his or her language ability as opposed to actual speaking proficiency, as measured by validated instruments such as the Oral Proficiency Interview (OPI). A sample of 1,710 student responses to the "Can Do Statements" was provided by Progressive Expert Consulting (PEC) Inc. An analysis of course feedback open-ended items also was conducted. Although this study provides some support for the use of the ILR "Can Do Statements" as a placement tool for SOFTS courses, some limitations may restrict the usefulness of the findings. Most notably, this study used data that had already been collected before the research questions were formulated. A follow-up study could involve measuring actual proficiency with an OPI at the beginning of language training for a sub-sample of SOFTS students.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 2012
Accession Number
ADA585068

Entities

People

  • Aaron M. Watson
  • Amanda Deane
  • Amanda Gissel
  • Eric A. Surface
  • Reanna P. Harman
  • Sarah Bienkowski

Tags

Communities of Interest

  • Biomedical

DTIC Thesaurus Topics

  • Data Analysis
  • Data Sets
  • Education
  • Foreign Languages
  • High Reliability
  • Information Science
  • Instructors
  • Job Analysis
  • Language
  • Linguistics
  • Psychology
  • Special Operations Forces
  • Statistical Analysis
  • Students
  • Surveys
  • Test And Evaluation
  • Training

Fields of Study

  • Education

Readers

  • Defense Financial Management and Audit.
  • Instructional Design and Training Evaluation.