Quantifying the Effectiveness of Crowd-Sourced Serious Games

Abstract

Crowd-sourced serious games (CSSGs) represent an emerging genre of games. Different from traditional games, the primary concern of the CSSGs is not player enjoyment, but contributing to difficult scientific problems or respectable social causes through incremental efforts embedded in parallel game plays by many non-specialists. CSSGs have a potential to support important tasks for humanity. Clearly, players contributions and the effectiveness of CSSGs is crucial for success. Further, players may have different motivations to play CSSGs than traditional games. Some players (called whales) produce more than other players possibly due to a stronger motivation. In addition, those contributions and their effectiveness must be measured and evaluated to improve CSSGs. In this thesis, we propose a methodology to quantify the effectiveness of CSSGs by analyzing mainly two VeriGames produced for DARPA s Crowd Sourced Formal Verification project. The analyses show that low engagement rates (ERs) can be an obstacle to CSSGs and their ultimate purpose. The results also show this game genre to have a strong whale effect, and thus a strategy focusing on recruiting and retaining whales may be effective to counterbalance the low ERs.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 2014
Accession Number
ADA620934

Entities

People

  • Umit Tellioglu

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Cyber
  • Energy and Power Technologies
  • Ground and Sea Platforms
  • Materials and Manufacturing Processes
  • Weapons Technologies

DTIC Thesaurus Topics

  • Computer Program Documentation
  • Computer Programming
  • Computer Programs
  • Computers
  • Data Mining
  • Information Science
  • Information Systems
  • Mobile Devices
  • Mobile Operating Systems
  • Motivation
  • Operating Systems
  • Personal Computers
  • Regression Analysis
  • Smartphones
  • Tablet Computers
  • Video Games
  • Web Browsers

Readers

  • Game Theory.
  • Marine Mammal Biology
  • Systems Analysis and Design