The Model Analyst's Toolkit: Scientific Model Development, Analysis, and Validation

Abstract

The proposed research effort builds on and extends the work of the previous ONR-funded "Validation Coverage Toolkit for HSCB Models" project. The overall objectives of the ongoing research program are: * Help scientists create, analyze, refine, and validate rich scientific models * Help computational scientists verify the correctness of their implementations of those models * Help users of scientific models, including decision makers within the US Navy, to use those models correctly and with confidence * Use a combination of human-driven data visualization and analysis, automated data analysis, and machine learning to leverage human expertise in model building with automated analyses of complex models against large datasets Specific objectives for the current effort include: * Fluid temporal correlation analysis. Our objective is to design a new method for performing temporally fluid correlation analysis for temporal sets of data and implement the method as a new prototype component within the Model Analyst's Toolkit (MAT) software application. * Automated suggestions for model construction and refinement. Our objective is to design and implement a prototype mechanism that learns from data how factors interact in non-trivial ways in scientific models. * Data validation and repair. Our objective is to design and implement a prototype capability to identify likely errors in data based on anomalies relative to historic data and to use models of historic data to offer suggested repairs. * System prototyping. Our objective is to incorporate all improvements into the MAT software application and make the resulting application available to the government and academic research community for use in scientific modeling projects. * Evaluation of applicability to multiple scientific domains. Our objective is to ensure (and demonstrate) that MAT can be applied to a wide range of scientific domains by identifying and building at least one neurological and/or physiological model.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 20, 2014
Accession Number
ADA604461

Entities

People

  • Scott N. Reilly

Tags

Communities of Interest

  • Autonomy
  • Biomedical
  • Cyber
  • Engineered Resilient Systems

DTIC Thesaurus Topics

  • Algorithms
  • Application Software
  • Change Detection
  • Computer Science
  • Correlation Analysis
  • Data Analysis
  • Data Mining
  • Data Sets
  • Data Visualization
  • Feature Extraction
  • Governments
  • Information Operations
  • Information Science
  • Machine Learning
  • Military Research
  • Models
  • Validation

Fields of Study

  • Computer science

Readers

  • Ocean-Atmosphere Mesoscale Modeling, Data Assimilation, and Flux Boundary Layers
  • Software Engineering.
  • Systems Analysis and Design

Technology Areas

  • AI & ML