Learning Hidden Structure from Data: A Method for Marginalizing Joint Distributions Using Minimum Cross-Correlation Error.

Abstract

This thesis demonstrates an entropy-based, Bayesian dependency algorithm-Minimum Error Tree Decomposition II (METD2)-that performs computer-based generation of probabilistic hidden-structure domain models from a database of cases. The system learns probabilistic hidden-structure domain models from data, which partially automates the task of expert system construction and the task of scientific discovery. Existing probabilistic systems find associations among the observable variables but do not consider the presence of hidden variables, or else, do not use cross-correlation error as the metric for building the hidden structure. The algorithm decomposes a joint distribution of n observable variables into n+l observable and hidden variables. The hidden variable exists in the form of a tree consisting of n-l interior nodes. The final product of the procedure is a combined tree whose n leaves are the observable variables in a sample and whose n-l interior nodes are the marginalizations for the leaves.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Apr 18, 1997
Accession Number
ADA323964

Entities

People

  • Antony K. Haynes

Organizations

  • Air Force Institute of Technology

Tags

Communities of Interest

  • Autonomy
  • Materials and Manufacturing Processes
  • Sensors

DTIC Thesaurus Topics

  • Air Force
  • Artificial Intelligence
  • Bayesian Networks
  • Computational Science
  • Cross Correlation
  • Data Mining
  • Databases
  • Information Science
  • Machine Learning
  • Network Science
  • Neural Networks
  • Operating Systems
  • Probabilistic Models
  • Probability Distributions
  • Reasoning
  • Topology
  • Trees (Data Structures)

Fields of Study

  • Computer science

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Computer Programming and Software Development.
  • Graph Algorithms and Convex Optimization.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference