Information-Based Approach to Unsupervised Machine Learning

Abstract

Unsupervised machine learning methods such as clustering and change detection are indispensable to various real-world data processing tasks. However, due to its vague formulation, studies of unsupervised learning tend to be ad-hoc, and thus development of unsupervised learning methods is still far behind supervised learning. The project aims at overcoming this difficulty by providing a systematic approach to unsupervised learning based on information measures. The PI and his group developed various information-based machine learning algorithms, including clustering, independence testing, object matching class-imbalance adaptation, change detection, and canonical dependency analysis. Furthermore, they explored fundamental data processing paradigms for further improving accuracy and robustness of information estimators in high dimensional problems. Through this project, they advanced the field of unsupervised learning by providing a novel systematic approach based on information measures.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 19, 2013
Accession Number
ADA586622

Entities

People

  • Masashi Sugiyama

Organizations

  • Tokyo Institute of Technology

Tags

Communities of Interest

  • Autonomy
  • C4I
  • Ground and Sea Platforms

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Change Detection
  • Cognitive Science
  • Computational Science
  • Computer Languages
  • Data Mining
  • Data Science
  • Dimensionality Reduction
  • Information Processing
  • Information Science
  • Information Systems
  • Kernel Functions
  • Machine Learning
  • Network Science
  • Statistical Algorithms
  • Supervised Machine Learning
  • Unsupervised Machine Learning

Fields of Study

  • Computer science

Readers

  • Artificial Intelligence
  • Computer Vision.
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - Neural Networks