A Supervised Approach to Windowing Detection on Dynamic Networks

Abstract

For any stream of time-stamped edges that form a dynamic network, a necessary and important choice is the aggregation granularity that an analyst uses to bin the data at. While this choice is often picked by hand, or left up to the technology that is collecting the data, the choice can make a big difference in the properties of the network. We call this the windowing detection problem. In previous work, this problem is often solved with a heuristic as an unsupervised task. As an unsupervised problem, it is difficult to measure how well a windowing algorithm performs. In addition, we show that the best windowing is dependent on which task an analyst want to perform on the network after windowing, and that therefore the task should be taken into account. We introduce a framework that tackles both of these issues: By measuring the performance of the windowing algorithm based on how well a given task is accomplished on the resulting network, we are for the first time able to directly compare different windowing algorithms to each other. Using this framework, we introduce windowing algorithms that take a supervised approach: they leverage ground truth on training data to nd a good windowing of the test data. We compare the supervised approach to previous approaches and several baselines on real data.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 2017
Accession Number
AD1028476

Entities

People

  • Benjamin Fish
  • Rajmonda S. Caceres

Organizations

  • MIT Lincoln Laboratory

Tags

DTIC Thesaurus Topics

  • Algorithms
  • Artificial Intelligence
  • Artificial Intelligence Software
  • Big Data
  • Change Detection
  • Data Mining
  • Data Science
  • Data Sets
  • Detection
  • Electronic Mail
  • Generative Models
  • Machine Learning
  • Mobile Phones
  • Models
  • Probabilistic Models
  • Supervised Machine Learning
  • Test Sets

Fields of Study

  • Computer science

Readers

  • Computational Modeling and Simulation
  • Neural Network Machine Learning.
  • Neurological Diseases/Conditions/Disorders