Density Estimation and Anomaly Detection in Large Social Networks

Abstract

High-velocity streams of high-dimensional data pose significant "big data" analysis challenges across a range of applications and settings, including large-scale social network analysis. Online learning and online convex programming play a significant role in the rapid recovery of important or anomalous information from these large data streams. While recent advances in online learning have led to novel and rapidly converging algorithms, these methods are unable to adapt to non-stationary environments arising in real-world settings. This paper describes a dynamic mirror descent framework which addresses this challenge, yielding low theoretical regrets bounds and accurate, adaptive, and computationally efficient algorithms which are applicable to broad classes of problems. The methods are capable of learning and adapting to the underlying and possibly time-varying dynamics of a system or environment. Empirical results in the context of social network tracking, dynamic texture analysis, sequential compressed sensing of a dynamic scene, and tracking self-exciting point processes support the core theoretical findings.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 15, 2014
Accession Number
ADA610336

Entities

People

  • Rebecca Willett

Organizations

  • Duke University

Tags

Communities of Interest

  • Energy and Power Technologies
  • Human Systems
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Algorithms
  • Anomaly Detection
  • Big Data
  • Change Detection
  • Compressed Sensing
  • Computational Complexity
  • Computational Science
  • Convex Sets
  • Data Analysis
  • Detection
  • Detectors
  • Distance Learning
  • Engineering
  • Information Theory
  • Pattern Recognition
  • Signal Processing
  • Social Networks

Fields of Study

  • Computer science

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Neural Network Machine Learning.