Calculation of Entropy and Mutual Information for Sinusoids

Abstract

In this work, an analytical expression is developed for the differential entropy of a sinusoid. The mutual information between two sinusoids with different amplitudes and phase is then derived using both continuous and discrete entropies.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 28, 2009
Accession Number
ADA494612

Entities

People

  • Frank Bucholtz
  • Jonathan M. Nichols
  • Joseph V. Michalowicz

Organizations

  • United States Naval Research Laboratory

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Abstracts
  • Background Noise
  • Converters
  • Data Compression
  • Data Science
  • Department Of Defense
  • Detection
  • Discrete Distribution
  • Information Theory
  • Military Research
  • New York
  • Probability
  • Probability Density Functions
  • Probability Distributions
  • Random Variables
  • Signal Detection
  • Sine Waves

Fields of Study

  • Engineering

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Calculus or Mathematical Analysis