Principles of Robust Learning Derived from the Structure and Function of the Cortical Column

Abstract

The goal of this project is to uncover the effects of learning and long-term memory storage on synaptic connectivity, thus,creating the basis for quantitative analyses of these fundamental brain functions. To that end, we developed a model of a biologically-inspired recurrent neural network, capable of storing and reliably retrieving temporal sequences of network states. The model incorporates many basic elements of local connectivity in the mammalian neocortex, including excitatory and inhibitory neuron classes, neuron morphologies, the homeostatic constraint on connection weights, and several types of errors and noise in signal transmission. The model was solved analytically and numerically with the replica and convex optimization methods. In addition, a perceptron-type learning rule was developed to load associative memory sequences into the network in a biologically-plausible online manner. Our results revealed that when individual neurons are robustly loaded with a near-maximum amount of memories they can support, the network develops many structural and dynamical properties that are consistent with experimental observations.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 17, 2020
Accession Number
AD1105877

Entities

People

  • Armen Stepanyants

Organizations

  • Northeastern University

Tags

Communities of Interest

  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Air Force Research Laboratories
  • Algorithms
  • Artificial Intelligence
  • Brain
  • Computational Neuroscience
  • Content Addressable Memory
  • Department Of Defense
  • Machine Learning
  • Neural Networks
  • Neurosciences
  • Optimization
  • Probability
  • Recurrent Neural Networks
  • Scientific Research
  • Sequences
  • Simulations
  • Standards

Fields of Study

  • Biology

Readers

  • Neural Network Machine Learning.
  • Neuroscience
  • Structural Dynamics.

Technology Areas

  • AI & ML
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks