Image associative memory by recurrent neural sub-networks

Władysław Skarbek, Andrzej Cichocki

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Gray scale images are represented by recurrent neural subnetworks which together with a competition layer create an associative memory. The single recurrent subnetwork Ni implements a stochastic nonlinear fractal operator ℱi, constructed for the given image fi. We show that under realistic assumptions ℱ has a unique attractor which is located in the vicinity of the original image. Therefore one subnetwork represents one original image. The associative recall is implemented in two stages. Firstly, the competition layer finds the most invariant subnetwork for the given input noisy image g. Next, the selected recurrent subnetwork in few (5-10) global iterations produces high quality approximation of the original image. The degree of invariance for the subnetwork Ni on the input g is measured by a norm ∥g - ℱi(g)∥. We have experimentally verified that associative recall for images of natural scenes with pixel values in [0,255] is successful even when Gaussian noise has the standard deviation σ as large as 500. Moreover, the norm, computed only on 10% of pixels chosen randomly from images still successfuly recalls a close approximation of original image . Comparing to Amari-Hopfield associative memory, our solution has no spurious states, is less sensitive to noise, and its network complexity is significantly lower. However, for each new stored image a new subnetwork must be added.

Original languageEnglish
Pages (from-to)1638-1644
Number of pages7
JournalIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
VolumeE79-A
Issue number10
Publication statusPublished - 1996
Externally publishedYes

Keywords

  • Associative memory
  • Fractals
  • Image compression
  • Recurrent neural networks

Fingerprint

Dive into the research topics of 'Image associative memory by recurrent neural sub-networks'. Together they form a unique fingerprint.

Cite this