A simple neural network generating an interactive memory

Author: Anderson, J.A.

Description: A model of a neural system where a group of neurons projects to another group of neurons is discussed. We assume that a trace is the simultaneous pattern of individual activities shown by a group of neurons. We assume synaptic interactions add linearly and that synaptic weights (quantitative measure of degree of coupling between two cells) can be coded in a simple but optimal way where changes in synaptic weight are proportional to the product of pre-and postsynaptic activity at a given time. Then it is shown that this simple system is capable of “memory” in the sense that it can (1) recognize a previously presented trace and (2) if two traces have been associated in the past (that is, if trace 1 was impressed on the first group of neurons and trace 2 was impressed on the second group of neurons and synaptic weights coupling the two groups changed according to the above rule) presentation of 1 to the first group of neurons gives rise to 2; plus a calculable amount of noise at the second set of neurons. This kind of memory is called an “interactive memory” since distinct stored traces interact in storage. It is shown that this model can effectively perform many functions. Quantitative expressions are derived for the average signal to noise ratio for recognition and one type of association. The selectivity of the system is discussed. References to physiological data are made where appropriate. A sketch of a model of mammalian cerebral cortex which generates an interactive memory is presented and briefly discussed. We identify a trace with the activity of groups of cortical pyramidal cells. Then it is argued that certain plausible assumptions about the properties of the synapses coupling groups of pyramidal cells lead to the generation of an interactive memory.

Subject headings: Neural network; Neurons; Synapses; Pyramidal cells; Interactive memory

Publication year: 1972

Journal or book title: Mathematical Biosciences

Volume: 14

Issue: 3-4

Pages: 197-220

Find the full text : https://www.sciencedirect.com/science/article/pii/0025556472900752

Find more like this one (cited by): https://scholar.google.com/scholar?cites=16016050827885146868&as_sdt=1000005&sciodt=0,16&hl=en

Type: Journal Article

Serial number: 602