Scripps VIVO scripps research logo

  • Index
  • Log in
  • Home
  • People
  • Organizations
  • Research
  • Events
Search form
As of April 1st VIVO Scientific Profiles will no longer updated for faculty, and the link to VIVO will be removed from the library website. Faculty profile pages will continue to be updated via Interfolio. VIVO will continue being used behind the scenes to update graduate student profiles. Please contact helplib@scripps.edu if you have questions.
How to download citations from VIVO | Alternative profile options

Value-dependent selection in the brain - simulation in a synthetic neural model

Academic Article
uri icon
  • Overview
  • Identity
  • Additional Document Info
  • View All
scroll to property group menus

Overview

authors

  • Friston, K. J.
  • Tononi, G.
  • Reeke, G. N.
  • Sporns, O.
  • Edelman, Gerald

publication date

  • March 1994

journal

  • Neuroscience  Journal

abstract

  • Many forms of learning depend on the ability of an organism to sense and react to the adaptive value of its behavior. Such value, if reflected in the activity of specific neural structures (neural value systems), can selectively increase the probability of adaptive behaviors by modulating synaptic changes in the circuits relevant to those behaviors. Neuromodulatory systems in the brain are well suited to carry out this process since they respond to evolutionarily important cues (innate value), broadcast their responses to widely distributed areas of the brain through diffuse projections, and release substances that can modulate changes in synaptic strength. The main aim of this paper is to show that, if value-dependent modulation is extended to the inputs of neural value systems themselves, initially neutral cues can acquire value. This process has important implications for the acquisition of behavioral sequences. We have used a synthetic neural model to illustrate value-dependent acquisition of a simple foveation response to a visual stimulus. We then examine the improvement that ensues when the connections to the value system are themselves plastic and thus become able to mediate acquired value. Using a second-order conditioning paradigm, we demonstrate that auditory discrimination can occur in the model in the absence of direct positive reinforcement and even in the presence of slight negative reinforcement. The discriminative responses are accompanied by value-dependent plasticity of receptive fields, as reflected in the selective augmentation of unit responses to valuable sensory cues. We then consider the time-course during learning of the responses of the value system and the transfer of these responses from one sensory modality to another. Finally, we discuss the relation of value-dependent learning to models of reinforcement learning. The results obtained from these simulations can be directly related to various reported experimental findings and provide additional support for the application of selectional principles to the analysis of brain and behavior.

subject areas

  • Animals
  • Brain
  • Learning
  • Mathematics
  • Models, Neurological
  • Motor Neurons
  • Neurons
  • Neurons, Afferent
  • Vision, Ocular
  • Visual Perception
scroll to property group menus

Identity

International Standard Serial Number (ISSN)

  • 0306-4522

Digital Object Identifier (DOI)

  • 10.1016/0306-4522(94)90592-4

PubMed ID

  • 8008189
scroll to property group menus

Additional Document Info

start page

  • 229

end page

  • 243

volume

  • 59

issue

  • 2

©2022 The Scripps Research Institute | Terms of Use | Powered by VIVO

  • About
  • Contact Us
  • Support