Salience (neuroscience)

This article is about salience in cognitive neuroscience. For other uses, see Salience.

The salience (also called saliency) of an item – be it an object, a person, a pixel, etc. – is the state or quality by which it stands out relative to its neighbors. Saliency detection is considered to be a key attentional mechanism that facilitates learning and survival by enabling organisms to focus their limited perceptual and cognitive resources on the most pertinent subset of the available sensory data.

Saliency typically arises from contrasts between items and their neighborhood, such as a red dot surrounded by white dots, a flickering message indicator of an answering machine, or a loud noise in an otherwise quiet environment. Saliency detection is often studied in the context of the visual system, but similar mechanisms operate in other sensory systems. What is salient can be influenced by training: for example, for human subjects particular letters can become salient by training.

When attention deployment is driven by salient stimuli, it is considered to be bottom-up, memory-free, and reactive. Attention can also be guided by top-down, memory-dependent, or anticipatory mechanisms, such as when looking ahead of moving objects or sideways before crossing streets. Humans and other animals have difficulty paying attention to more than one item simultaneously, so they are faced with the challenge of continuously integrating and prioritizing different bottom-up and top-down influences.

Neuroanatomy of salience

The hippocampus participates in the assessment of salience and context using past memories to filter new incoming stimuli; placing those that are most important into long term memory. The entorhinal cortex is the pathway into and out of the hippocampus and is damaged early on in Alzheimer's disease.
The pulvinar nuclei (in the thalamus) modulate physical saliency in attentional selection.

Salience in psychology

The term is widely used in the study of perception and cognition to refer to any aspect of a stimulus that, for any of many reasons, stands out from the rest. Salience may be the result of emotional, motivational or cognitive factors and is not necessarily associated with physical factors such as intensity, clarity or size. Although salience is thought to determine attentional selection, salience associated with physical factors does not necessarily influence selection of a stimulus.

Aberrant salience hypothesis of schizophrenia

Kapur (2003) proposed that a hyperdopaminergic state, at a "brain" level of description, leads to an aberrant assignment of salience to the elements of one's experience, at a "mind" level. Dopamine mediates the conversion of the neural representation of an external stimulus from a neutral bit of information into an attractive or aversive entity, i.e. a salient event. Symptoms of schizophrenia may arise out of 'the aberrant assignment of salience to external objects and internal representations', and antipsychotic medications reduce positive symptoms, by attenuating aberrant motivational salience, via blockade of the dopamine D2 receptors (Kapur, 2003).

Visual saliency modeling

In the domain of psychology, efforts have been made in modeling the mechanism of human attention, including the learning of prioritizing the different bottom-up and top-down influences.

In the domain of computer vision, efforts have been made in modeling the mechanism of human attention, especially the bottom-up attentional mechanism. Such a process is also called visual saliency detection.

Generally speaking, there are two kinds of models to mimic the bottom-up saliency mechanism. One way is based on the spatial contrast analysis. For example, in a center-surround mechanism is used to define saliency across scales, which is inspired by the putative neural mechanism. The other way is based on the frequency domain analysis. This method was first proposed by Hou et al. While they used the amplitude spectrum to assign saliency to rarely occurring magnitudes, Guo et al. use the phase spectrum instead. Recently, Li et al. introduced a system that uses both the amplitude and the phase information.

A key limitation in many such approaches is their computational complexity which produces less than real-time performance, even on modern computer hardware. Some recent work attempts to overcome these issues but at the expense of saliency detection quality under some conditions. Other work suggests that saliency and associated speed-accuracy phenomena may be a fundamental mechanisms of recognition determined during recognition through gradient descent and does not have to be spatial in nature.

See also

• Dopamine hypothesis of schizophrenia
• Latent inhibition
• Schizophrenia
• Schizotypy

External links

• iLab at the University of Southern California
• Scholarpedia article on visual saliency by Prof. Laurent Itti