Skip to content
Cognitive neuroscienceThe Neural Mind
Contents and reading path

Chapter 2

Sensation, Perception and Action

  1. 2.1How does the world become an experience?
  2. 2.2From stimulation to nerve signals
  3. 2.3Vision and visual perception
  4. 2.4Hearing and the direction of sound
  5. 2.5When the senses work together
  6. 2.6The cup in a noisy café
  7. 2.7How does a movement take shape?
  8. 2.8Prediction, feedback and learning
  9. LabThe visual lab

Perception and motor learning – in preparation

Reading path
Coming chapters (planned content)
  1. 1. Introduction to Cognitive Neuroscience
  2. 3. Attention
  3. 4. Memory and Learning
  4. 5. Language
  5. 6. Thinking and Executive Functions
  6. 7. Decision-Making
  7. 8. Emotion and Motivation
  8. 9. Social Cognition
  9. 10. Metacognition and Consciousness

Chapter 2 · Section 2

From stimulation to nerve signals

Light and sound are not nerve signals. Somewhere, physical influence must be converted into changes in the cells' electrical state.

You lift the cup from the table. Light reflects from the porcelain, a faint scrape is heard, and the handle presses against your fingers. These are different kinds of physical influence. Yet the nervous system needs to use them together: which cup is it, where is the handle, and how firmly should you hold it?

Sensory receptors connect these events to electrical activity in the nervous system. Light can alter a light-sensitive pigment, a vibration can bend a hair cell's projections, and pressure can deform a sensitive nerve ending. When this influence changes the cell's electrical state, transduction occurs. The change is the beginning of sensory processing; it is not yet the experience of a cup.

A change across the cell membrane

Cells maintain differences in ion concentration and electrical voltage between their inside and outside. When ion channels open or close, ion flow across the membrane changes, and so does the membrane potential. A receptor potential is graded: its size and time course can vary with stimulation.

Distinguish this local change from an action potential. Action potentials are brief impulses that propagate along nerve fibres. In a given fibre, variations in stimulation are encoded mainly through when impulses occur and how often they occur, together with which neurons are active. A stronger influence therefore does not mean that every impulse has a larger amplitude.

Terms: receptor potential · action potential.

Two routes to an electrical change

When light is absorbed in a rod or cone, it starts a chemical cascade that closes certain ion channels. The photoreceptor hyperpolarises: its inside becomes more negative, and glutamate release decreases. In darkness these channels are more open and glutamate release is greater. Rod and cone signals are graded; they do not send action potentials along the optic nerve.

Retinal networks then process the change. ON and OFF pathways respond differently to increases and decreases in light. Ganglion cells carry the retina's output as action potentials. More light therefore does not make every cell more active. Some signals increase, others decrease, and the pattern of differences makes the information useful.

In the cochlea, the mechanical movements caused by sound instead bend the hair cells' stereocilia. When an inner hair cell's bundle bends in the excitatory direction, more mechanically sensitive channels open. The cell depolarises and releases more glutamate onto auditory nerve fibres, where action potentials arise. Bending in the opposite direction has the opposite effect. The same underlying principle is at work as in vision, with a different receptor and a different conversion mechanism.

Rod: outer segment, cell body and synaptic terminalNumbers correspond to the descriptions below. Mechanism drawing, not an anatomical section. Light closes certain channels. The photoreceptor hyperpolarises and releases less glutamate.123
  1. Outer segment with light-sensitive pigment
  2. Cell body and nucleus
  3. Synaptic terminal: glutamate

Light closes certain channels. The photoreceptor hyperpolarises and releases less glutamate.

Graded receptor potential · qualitative sketch

Up: less negative. Down: more negative. No measurement scale or recorded trace.

Retinal network · ON / OFFIncreases and decreases are processed differently; rod circuits include additional intermediates.

Ganglion-cell action potentials

Equal-amplitude pulses are illustrations, not measurements. No universal change in visual spike frequency with light is specified.

Figure 2.3. From stimulation to signals in two senses. Mechanism drawings of a rod and an inner hair cell, not anatomical sections. Channels, graded traces and pulse trains are qualitative illustrations without a measurement scale. Ganglion-cell pulses follow the retinal ON/OFF network; the hair cell releases onto the auditory nerve, which generates the pulses.Original schematic illustration.

Explore the seven retinal cell types → · Start with the eye →

The visual lab includes a return link to the vision section.

Several kinds of processing at once

As you look at the cup, your visual system works simultaneously with contrast, colour, shape, motion and position. Hearing simultaneously processes a sound's frequency content, timing and cues to its location. Parallel processing means that different parts of a problem are handled at the same time in interacting neural circuits. Some computations depend on others, but the whole system does not wait for a single stage to finish.

This is a recurring organising principle across human sensory systems: multiple processes cooperate, and information influences activity in several directions. The detailed architecture differs between senses. Smell's early route to cortex, for example, does not pass through an initial thalamic relay in the same way as the main visual pathway.

Parallel processing · Sources on sensory-system organisation

What you are trying to do changes processing

Imagine first looking for the red cup, then judging whether a cup is about to tip over. The scene can stay the same while the task makes different features relevant. Attention to colour or motion can change activity in visual areas that process those features. Intention can thus influence how information is prioritised along parallel streams, while sensory evidence constrains what we can perceive.

Descending influence from higher to earlier processing levels is often called top-down. It can help adjust sensitivity and selection to the task. Feedback operates alongside ascending processing; it need not wait for a finished picture of the world. Nor is every feedback signal a conscious decision or a prediction.

Same physical scene · different relevance

Task and attentionColour and form become especially relevant
Colour / formEmphasised for the task
↔
Motion / positionStill involved
Earlier interacting visual processes · contrast and other features

Solid upward arrows: sensory input. Dashed downward arrows: task-related influence. Double arrow: interaction. All branches remain; no single route is selected.

Same scene, different tasks. Original schematic of relevance and interaction, not measured connections or activation. The task does not change stimulation or imply control of photoreceptors. Chawla et al. studied attention to colour and motion using human fMRI. Chawla et al. (1999) ↗

Feedback reaches different levels

In vision, extensive feedback runs from visual cortex to the lateral geniculate nucleus, the LGN, in the thalamus. Even there, the onward transmission of retinal signals can be influenced. Studies in cats show that cortical feedback synaptic contacts can outnumber retinal contacts onto LGN relay cells. This compares synapses, not the number of impulses or the amount of information. Retinal contacts are fewer but provide a strong driving input; many other contacts alter how signals are processed. Not all nonretinal contacts are cortical feedback: brainstem inputs and inhibitory circuits contribute too.

The LGN is therefore an important level in the cortical feedback loop followed here. Saying that all influence from the brain stops there would be too categorical: a small number of fibres from the brain to the retina have also been demonstrated in macaques, among other animals. These findings do not show that conscious intention directly controls human photoreceptors.

In hearing, descending pathways pass through the brainstem and reach the cochlea itself. Medial olivocochlear fibres contact outer hair cells and can alter the cochlea's mechanical amplification. Lateral olivocochlear fibres influence auditory nerve endings near inner hair cells. These connections make it possible to influence processing within the sensory organ; there is no direct nerve fibre from auditory cortex to a hair cell.

This anatomy and experiments in animals show that cortex can influence peripheral auditory responses. How much voluntary attention changes cochlear responses in humans is a more specific research question. When we listen for one voice among several, selection therefore takes place at several brain levels as well as potentially involving the ear.

↑ Solid: ascending⇣ Dashed: descending

Ascending and descending processing interact. Arrows indicate direction, not signal volume or synapse counts.

Feedback to different structures. Selected directed network relationships; not anatomical geometry or a comparison of synapse counts. The principal visual drawing has no cortex–retina line. Auditory MOC/LOC reach different targets through the brainstem. Animal findings do not establish the magnitude of voluntary attention effects in the human cochlea.

Perceiving something involves registering changes, processing several kinds of information at once, and continuously adapting processing to what we are doing. Receptors anchor the process in the physical world. Interacting networks make that information useful for recognition, orientation and action.

Sources for this section
  • Scientific referencePurves, D. et al. (2001). Neuroscience (2nd ed.). Phototransduction.Light leads to hyperpolarisation of photoreceptors. Open the source ↗ (new tab)
  • Scientific referencePurves, D. et al. (2001). Neuroscience (2nd ed.). The Retina.The retina's layers, cell types and the direction of light in the visual lab. Open the source ↗ (new tab)
  • Scientific referenceSchiller, P. H. (1986). The functions of the ON and OFF channels of the visual system. Open the source ↗ (new tab)
  • Scientific referencePurves, D. et al. (2001). Neuroscience (2nd ed.). The Auditory System – Summary.Tonotopy in the cochlea and auditory pathways. Open the source ↗ (new tab)
  • Scientific referenceCourtiol, E. & Wilson, D. A. (2015). The olfactory thalamus: unanswered questions about the role of the mediodorsal thalamic nucleus in olfaction. Frontiers in Neural Circuits.The early olfactory bulb–cortex pathway lacks an initial thalamic relay; the thalamus participates in later olfactory processing. Open the source ↗ (new tab)
  • Scientific referenceFelleman, D. J. & Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex, 1(1), 1–47. DOI: 10.1093/cercor/1.1.1-a.Synthesis of macaque cortical connectivity; a compilation of monkey data, not a human atlas. Open the source ↗ (new tab)
  • Scientific referenceHupé, J. M. et al. (1998). Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature, 394, 784–787. DOI: 10.1038/29537.Macaque: inactivating area V5 changed figure–background responses in V1–V3, an example of feedback's contribution. Open the source ↗ (new tab)
  • Scientific referenceRuff, C. C. et al. (2008). Distinct causal influences of parietal versus frontal areas on human visual cortex: evidence from concurrent TMS–fMRI. Cerebral Cortex, 18(4), 817–827.Human TMS–fMRI, network influence: stimulating the IPS changes activity in V5/MT+ and V1–V4. Supports an influence through networks, not a monosynaptic tract. Open the source ↗ (new tab)
  • Scientific referenceBriggs, F. & Usrey, W. M. (2007). A fast, reciprocal pathway between the lateral geniculate nucleus and visual cortex in the macaque monkey. Journal of Neuroscience, 27(20), 5431–5436.Macaque: a fast, reciprocal connection between LGN and cortex – the basis of corticogeniculate feedback. Open the source ↗ (new tab)
  • Scientific referenceChawla, D., Rees, G., & Friston, K. J. (1999). The physiological basis of attentional modulation in extrastriate visual areas. Nature Neuroscience, 2, 671–676.Human fMRI: attention to colour and motion. The task figure contains no measured activity values. Open the source ↗ (new tab)
  • Scientific referenceMcAlonan, K., Cavanaugh, J., & Wurtz, R. H. (2008). Guarding the gateway to cortex with attention in visual thalamus. Nature, 456, 391–394.Attending macaques: modulation of magno- and parvocellular LGN responses, not control of human photoreceptors. Open the source ↗ (new tab)
  • Scientific referenceErişir, A., Van Horn, S. C., & Sherman, S. M. (1997). Relative numbers of cortical and brainstem inputs to the lateral geniculate nucleus. PNAS, 94, 1517–1520.Cat anatomy: distinguishes cortical and brainstem inputs. Synaptic contacts are not signal traffic. Open the source ↗ (new tab)
  • Scientific referenceVan Horn, S. C., Erişir, A., & Sherman, S. M. (2000). Relative distribution of synapses in the A-laminae of the lateral geniculate nucleus of the cat. Journal of Comparative Neurology, 416, 509–520.Synapses in cat LGN. The RS category also includes brainstem inputs and must not be equated with cortex; read alongside Erişir et al. Open the source ↗ (new tab)
  • Scientific referenceGastinger, M. J., O'Brien, J. J., Larsen, N. B., & Marshak, D. W. (1999). Histamine immunoreactive axons in the macaque retina. Investigative Ophthalmology & Visual Science, 40, 487–495.Sparse brain-origin retinal fibres in macaques; does not demonstrate conscious cortical control of human photoreceptors. Open the source ↗ (new tab)
  • Scientific referenceDragicevic, C. D., et al. (2015). The olivocochlear reflex strength and cochlear sensitivity are independently modulated by auditory cortex microstimulation. Journal of the Association for Research in Otolaryngology, 16, 223–240.Cortical microstimulation in chinchillas: peripheral auditory influence through descending systems. MOC contacts outer hair cells; LOC auditory afferents. Not a measure of voluntary human attention. Open the source ↗ (new tab)
  • Scientific referenceGuinan, J. J., Jr. (2010). Cochlear Efferent Innervation and Function. Current Opinion in Otolaryngology & Head and Neck Surgery.Review of olivocochlear systems: MOC to outer hair cells, LOC to auditory nerve fibres near inner hair cells. Open the source ↗ (new tab)
  • Figure provenance and model limitations are described on the sources page. About sources and figures