- Atlas
- Natural Sciences
- Computational Neuroscience
Computational Neuroscience
Computational neuroscience is the branch of neuroscience that treats the brain as an information-processing system and tries to explain how it works using mathematics, models, and simulation.
10 frameworks, from 1943 to today · Neuroscience · Natural Sciences
- Artificial neural network modeling 1943-Present
- Hebbian theory 1949-Present
- Biophysical compartmental modeling 1952-Present
- Feature-detector and hierarchical feedforward models 1962-Present
- Neural coding 1970-Present
- Marr's levels of analysis 1977-Present
- Attractor network 1982-Present
- Error-driven learning and backpropagation 1986-Present
- Bayesian brain and predictive processing 1990-Present
- Deep learning as a model of brain computation 2014-Present
Overview
Computational neuroscience is the branch of neuroscience that treats the brain as an information-processing system and tries to explain how it works using mathematics, models, and simulation1. Its practitioners ask questions like: How does a neuron turn a stream of tiny electrical inputs into an output spike? How does a network of neurons store a memory or represent a face? What computation is the visual cortex actually performing? What is at stake is whether the brain's most remarkable abilities—perception, memory, learning, action—can be understood as the operation of a physical system, and whether building models of that system can tell us something that experiments alone cannot.
The field is unusual in that it has always been a meeting point. Physiologists, physicists, engineers, mathematicians, and computer scientists have all contributed, and the history is one of ideas migrating between the brain and the machine in both directions.
The neuron as a circuit element: from the 1940s
The founding move was to treat the neuron as a computational unit. In 1943, Warren McCulloch and Walter Pitts published a paper showing that idealized neurons—binary units that fire when their summed inputs cross a threshold—could, in principle, compute any logical function. This was a mathematical abstraction, not a claim about real anatomy, but it established the idea that nervous tissue could be described as a logic circuit.
The next step came from physiology. In the early 1950s, Alan Hodgkin and Andrew Huxley worked out the ionic mechanism of the action potential in the squid giant axon, measuring how sodium and potassium currents change with voltage and membrane permeability. Their model, published in 1952, is a set of differential equations describing how the membrane potential evolves2. It remains the benchmark for biophysical realism: it predicts the shape and timing of spikes from the underlying ion channels. The Hodgkin–Huxley equations showed that a neuron's electrical behavior could be derived from measurable physical properties, and they set the standard for what a "mechanistic" model should look like.
At the same time, the question of what neurons represent was being posed. In the late 1950s and early 1960s, David Hubel and Torsten Wiesel recorded from the visual cortex of cats and found cells that responded to edges at particular orientations, and others that responded to movement in a preferred direction. These were the first "feature detectors"—neurons whose firing seemed to encode a specific property of the stimulus. The finding raised a computational question: how could such selectivity arise from the wiring of the visual pathway? In 1962, Hubel and Wiesel proposed a model in which simple cells combine inputs from center-surround retinal ganglion cells, and complex cells combine inputs from simple cells. This was one of the first attempts to explain a cortical response property as the result of a feedforward network.
Learning rules and the first networks
If neurons are computing units, how do they get wired up? In 1949, Donald Hebb proposed that when one neuron repeatedly helps fire another, the connection between them strengthens34. This "Hebbian" rule—cells that fire together wire together—gave a plausible mechanism for learning and memory, and it became a cornerstone of the field34. It was a local rule: it used only information available at the synapse.
In 1958, Frank Rosenblatt built the perceptron, a trainable pattern-recognition machine inspired by the neuron. The perceptron learned by adjusting its weights according to errors, and it could classify simple patterns. The idea that a network could learn from examples was powerful, and it attracted both excitement and criticism. In 1969, Marvin Minsky and Seymour Papert published a book showing that a single-layer perceptron could not solve certain simple problems (like exclusive-or), which dampened enthusiasm for neural networks for more than a decade56. The limitation was real: the perceptron had no hidden layer, and no one yet had a good way to train one.
The solution came in the 1980s6. In 1986, David Rumelhart, Geoffrey Hinton, and Ronald Williams popularized the backpropagation algorithm, which computes how much each weight in a multi-layer network contributed to the output error and adjusts it accordingly. Backpropagation made it possible to train networks with hidden layers, and it became the workhorse of connectionist modeling. The algorithm is not biologically plausible in detail—it requires a backward pass of error signals that real neurons do not obviously have—but it demonstrated that layered networks could learn complex mappings, and it gave computational neuroscientists a tool for asking what kinds of representations a network could learn from data.
The brain as an associative memory
A parallel tradition asked how networks of neurons could store and retrieve memories. In 1982, John Hopfield published a model of a network of binary neurons with symmetric connections, showing that such a network could act as a content-addressable memory: if you present a partial or noisy version of a stored pattern, the network settles into the full pattern7. These "attractor networks" (the stored patterns are attractors of the network's dynamics) gave a concrete, analyzable model of associative memory87. The Hopfield model was a physicist's approach—it borrowed tools from statistical mechanics—and it inspired a generation of work on how neural circuits might implement memory, including later models of grid cells and head-direction cells as attractor networks.
Vision as computation: Marr's levels
In the late 1970s, David Marr, working at MIT, proposed a framework for understanding vision that reshaped how computational neuroscientists thought about their subject. Marr argued that any information-processing system should be understood at three levels: the computational level (what problem is being solved and why), the algorithmic level (what representations and procedures are used), and the implementation level (how the hardware carries it out). His 1982 book Vision applied this framework to early visual processing, proposing specific algorithms for edge detection and stereopsis. Marr's levels gave the field a vocabulary and a justification for building models that were not necessarily biophysically detailed: a model could be valuable if it captured the right computation, even if its implementation was abstract. The framework also made clear that "what the brain computes" was a legitimate scientific question, distinct from "how the neurons are wired."
Neural coding: what do spikes mean?
As recording techniques improved, a central question became how information is represented in the activity of populations of neurons. In the 1970s and 1980s, work on the visual system and on the motor cortex suggested that information could be read out from the firing rates of many neurons. Apostolos Georgopoulos and colleagues, recording from motor cortex in the 1980s, found that the direction of arm movement could be predicted from the population activity of many neurons, each of which was broadly tuned. This "population vector" idea suggested that the brain might represent movement direction as a distributed pattern across a population, rather than in the firing of any single cell9.
The 1990s and 2000s brought more sophisticated statistical tools. Researchers began to ask how much information a spike train carries, using information theory, and how correlations between neurons affect what a population can represent. The debate between "rate coding" (information in the number of spikes per unit time) and "temporal coding" (information in the precise timing of spikes) remains open, and the answer likely depends on the brain region and the task.
The Bayesian brain and predictive processing
A major development of the 1990s and 2000s was the idea that the brain performs probabilistic inference. The Bayesian framework treats perception as the problem of inferring the causes of sensory input, given prior expectations and noisy evidence10. In the 1990s, researchers like David Knill and Alexandre Pouget showed that human behavior in sensory tasks often matches the predictions of Bayesian optimality. The idea was extended by Karl Friston and others into "predictive processing": the brain is constantly generating predictions about its input and using the mismatch (prediction error) to update its internal model. This framework has been influential because it offers a unified account of perception, learning, and action, and because it connects to the error-driven learning ideas of the connectionists. It remains a subject of active debate, particularly about how literally the brain implements Bayesian computations.
Deep learning and the brain
The most recent turning point is the rise of deep learning. Since the early 2010s, deep neural networks—networks with many layers, trained on large datasets using backpropagation—have achieved dramatic successes in tasks like image recognition and language processing. These networks were not designed as models of the brain, but computational neuroscientists quickly noticed that their internal representations often resemble those found in the brain. In 2014, Daniel Yamins and colleagues showed that deep networks trained on object recognition produced representations in their higher layers that predicted neural responses in the ventral visual stream better than earlier models. This has led to a productive, if contested, research program: using deep networks as "model organisms" for brain computation, and asking which architectural features are necessary to reproduce neural response properties1. The debate about whether backpropagation is biologically plausible, and what alternative learning rules might work, is one of the liveliest in the field today.
The present
Computational neuroscience today is a broad church. Biophysical modelers build detailed compartmental models of single neurons and small circuits, using the Hodgkin–Huxley framework and increasingly detailed anatomical data. Network modelers study how populations of neurons produce dynamics like oscillations, attractor states, and sequential activity. Statistical neuroscientists develop methods for decoding neural activity and for testing models against data. And a growing community uses deep learning both as a tool for analyzing neural data and as a source of hypotheses about brain computation1.
The field's central questions remain open. How does the brain learn without a global error signal? What is the right level of abstraction for a model of a given brain region? How do we connect the dynamics of a network to the computations it performs? And perhaps most fundamentally: what would it mean to have a model that truly explains a piece of the brain, rather than merely predicting its activity? These questions are the direct descendants of the ones McCulloch and Pitts, Hodgkin and Huxley, and Marr were asking, and they are still being answered.
References
- Computational neuroscience (introduction, Cognition, discrimination, and learning), Wikipedia
- Hodgkin–Huxley model, Wikipedia
- Hebbian theory, Wikipedia
- Spike-timing-dependent plasticity (History), Wikipedia
- Connectionism, Wikipedia
- Neural network (History), Wikipedia
- Hopfield network (introduction, History), Wikipedia
- Attractor network, Wikipedia
- Neural coding (Population coding), Wikipedia
- Bayesian approaches to brain function, Wikipedia
The frameworks of Computational Neuroscience
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1943-Present
Artificial neural network modeling
How can networks of simple units compute?
- 1949-Present
Hebbian theory
How do connections between neurons change with experience?
- 1952-Present
Biophysical compartmental modeling
How do ion channels produce the action potential?
- 1962-Present
Feature-detector and hierarchical feedforward models
How do cortical cells become selective for features?
- 1970-Present
- 1977-Present
Marr's levels of analysis
At what levels should we explain an information-processing system?
- 1982-Present
- 1986-Present
Error-driven learning and backpropagation
How can multilayer networks learn from errors?
- 1990-Present
Bayesian brain and predictive processing
Does the brain infer causes probabilistically?
- 2014-Present
Deep learning as a model of brain computation
Can deep networks explain brain computation?
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Deep learning as a model of brain computation grew out of Error-driven learning and backpropagation
Deep learning is the direct continuation of the backpropagation-trained multilayer networks of the 1980s, scaled up with more layers, data and compute.
Carried by Geoffrey Hinton; Yann LeCun; Yoshua Bengio.
Hebbian theory influenced by Artificial neural network modeling
Hebb's learning rule was formulated for networks of McCulloch–Pitts-style formal neurons, and Hebb explicitly built on the idea of the neuron as a unit whose connections could be modified.
Carried by Donald Hebb; The Organization of Behavior (1949).
Attractor network influenced by Artificial neural network modeling
Hopfield's attractor networks were built from binary threshold units of the McCulloch–Pitts type, with symmetric connections added.
Carried by John Hopfield.
Error-driven learning and backpropagation grew out of Artificial neural network modeling
Backpropagation was applied to multilayer networks of neuron-like units, extending the formal neuron into hidden layers.
Carried by David Rumelhart; Geoffrey Hinton; Ronald Williams.
Attractor network influenced by Hebbian theory
Hopfield networks store patterns by strengthening connections between co-active units, a direct application of Hebbian learning.
Carried by John Hopfield.
Deep learning as a model of brain computation influenced by Feature-detector and hierarchical feedforward models
Hierarchical feedforward models of visual cortex, especially the simple/complex cell scheme, were a direct inspiration for the layered architectures of deep convolutional networks.
Carried by David Hubel; Torsten Wiesel; Kunihiko Fukushima.
Bayesian brain and predictive processing influenced by Error-driven learning and backpropagation
Predictive processing adopted the connectionist idea that learning is driven by prediction error, recasting backpropagation-style error signals as Bayesian model updating.
Carried by Karl Friston.
Bayesian brain and predictive processing influenced by Neural coding
Population coding work, such as the motor-cortex population vector, supplied the neural representation that Bayesian models then interpreted probabilistically.
Carried by Apostolos Georgopoulos; Alexandre Pouget.
Bayesian brain and predictive processing influenced by Marr's levels of analysis
Marr's computational level gave Bayesian theorists a framework for treating perception as inference about the causes of sensory input, separate from implementation.
Carried by David Marr.
Beyond the field
Where Computational Neuroscience's ideas came from in other fields, and what they led to there: the strongest 12 of 66 links.
Artificial neural network modeling led to Deep learning as cognitive modelling in Computational Cognitive Science
Deep learning as cognitive modelling descends directly from artificial neural network modelling: the connectionist networks of McCulloch and Pitts, Rosenblatt and the PDP group are the ancestors of the deep networks used as cognitive models.
Carried by Warren McCulloch; Frank Rosenblatt; Parallel Distributed Processing (1986).
Artificial neural network modeling led to Deep learning as cognitive modeling in Cognitive Science
Deep learning as cognitive modelling descends directly from connectionist artificial neural network modelling, from McCulloch and Pitts through PDP; deep networks are the multi-layer generalisation of that programme.
Carried by McCulloch and Pitts (1943); Parallel Distributed Processing (1986).
Artificial neural network modeling influenced Perceptron and Early Neural Networks in Deep Learning
McCulloch and Pitts' 1943 formal neuron and Hebb's 1949 synaptic learning rule supplied the model of a threshold unit and of learning by modifying connection strengths that Rosenblatt built the Perceptron on.
Carried by Warren S. McCulloch; Walter Pitts; Donald O. Hebb.
Artificial neural network modeling led to Connectionism and Neural Network Models in Perception
Connectionist network models grew directly out of earlier artificial neural network modelling, taking the formal neuron, layered architecture and learning rules. The PDP programme refined and generalised the McCulloch-Pitts and perceptron tradition.
Carried by Warren McCulloch; Frank Rosenblatt; Parallel Distributed Processing (1986).
Artificial neural network modeling influenced Computational Neuroscience in Neuroscience
Artificial neural network modeling, from McCulloch and Pitts' 1943 threshold units through Rosenblatt's perceptron and Hopfield's 1982 networks, supplied computational neuroscience with its central tool of simplified network models. Hopfield's energy-based networks in particular were taken up directly by physicists and neuroscientists building the field.
Carried by Warren McCulloch; Walter Pitts; John Hopfield.
Hebbian theory influenced Computational Models of Activity-Dependent Wiring in Developmental Neuroscience
The computational-neuroscience formulation of Hebbian learning, including normalized and competitive Hebbian rules, was taken directly into models of activity-dependent wiring and map refinement. These models use Hebbian plasticity as the learning rule that produces ocular-dominance columns and topographic ordering.
Feature-detector and hierarchical feedforward models influenced by Single-unit receptive field analysis in Systems Neuroscience
Hubel and Wiesel's single-unit recordings of simple and complex cells in cat visual cortex supplied the receptive-field hierarchy that Fukushima's Neocognitron and later feedforward feature-detector models formalised. The physiological findings were the direct template for the model architecture.
Carried by David H. Hubel; Torsten Wiesel; Kunihiko Fukushima.
Neural coding led to Population Coding in Action And Motor Cognition
Population coding developed as a specific proposal within neural coding, the broader question of how stimulus features are represented in spike trains. The population-vector work of Georgopoulos and colleagues on motor cortex supplied the concrete case that made population coding a distinct programme within neural coding.
Carried by Apostolos P. Georgopoulos.
Neural coding influenced Neural decoding in Neural Engineering
Neural decoding grew out of the neural coding programme: the question of what the spike train encodes had to be posed before it could be inverted to read behaviour out of population activity. Decoding methods were developed by the same community that framed the coding problem, and the two are treated as the encode/decode pair of the same research programme.
Carried by Horace Barlow; William Bialek.
Marr's levels of analysis grew out of Computational Theory of Vision in Philosophy Of Perception
Marr's levels of analysis were formulated as the methodological framework for his computational theory of vision, separating the computational task from its algorithm and implementation. The levels were introduced to organise that theory and are inseparable from it.
Carried by David Marr; Vision (1982).
Bayesian brain and predictive processing led to Predictive coding in Embodied Cognition
Predictive coding grew directly out of the Bayesian brain programme, taking its hierarchical Bayesian inference and recasting perception as prediction-error minimisation.
Carried by Karl Friston.
Bayesian brain and predictive processing led to Predictive coding in Philosophy Of Consciousness
Predictive coding in philosophy grew directly out of the Bayesian-brain and predictive-processing programme in computational neuroscience, taking its hierarchical generative-model machinery and applying it to mind.
Carried by Karl Friston; Andy Clark.

Computational Neuroscience is a planet in Nousfarer
Its city has a tower for each of these 10 frameworks. Land, walk in, and climb one concept at a time.
Land on Computational NeuroscienceRelated fields
Fields its ideas are linked to
- Systems Neuroscience 6 links
- Deep Learning 5 links
- Computer Vision 4 links
- Perception 4 links
- Cellular Neuroscience 4 links
- Neurophysiology 4 links
- Neuroscience 4 links
- Engineering Physiology 3 links
- Cognitive Science 3 links
- Learning And Concept Formation 3 links
- Developmental Neuroscience 3 links
- Artificial Intelligence 2 links
More in Neuroscience
- Behavioral Neuroscience
- Cellular Neuroscience
- Cognitive Neuroscience
- Developmental Neuroscience
- Molecular Neuroscience
- Neuroimaging
- Neurophysiology
- Neuroscience
- Systems Neuroscience
See where Computational Neuroscience sits on the Map of Human Knowledge