- Atlas
- Social Sciences
- Computational Cognitive Science
Computational Cognitive Science
Computational cognitive science is the attempt to explain the mind by building precise, runnable models of it.
8 frameworks, from 1943 to today · Cognitive Science · Social Sciences
- Cybernetics 1943-1960
- Symbolic information processing 1956-1990
- Connectionism 1958-Present
- Cognitive architecture 1975-Present
- Computational theory of vision (Marr's levels) 1982-Present
- Bayesian cognitive science 1990-Present
- Predictive coding 2005-Present
- Deep learning as cognitive modelling 2012-Present
Overview
Computational cognitive science is the attempt to explain the mind by building precise, runnable models of it1. Its practitioners ask: what kind of computation could produce perception, memory, learning, and reasoning, and what evidence tells us which computation the brain actually performs? The field matters because it turns verbal theories into testable machinery—if a theory of mind cannot be implemented, its gaps show; if it can, its predictions can be checked against human behaviour and neural data. Its history is a sequence of competing answers to one question: what is the right vocabulary for describing mental computation?
Cybernetics and the feedback loop (1940s–1950s)
The earliest strand grew from wartime engineering. Norbert Wiener's Cybernetics (1948) proposed that animals and machines share a common logic of control and communication: feedback, the use of a system's own output to correct its future behaviour. The concrete case was the anti-aircraft predictor—a machine that tracked a moving target, predicted its future position, and adjusted fire, all through closed-loop correction rather than a stored plan. Warren McCulloch and Walter Pitts had already shown in 1943 that idealized neurons could compute logical functions, suggesting that thought might be a kind of logic implemented in tissue234. Cybernetics made "purpose" and "adaptation" respectable objects of engineering study, but it offered little account of representation—of what a system knows, as opposed to how it corrects.
Symbolic information processing and the cognitive revolution (1950s–1970s)
The decisive break came with the idea that minds manipulate symbols—discrete representations with combinatorial structure. Allen Newell and Herbert Simon's Logic Theorist (1956) proved theorems from Whitehead and Russell's Principia Mathematica, and their General Problem Solver (1957) modelled problem-solving as search through a space of states using means–ends analysis: compare current state to goal, find a difference, apply an operator that reduces it. The claim was that cognition is symbol manipulation, and that a physical system can implement it—the "physical symbol system hypothesis" Newell and Simon stated in 1976.
This programme produced lasting results. George Miller's 1956 work on the magic number seven, and later Atkinson and Shiffrin's 1968 memory model, treated memory as a set of stores with transfer rules. Noam Chomsky's 1957 Syntactic Structures argued that grammar is a formal system generating sentences, and that children's rapid language acquisition requires innate structure. David Marr's 1982 Vision gave the field its canonical methodology: describe a computation at three levels—what problem is solved, what algorithm solves it, and how it is physically implemented. Marr's analysis of edge detection in early vision showed how a computational account could be constrained by both psychophysics and neurophysiology.
The symbolic approach's weakness was brittleness5. Hand-built systems struggled with the messiness of real perception and language, and the "frame problem"—how a system knows which facts are relevant to a situation—resisted clean solution.
Connectionism and distributed representation (1940s–1980s, revived)
An alternative had been present from the start. Donald Hebb's 1949 The Organization of Behavior proposed that learning consists of strengthening synapses between neurons that fire together. Frank Rosenblatt's perceptron (1958) was a trainable network that could learn to classify patterns, and it made headlines—until Marvin Minsky and Seymour Papert's 1969 Perceptrons proved that single-layer networks could not compute certain simple functions (like exclusive-or), a result widely read as a verdict on the whole approach.
The revival came in the 1980s6. David Rumelhart, Geoffrey Hinton, and Ronald Williams's 1986 backpropagation algorithm—gradient descent on the error of a multi-layer network—allowed networks to learn internal representations that were distributed across many units rather than stored in discrete symbols. Rumelhart and James McClelland's two-volume Parallel Distributed Processing (1986) argued that such networks capture graceful degradation, generalization, and the statistics of experience in ways symbolic systems did not. The past-tense debate of the late 1980s—Rumelhart and McClelland's network that learned English past tenses versus Steven Pinker and Alan Prince's rule-based account—became the emblematic contest between connectionist and symbolic explanations, and it was never fully resolved.
Cognitive architectures (1970s–1990s)
A third strand asked not how one task is done but how a whole mind is organized. A cognitive architecture is a fixed set of mechanisms—memory stores, processing cycles, learning rules—within which many tasks can be modelled7. Allen Newell's Soar (developed from the early 1980s) modelled problem-solving as search in problem spaces with chunking as its learning mechanism. John Anderson's ACT-R (from the 1970s onward, maturing in the 1990s) combined declarative memory, procedural production rules, and activation-based retrieval, and was fitted quantitatively to human reaction times and error rates across many experiments. These architectures claimed that a single set of mechanisms could explain data from memory, reasoning, and learning simultaneously—a stronger claim than any single-task model.
Bayesian cognitive science (1980s–2000s)
The Bayesian turn reframed cognition as probabilistic inference8. The core idea: a mind holds prior beliefs, receives evidence, and updates to posterior beliefs by Bayes' rule9. The approach's power lies in explaining how people reason under uncertainty—and why they make the errors they do. An early landmark was the "Bayesian observer" model of perception, in which the brain combines noisy sensory evidence with prior expectations; work on cue combination in depth perception in the 1990s showed that humans integrate visual and haptic cues in close to the statistically optimal way.
The framework expanded dramatically in the 2000s. Josh Tenenbaum and colleagues' work on concept learning, causal inference, and "theory theory"—the idea that people reason with intuitive theories that are themselves probabilistic—showed that Bayesian models could capture inductive generalization from sparse data. The "Bayesian program learning" approach later modelled how people learn new concepts from a single example by inferring the generative program behind it. The appeal was normative: Bayesian models specify what an ideal reasoner would do, and deviations become informative about the priors and approximations real minds use.
Predictive processing (2000s–present)
Predictive processing grew out of Bayesian ideas about perception but made a stronger claim: that the brain is fundamentally a prediction machine10. The core mechanism is the minimization of prediction error—the mismatch between expected and actual sensory input10. Higher levels send predictions downward; lower levels send upward only the residual error. Karl Friston's "free energy principle" (from the mid-2000s) generalized this into a mathematical framework claiming that all self-organizing systems minimize a quantity (variational free energy) that bounds surprise. Andy Clark's Surfing Uncertainty (2016) popularized the view that perception, action, and learning are all aspects of prediction-error minimization. The framework is influential and contested: critics ask whether it makes falsifiable predictions distinct from standard Bayesian accounts, and whether "minimizing free energy" is a substantive theory or a redescription.
Deep learning as cognitive modelling (2010s–present)
The most recent turn applies modern deep learning—multi-layer neural networks trained on large data—to questions about minds11. The 2012 success of deep convolutional networks on image recognition (AlexNet) demonstrated that hierarchical feature learning could match human-level performance on some perceptual tasks, reviving connectionist ambitions with far greater computational power. Cognitive scientists began using deep networks as models of human vision, language, and even navigation. Word embeddings and, later, large language models were probed for whether their internal representations resemble human semantic and syntactic knowledge. The "controversy" is whether such models explain cognition or merely perform tasks: a network that predicts the next word may capture statistical regularities without the structured representations cognitive scientists posit. The debate echoes the 1980s past-tense dispute, now at larger scale.
The present
Today the field is plural. Bayesian and predictive-processing models dominate work on perception and learning; cognitive architectures like ACT-R continue to integrate data across tasks; deep learning provides both tools and provocative models; and hybrid approaches—neural networks with structured priors, or architectures with Bayesian components—attempt to combine the strengths of each. The open questions are old ones in new form: what level of description is the right one for cognition (Marr's levels remain a touchstone); whether symbolic and subsymbolic accounts are competitors or complementary; how to ground computational models in neural implementation; and whether the predictive-processing framework can be made precise enough to be tested rather than merely accommodated. The field's history is a record of successive attempts to say what kind of computation a mind is—and each attempt has sharpened the question rather than closed it.
References
- Computational cognition, Wikipedia
- Cognitive model (History), Wikipedia
- Computational theory of mind (History), Wikipedia
- Neural computation, Wikipedia
- Symbolic artificial intelligence, Wikipedia
- Connectionism, Wikipedia
- Cognitive architecture, Wikipedia
- Bayesian cognitive science, Wikipedia
- Bayesian inference, Wikipedia
- Predictive coding, Wikipedia
- Deep learning, Wikipedia
The frameworks of Computational Cognitive Science
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1943-1960
- 1956-1990
Symbolic information processing
Can thought be reduced to symbol manipulation?
- 1958-Present
Connectionism
How do networks of simple units learn representations?
About Connectionism
Connectionism offers a radical answer to the question of what kind of computational system the human mind is. Instead of a digital computer manipulating discrete symbols according to explicit rules, connectionism proposes that cognition emerges from the parallel, distributed activity of many simple, neuron-like processing units. These units are connected in a network, and knowledge is not stored in a central location or as a set of propositions, but is encoded in the strengths of the connections between units. This framework directly challenged the dominant symbolic paradigm of Classical Computationalism by providing a model that was more biologically plausible, could learn from experience, and gracefully degraded under damage, much like the human brain.Connectionism’s core curriculum is built around a set of interconnected concepts that describe how these networks are structured, how they learn, and how they perform cognitive tasks. The fundamental unit of analysis is the Parallel Distributed Processing (PDP) model, which emphasizes that many operations happen simultaneously across the network. Information is not stored in a single location but is a Distributed Representation, meaning that a concept is represented by a pattern of activation across many units. This contrasts sharply with Localist Representation, where each unit stands for a single concept. The network’s architecture includes Hidden Units, which are intermediate processing nodes between input and output layers that allow the network to learn complex, non-linear mappings. The primary learning mechanism is Backpropagation, an algorithm that calculates the error at the output and propagates it backward through the network to adjust the Connection Weights. These weights, which determine the strength of influence between units, are the primary locus of learning. The output of each unit is determined by an Activation Function, which transforms the net input into an output value. The classic choice is the Sigmoid Activation function, which introduces non-linearity and allows the network to learn complex patterns. Learning is driven by Error-Driven Learning, where the network adjusts its weights to minimize the difference between its actual output and the target output. This process is governed by a Learning Rule, such as the delta rule or the generalized delta rule used in backpropagation. A trained network can perform Pattern Completion, where a partial or noisy input can trigger the retrieval of a complete stored pattern. This ability contributes to Graceful Degradation, meaning that as units or connections are damaged, the network’s performance declines gradually rather than catastrophically. Many connectionist models are built as Attractor Networks, which settle into stable patterns of activation over time, a process that can be understood as Constraint Satisfaction, where the network finds a state that best satisfies multiple, potentially conflicting, constraints. This entire approach is often described as Subsymbolic Processing, because the units themselves do not represent symbols; instead, meaningful symbols emerge from the collective activity of many units. The basic features that the network learns to detect are often called Microfeatures, which are sub-symbolic properties that combine to form higher-level concepts.The intellectual history of connectionism in computational cognitive science is marked by distinct waves. The first wave began with the McCulloch-Pitts Neuron (1943), a simple mathematical model of a neuron, and Frank Rosenblatt’s Perceptron (1958), a single-layer network that could learn simple patterns. This wave was halted by the Minsky-Papert Critique (1969), which mathematically demonstrated the limitations of single-layer perceptrons, leading to a period of reduced funding and interest known as the “AI winter” for connectionism. The second wave, which defines the local dominance period (1980–2026), was sparked by a revival. The term “connectionist model” was reintroduced by Jerome Feldman and Dana Ballard in 1982. The landmark publication was the two-volume work Parallel Distributed Processing (1986) by James L. McClelland, David E. Rumelhart, and the PDP Research Group. This work introduced key innovations like hidden units and the backpropagation learning algorithm, overcoming the limitations of the perceptron. Key figures of this era include Geoffrey Hinton, who co-developed backpropagation and explored distributed representations; John Hopfield, who introduced Hopfield networks (a type of attractor network); and Stephen Grossberg, who developed Adaptive Resonance Theory (ART). This second wave positioned connectionism as a direct competitor to Symbolic AI and Classical Computationalism, sparking intense debates about the nature of mental representation and compositionality. The third wave, beginning around 2010, is characterized by Deep Learning, which uses very large networks with many hidden layers. While deep learning has led to remarkable practical successes, it is a later development that builds on the core concepts of the second wave. Connectionism’s legacy in computational cognitive science is profound: it provided a powerful, biologically-inspired alternative to symbolic models, fundamentally shifted the field’s focus toward learning and statistical inference, and introduced a set of concepts and tools that remain central to modern cognitive modeling and artificial intelligence.The 15 concepts its tower teaches
- Activation Function
- Attractor Network
- Backpropagation
- Connection Weight
- Constraint Satisfaction
- Distributed Representation
- Error-Driven Learning
- Graceful Degradation
- Hidden Unit
- Learning Rule
- Microfeature
- Parallel Distributed Processing
- Pattern Completion
- Sigmoid Activation
- Subsymbolic Processing
- 1975-Present
Cognitive architecture
What fixed mechanisms organize a whole mind?
About Cognitive architecture
How can we build a single computational system that accounts for the full range of human cognition—from perception and memory to problem-solving and learning? Cognitive architectures emerged in the 1980s as a direct response to the fragmentation of earlier symbolic models, which tackled isolated tasks but lacked a unified structural theory. A cognitive architecture is both a theoretical hypothesis about the fixed, domain-general structures of the mind and a runnable software instantiation of that hypothesis. Unlike Classical Computationalism, which treated cognition as a general symbol-manipulation engine, or Connectionism, which focused on distributed neural-like processing, cognitive architectures commit to specific, invariant components—working memory buffers, production rules, a declarative memory store—and specify how they interact to produce intelligent behavior across diverse environments. The goal is a unified theory of cognition, not just a model of one cognitive function.The core curriculum for cognitive architectures in computational cognitive science begins with the foundational distinction between the architecture (the fixed, innate structures) and the knowledge (the content loaded into those structures). From there, students learn the canonical components: production rules (condition-action pairs that govern step-by-step behavior), working memory (a limited-capacity buffer for current goals and information), and declarative memory (a long-term store for facts and episodes). The architecture's procedural memory holds the production rules themselves. A central teaching is the production cycle—the repeated process of matching rule conditions against working memory contents, selecting a winning rule, and firing it to update working memory or initiate an action. To handle learning, architectures include mechanisms such as chunking (compiling sequences of productions into single rules) and strengthening (adjusting the activation or utility of declarative chunks or productions based on experience). The utility learning mechanism in architectures like ACT-R tunes which production to select when multiple rules match, optimizing for speed and accuracy. Students also learn how architectures model cognitive control—the executive processes that manage goals, resolve conflicts, and allocate attention—often through a goal stack or a specialized goal buffer. Finally, the curriculum covers how architectures are evaluated: by fitting response times and error patterns from human experiments, using the architecture's subsymbolic parameters (e.g., base-level activation, noise) to predict behavioral data.The intellectual history of cognitive architectures in computational cognitive science begins with precursors in the 1970s. Herbert Simon and his student Ed Feigenbaum's EPAM system (1960s) was an early candidate for an architecture because it integrated memory and learning. John R. Anderson and Gordon Bower's 1973 HAM (Human Associative Memory) theory provided a structured account of declarative memory. But the framework crystallized in the 1980s. Allen Newell, in his 1990 book Unified Theories of Cognition, explicitly called for cognitive architectures as the vehicle for unifying psychology, and his Soar architecture (first developed in the early 1980s with John Laird and Paul Rosenbloom) embodied that vision with a single production system, a universal subgoaling mechanism, and chunking as its sole learning mechanism. Simultaneously, John R. Anderson developed the ACT family of architectures, culminating in the 1983 book The Architecture of Cognition and the mature ACT-R (Adaptive Control of Thought—Rational) in the 1990s. ACT-R added a rational analysis of cognition, subsymbolic activation equations, and distinct buffers for different modalities (vision, manual, etc.). Both Soar and ACT-R became the dominant platforms, each with a community of researchers who used them to model phenomena from memory retrieval to air-traffic control. The framework coexisted with Connectionism (which emerged in parallel in the 1980s) and later with Bayesian Cognitive Science and Deep Learning. Cognitive architectures have been supplemented by, rather than replaced by, these later frameworks: Bayesian methods have been integrated into ACT-R's subsymbolic equations, and deep learning has been used to implement perceptual and motor components. The legacy of cognitive architectures is the insistence that a theory of cognition must specify the fixed structures that make any mind—human or artificial—possible, and that those structures must be precise enough to run as a computer program.The 15 concepts its tower teaches
- Architecture vs. knowledge distinction
- Chunking
- Cognitive control
- Declarative memory
- Goal buffer
- Goal stack
- Procedural memory
- Production cycle
- Production rules
- Response time and error pattern fitting
- Strengthening
- Subsymbolic parameters
- Unified theory of cognition
- Utility learning
- Working memory
- 1982-Present
Computational theory of vision (Marr's levels)
At what levels should we explain a computation?
- 1990-Present
- 2005-Present
- 2012-Present
Deep learning as cognitive modelling
Can deep networks model human cognition?
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Cognitive architecture grew out of Symbolic information processing
Newell's Soar and Anderson's ACT-R were built directly on the symbolic information-processing framework, extending its production rules and problem-space search into whole-mind architectures with fixed memory stores and learning mechanisms.
Carried by Allen Newell; John Anderson; Soar.
Deep learning as cognitive modelling revived Connectionism
Deep learning deliberately revived the connectionist programme of multi-layer trainable networks, with AlexNet's 2012 success showing that hierarchical feature learning could work at scale. The backpropagation algorithm of the 1980s is the direct technical ancestor.
Carried by Geoffrey Hinton; AlexNet (2012); David Rumelhart.
Predictive coding grew out of Bayesian cognitive science
Predictive processing grew out of Bayesian models of perception, recasting inference as prediction-error minimization with hierarchical generative models. Friston's free energy principle generalized the Bayesian observer into a claim about all self-organizing systems.
Carried by Karl Friston; Andy Clark.
Symbolic information processing reacted against Cybernetics
Newell and Simon's symbolic programme defined itself against cybernetics' feedback-and-control vocabulary, insisting that cognition is discrete symbol manipulation rather than closed-loop correction. The physical symbol system hypothesis was offered as a rival account of what minds do.
Carried by Allen Newell; Herbert Simon; Logic Theorist (1956).
Connectionism influenced by Cybernetics
Rosenblatt's perceptron grew out of the cybernetic milieu of adaptive machines and McCulloch-Pitts neurons, treating learning as adjustment of connection weights in a network that corrects itself from error.
Carried by Frank Rosenblatt; Warren McCulloch; Walter Pitts.
Computational theory of vision (Marr's levels) grew out of Symbolic information processing
Marr's three levels of analysis formalized the symbolic programme's methodology, specifying computation, algorithm, and implementation as distinct explanatory levels for vision. Marr worked within the information-processing tradition and gave it its canonical statement.
Carried by David Marr; Vision (1982).
Bayesian cognitive science reacted against Symbolic information processing
Bayesian cognitive science arose partly as a response to the brittleness of symbolic models, replacing deterministic symbol manipulation with probabilistic inference over uncertain evidence. It kept the computational-level ambition while rejecting the symbolic vocabulary.
Carried by Josh Tenenbaum.
Cognitive architecture influenced by Connectionism
Connectionist ideas about distributed representation and activation-based processing fed into architecture designs, notably ACT-R's activation-based declarative memory, which borrowed spreading-activation notions from the PDP programme.
Carried by John Anderson; Parallel Distributed Processing (1986).
Beyond the field
Where Computational Cognitive Science's ideas came from in other fields, and what they led to there: the strongest 12 of 43 links.
Cybernetics influenced Efference copy in Action And Motor Cognition
Von Holst and Mittelstaedt's efference copy concept grew out of cybernetic thinking about feedback and closed-loop control, recasting the problem as comparison between sensory inflow and a copy of the motor command. The cybernetic framework supplied the feedback model the concept was built on.
Carried by Erich von Holst; Horst Mittelstaedt; Norbert Wiener.
Symbolic information processing led to Cognitive Modeling and Information Processing in Human Computer Interaction
Symbolic information processing is the direct parent of cognitive modeling in HCI: the Model Human Processor and GOMS treat the user as a symbol-manipulating information processor. Card, Moran and Newell imported the production-system and symbol-processing framework into interface analysis.
Carried by The Psychology of Human-Computer Interaction (1983); Allen Newell.
Connectionism rival of Symbolic computationalism in Cognitive Science
Connectionism arose in part as a reaction against symbolic computationalism, arguing that cognition is distributed subsymbolic processing rather than rule-governed symbol manipulation. The PDP volumes defined connectionism by contrast with the symbolic paradigm.
Carried by David Rumelhart; James McClelland; Parallel Distributed Processing (1986).
Cognitive architecture influenced Cognitive Tutors in Learning Sciences
Cognitive tutors are built on cognitive architectures such as ACT-R: the production-system architecture supplies the model of skill acquisition and the rule representation that the tutor uses to trace student solutions.
Carried by John R. Anderson.
Predictive coding grew out of Bayesian cognitive science in Cognitive Science
Predictive coding grew out of Bayesian cognitive science: the Bayesian programme of the 1990s and 2000s, associated with Griffiths, Tenenbaum and Knill and Richards, supplied the inference framework that predictive coding then applied to cortical message passing.
Carried by David C. Knill.
Deep learning as cognitive modelling grew out of Artificial neural network modeling in Computational Neuroscience
Deep learning as cognitive modelling descends directly from artificial neural network modelling: the connectionist networks of McCulloch and Pitts, Rosenblatt and the PDP group are the ancestors of the deep networks used as cognitive models.
Carried by Warren McCulloch; Frank Rosenblatt; Parallel Distributed Processing (1986).
Deep learning as cognitive modelling influenced by Deep Learning in Machine Learning
Deep learning as cognitive modelling takes its networks, training algorithms and representational findings directly from machine-learning deep learning, especially the backpropagation-trained convolutional networks of the 2010s.
Carried by AlexNet (2012); Geoffrey Hinton; Yann LeCun.
Cybernetics influenced by Control Theory in Applied Mathematics
Cybernetics drew on and helped popularise the feedback and servomechanism concepts of control theory, while control theory later formalised these ideas independently. Wiener's work bridged the two traditions.
Carried by Norbert Wiener.
Cybernetics provoked Symbolic computationalism in Cognitive Science
Symbolic computationalism arose partly in reaction to cybernetics, shifting from analog feedback and self-regulation to discrete symbol manipulation; the 1956 MIT and Dartmouth work marked the break.
Carried by Newell and Simon; Logic Theorist (1956).
Cybernetics influenced General Systems Theory in Systems Biology
The cybernetics movement's information and feedback concepts were taken up by general systems theorists as core organising principles in the 1950s.
Carried by Ludwig von Bertalanffy; Norbert Wiener.
Cybernetics influenced Carnegie School in Organizational Knowledge
Cybernetics provided the information-processing and feedback concepts that the Carnegie School carried into its models of organizational decision making, later feeding computational cognitive science. The passage runs through Simon's work on bounded rationality and problem solving.
Carried by Norbert Wiener; Herbert A. Simon.
Cybernetics influenced Computational Theory of Mind in Philosophy Of Artificial Intelligence
The same cybernetic information-and-control framework fed the computational cognitive science that carried the computational theory of mind. Early cognitive scientists took over its machine models and information vocabulary.
Carried by Norbert Wiener; George A. Miller.

Computational Cognitive Science is a planet in Nousfarer
Its city has a tower for each of these 8 frameworks. Land, walk in, and climb one concept at a time.
Land on Computational Cognitive ScienceRelated fields
Fields its ideas are linked to
- Cognitive Science 6 links
- Psychology 4 links
- Deep Learning 3 links
- Cognitive Psychology 3 links
- Computer Vision 2 links
- Machine Learning 2 links
- Cognitive Hci 2 links
- Philosophy Of Consciousness 2 links
- Philosophy Of Artificial Intelligence 2 links
- Artificial Intelligence 1 link
- Systems Biology 1 link
- Action And Motor Cognition 1 link
More in Cognitive Science
- Action And Motor Cognition
- Attention
- Cognitive Science
- Consciousness Studies
- Embodied Cognition
- Learning And Concept Formation
- Memory
- Perception
- Reasoning Decision Making
See where Computational Cognitive Science sits on the Map of Human Knowledge