- Atlas
- Computer Science
- Cognitive Hci
Cognitive Hci
Cognitive HCI is the branch of human–computer interaction that treats the person at the machine as an information processor, a reasoner, a rememberer, a decision-maker—and asks how interfaces can be built to fit those mental capacities and their limits.
11 frameworks, from 1940 to today · Human Computer Interaction · Computer Science
- Ergonomics 1940-Present
- Fitts's Law and Human-Performance Modeling 1954-Present
- Information processing 1956-1990
- Cognitive architecture 1976-Present
- GOMS 1980-Present
- Mental Models and Design Metaphor 1983-Present
- Situated Action 1987-Present
- Cognitive load 1988-Present
- Distributed Cognition 1989-Present
- Dual process theory 1995-Present
- Embodied Interaction 2001-Present
Overview
Cognitive HCI is the branch of human–computer interaction that treats the person at the machine as an information processor, a reasoner, a rememberer, a decision-maker—and asks how interfaces can be built to fit those mental capacities and their limits1. Its practitioners build models that predict how long a task will take or where errors will occur, run experiments on attention and memory, and design systems whose menus, icons, and feedback match how people actually think. What is at stake is concrete: a telephone operator's speed, a pilot's error under stress, a patient's ability to read a medication screen correctly. Cognitive HCI supplies the theories and measurements that let designers argue, before building anything, that a system will be usable—and that let them explain, after the fact, why it was not.
Human factors and the operator's task
The field's deepest roots lie in human factors and ergonomics, the study of fitting work to human capacities, which matured during the Second World War and after. Military research on radar operators, pilots, and control-room crews showed that equipment designed around the machine's convenience produced predictable human error. The response was a discipline of measurement: how fast can a person detect a signal, how many dials can be monitored, what display layout reduces misreading. This tradition gave cognitive HCI its experimental habits—controlled tasks, error counts, response times—and its conviction that human limits are design constraints, not personal failings. Early computing inherited the same problems: operators at consoles, typists at terminals, and later office workers at screens all needed interfaces matched to perception and motor control.
Information-processing psychology and the model human
The decisive intellectual shift came in the 1950s and 1960s, when psychology reconceived the mind as a system that encodes, stores, and transforms information. Laboratory work on attention, short-term memory, and problem solving produced a picture of a person with limited channels and finite memory2. Two results became foundational for interface design. George Miller's 1956 paper on the "magical number seven" argued that immediate memory holds only a handful of chunks—meaningful units—at once, which implied that interfaces should not force users to hold many items in mind. Paul Fitts's 1954 work on aimed movements produced what became known as Fitts's law: the time to move to a target grows with the distance to it and shrinks with its size. That single relationship, later applied to screen layouts and pointing devices, let designers predict how long a click or a reach would take before testing it on anyone.
GOMS and the engineering of behavior
The first fully computational theory of the user arrived with GOMS—Goals, Operators, Methods, and Selection rules—developed by Stuart Card, Thomas Moran, and Allen Newell in the late 1970s and published in their 1983 book The Psychology of Human-Computer Interaction. GOMS models a skilled user as a hierarchy: a goal (delete a word) is achieved by a method (select, then cut), built from operators (keystrokes, mouse movements, mental steps), with selection rules choosing among methods3. Each operator carries a time cost, so a model can predict total task time for a proposed interface without building it. The book's keystroke-level model, with its table of standard operator times, made this practical4. GOMS was convincing because it was quantitative and falsifiable: predicted times could be checked against real users. Its limitation was equally clear—it modeled expert, error-free performance and said little about learning, confusion, or novices.
Mental models, metaphor, and the user's theory of the machine
Running alongside the modeling tradition was a concern with what users believe about a system. The idea of the mental model—a person's internal, often incomplete theory of how a device works—entered HCI through work such as Donald Norman's studies of users' understandings of devices in the 1980s. If a user's model of a word processor is a typewriter, their expectations about what a key will do are wrong in specific, predictable ways. Designers responded with design metaphor: the desktop, folders, and trash can borrowed from office life to give users a working model they already possessed. The approach's power and its risk were both evident—metaphors guide expectations, but they also mislead when the system departs from the metaphor's logic.
Cognitive architectures and the simulated user
A more ambitious program sought a single architecture that could generate human behavior across many tasks. Cognitive architectures such as ACT-R, developed by John Anderson and colleagues from the 1970s onward, and SOAR, begun by Allen Newell and John Laird in the early 1980s, combined memory structures, production rules, and timing parameters into running systems. In HCI, the most influential application was the Model Human Processor in Card, Moran, and Newell's book: a simplified architecture of perceptual, cognitive, and motor processors with cycle times, used to derive predictions like GOMS's. Architectures promised to unify findings and to simulate users before testing, though their complexity and the difficulty of validating them against real interface use kept them a specialist tool rather than a daily design method.
Distributed cognition and the social unit of analysis
In the late 1980s and 1990s, a challenge came from within cognitive science. Distributed cognition, associated with Edwin Hutchins and his studies of ship navigation published in Cognition in the Wild (1995), argued that cognition is not confined to a single skull: it is spread across people, artifacts, and representations. A cockpit crew, a chart, and a set of instruments together perform a computation no individual performs alone. For HCI this reframed the unit of analysis from the solitary user to the system of person-plus-tools, and it encouraged designs that externalize memory and reasoning into the interface. The same period saw situated action, articulated by Lucy Suchman in Plans and Situated Actions (1987), which argued from studies of people using a photocopier that action is improvised in context rather than dictated by pre-formed plans. Suchman's critique struck directly at the planning-heavy assumptions behind GOMS-style models, and it helped push HCI toward ethnographic study of real use.
Cognitive load and the measurement of mental effort
A parallel strand concerned how much mental work an interface demands. Cognitive load theory, developed by John Sweller from the 1980s in the context of instruction, distinguished the intrinsic difficulty of material from the load imposed by how it is presented, and argued that working memory is the bottleneck. In HCI the idea was applied to interface complexity and to measurement: dual-task methods, subjective rating scales, and physiological measures were used to estimate how hard a system was to use. The appeal was practical—load is something designers can reduce by chunking information, offloading memory to the display, or simplifying choices—though measuring it reliably remained contested.
Dual-process accounts and the intuitive user
Later work imported the distinction, familiar from psychology, between fast, automatic, intuitive judgment and slow, deliberate reasoning5. Dual-process accounts suggested that much everyday interaction is handled by the first system: users recognize familiar patterns, rely on habit, and skim. This helped explain why interfaces that look trustworthy are trusted, why small visual cues sway choices, and why users ignore warnings. It connected cognitive HCI to the study of persuasion and error in digital environments, and it complicated the picture of the user as a careful problem-solver that earlier modeling had assumed.
Embodied interaction and the move beyond the screen
By the 2000s, a further shift questioned the information-processing picture itself. Embodied interaction, articulated by Paul Dourish in his 2001 book Where the Action Is, drew on phenomenology and on tangible and social computing to argue that meaning arises from bodily engagement with the world, not from representations passed into a passive mind. Designers began building systems around gesture, touch, and physical manipulation, where the body's skills and the setting's social meaning are part of the interaction. This did not replace cognitive HCI so much as widen it, and it pushed the field to ask what a "cognitive" account of use leaves out.
The present: models, measures, and open questions
Today cognitive HCI is plural. Predictive modeling survives in tools that estimate task times and in the design of safety-critical systems, where formal analysis of error is expected. Experimental methods—controlled studies of attention, memory, and workload—remain standard in usability evaluation, and cognitive load measurement is used in educational and complex-work interfaces. Mental models and metaphor guide the design of new domains, from voice assistants to mixed reality, where users must form a working theory of an unfamiliar system6. Dual-process findings inform work on trust, warnings, and dark patterns5. Distributed and situated perspectives are built into field studies and into the design of collaborative and embedded systems. Embodied approaches shape tangible, gestural, and spatial interfaces. The open questions are the old ones sharpened: how to model users who learn and err rather than perform perfectly; how to measure mental effort without disturbing it; how far cognition extends into tools and other people; and how to reconcile the predictive power of information-processing models with the contextual, bodily, and social character of real use.
References
- Cognitive ergonomics, Wikipedia
- Cognitive science (History), Wikipedia
- GOMS, Wikipedia
- Keystroke-level model, Wikipedia
- Dual process theory, Wikipedia
- Mental model (History), Wikipedia
The frameworks of Cognitive Hci
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1940-Present
- 1954-Present
Fitts's Law and Human-Performance Modeling
How long does an aimed movement take?
- 1956-1990
Information processing
How does the mind encode, store, and transform information?
- 1976-Present
Cognitive architecture
What fixed architecture generates human thought and action?
- 1980-Present
- 1983-Present
Mental Models and Design Metaphor
What do users believe about how a system works?
- 1987-Present
- 1988-Present
- 1989-Present
Distributed Cognition
How is cognition spread across people and artifacts?
About Distributed Cognition
Distributed cognition emerged in the mid-1990s as a direct challenge to the assumption that cognition happens only inside an individual's head. In Human-Computer Interaction (HCI), this framework asks a fundamentally different question: where is the cognitive system? Its answer—that cognition is distributed across people, artifacts, and their coordinated interactions—reoriented HCI from modeling the solitary user to analyzing entire socio-technical systems. This shift was not merely philosophical; it provided new analytic tools for understanding real-world settings like aircraft cockpits, ship navigation teams, and control rooms, where expertise and memory are spread across multiple human and non-human agents.Distributed cognition is distinct from neighboring frameworks in cognitive HCI. Unlike Human Information Processing, which treats the individual as a bounded processor, or Ecological Interface Design, which focuses on the structure of the work domain, distributed cognition takes as its unit of analysis the entire functional system—the collection of people, tools, representations, and their interrelations—that accomplishes a cognitive task. It shares with Embodied Interaction a concern for the physical and social environment, but it retains a stronger focus on information flow and representational states.The core curriculum for distributed cognition in HCI begins with the foundational concept of the unit of analysis: the cognitive system is defined functionally, not anatomically. This leads to the study of representational states and information flow across that system. A key analytic move is propagation across representational states, tracing how information is transformed as it moves between media—from a spoken command to a written note to a digital display. This process is governed by coordination mechanisms, the routines, protocols, and artifacts that synchronize activity. The framework also emphasizes mediating artifacts and external representations, such as checklists, charts, or shared screens, which offload memory and computation. Finally, cognitive ethnography is the primary methodological approach, using detailed observation to map how cognition is distributed in practice.Edwin Hutchins, a cognitive anthropologist, developed distributed cognition in the 1990s, most famously through his 1995 book Cognition in the Wild. Hutchins studied the navigation team of a U.S. Navy ship, showing how the task of piloting a vessel into port was accomplished not by any single individual but by a system of people (the navigator, the bearing-takers, the plotter) and artifacts (the chart, the alidade, the gyrocompass). His work demonstrated that memory, computation, and decision-making were distributed across this socio-technical system. Hutchins's key insight was that the cognitive properties of the system—its ability to compute a position, to remember a course, to detect an error—could not be reduced to the properties of any individual component.Distributed cognition entered HCI as a corrective to the prevailing individualistic models of the late 1980s and early 1990s. It coexisted with and supplemented Computational Cognitive Modeling, which continued to focus on internal processes, and Ecological Interface Design, which emphasized the work domain. By the early 2000s, distributed cognition had influenced the rise of Embodied Interaction, which shared its concern for the physical and social setting but placed greater emphasis on the lived, phenomenological experience of interaction. Distributed cognition remains a vital framework in HCI, particularly for analyzing complex, collaborative work settings and for designing systems that support coordination across human and machine agents.A common misconception is that distributed cognition simply means "cognition is shared among people." In fact, the framework is analytically precise: it treats the distribution of representational states and the transformations they undergo as the primary object of study. Another pitfall is to confuse distributed cognition with the broader philosophical position of extended mind. While related, distributed cognition is a specific analytic framework developed for empirical study, not a general thesis about the metaphysics of mind.The 13 concepts its tower teaches
- Cognitive ethnography
- Cognitive properties of the system
- Coordination artifacts
- Coordination mechanisms
- External representations
- Functional system definition
- Information flow
- Mediating artifacts
- Propagation across representational states
- Representational media
- Representational states
- Socio-technical system
- Unit of analysis
- 1995-Present
- 2001-Present
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Cognitive architecture grew out of Information processing
Cognitive architectures grew directly out of information-processing psychology, turning its box-and-arrow models of memory and processing into running computational systems with specified cycle times.
Carried by Allen Newell; John Anderson.
GOMS grew out of Information processing
GOMS was built on information-processing assumptions: the Model Human Processor in Card, Moran, and Newell's 1983 book is an information-processing architecture, and GOMS operators are its processing steps with time costs.
Carried by Stuart Card; Thomas Moran; Allen Newell.
Situated Action reacted against GOMS
Suchman's situated-action critique in Plans and Situated Actions (1987) attacked the planning-heavy assumptions of GOMS-style models, arguing from photocopier studies that action is improvised rather than plan-driven.
Carried by Lucy Suchman; Plans and Situated Actions (1987).
Fitts's Law and Human-Performance Modeling influenced by Ergonomics
Fitts's law emerged from the human-factors tradition of measuring operator performance on control tasks; Fitts's experiments on aimed movements were conducted in a military-human-engineering context and gave ergonomics a quantitative law of motor time.
Carried by Paul Fitts.
Information processing influenced by Ergonomics
Human-factors research on radar operators, vigilance, and signal detection supplied information-processing psychology with its experimental tasks and its framing of the human as a limited-capacity channel.
GOMS influenced by Fitts's Law and Human-Performance Modeling
The keystroke-level model in GOMS incorporated Fitts's law as the operator time for pointing movements, making Fitts's law a component of predictive task-time modeling.
Carried by Stuart Card; Thomas Moran; Allen Newell.
Mental Models and Design Metaphor influenced by Information processing
The mental-model concept entered HCI from information-processing psychology's internal representations; Norman's studies of users' device models applied the idea to interface design.
Carried by Donald Norman.
Cognitive load influenced by Information processing
Cognitive load theory took from information-processing psychology the notion of a limited-capacity working memory and the chunking results of Miller, applying them to instructional design.
Carried by John Sweller.
Distributed Cognition reacted against Information processing
Distributed cognition arose as a challenge to the information-processing assumption that cognition is bounded by the individual skull, redefining the unit of analysis to include people, artifacts, and representations.
Carried by Edwin Hutchins.
GOMS influenced by Cognitive architecture
GOMS drew on the cognitive-architecture program, especially Newell's production-system work, and the Model Human Processor was a simplified architecture used to derive GOMS predictions.
Carried by Allen Newell; Stuart Card.
Embodied Interaction influenced by Situated Action
Dourish's embodied interaction drew on the situated-action critique of planning and representation, extending it with phenomenology to argue that meaning arises from bodily engagement.
Carried by Paul Dourish; Where the Action Is (2001).
Embodied Interaction influenced by Distributed Cognition
Embodied interaction took from distributed cognition the idea that cognition is spread across people and artifacts, and pushed further to include bodily skills and social setting.
Carried by Paul Dourish.
Dual process theory influenced by Information processing
Dual-process theory imported into HCI the psychology distinction between automatic and controlled processing, which itself descends from information-processing studies of attention and automaticity.
Beyond the field
Where Cognitive Hci's ideas came from in other fields, and what they led to there: the strongest 12 of 45 links.
Ergonomics led to Cognitive Engineering in Human Factors
Cognitive engineering grew directly out of ergonomics and human factors, taking its concern with fitting work to human capacities and reframing it around mental models and cognitive task analysis. Norman and Rasmussen built on the human-factors tradition rather than starting afresh.
Carried by Donald Norman; Jens Rasmussen.
Ergonomics led to Human-Computer Interaction in Human Factors
HCI is a branch of the ergonomics tradition, inheriting its human-factors methods and applying them to interactive computer systems.
Carried by Stuart Card.
Cognitive architecture influenced Cognitive Tutors in Learning Sciences
The cognitive architecture tradition in human-computer interaction, especially production-system models of the user, provided the modeling machinery that cognitive tutors use to represent and diagnose student knowledge.
Carried by John R. Anderson.
Embodied Interaction influenced by Situated Action in Embodied Interaction
Dourish's embodied interaction explicitly incorporates situated action as one of its two foundations, alongside phenomenology.
Carried by Paul Dourish; Lucy Suchman.
Embodied Interaction influenced by Embodied Cognition in Embodied Interaction
Dourish's embodied interaction was built directly on embodied cognition, taking its rejection of the separation of mind from body and world as the foundation for interaction design.
Carried by Paul Dourish.
Embodied Interaction influenced by Situated Action in Human Computer Interaction
Embodied interaction in HCI took situated action as a direct foundation, treating action as contingent on circumstances rather than plan-driven.
Carried by Paul Dourish; Lucy Suchman.
Embodied Interaction influenced Somaesthetic Interaction Design in Embodied Interaction
Embodied interaction, especially Dourish's phenomenological account, provided the theoretical foundation somaesthetic interaction design extended from interaction-in-the-world to felt somatic experience. Höök built explicitly on this body of work.
Carried by Kristina Höök; Paul Dourish.
Ergonomics influenced Usability Engineering in Human Computer Interaction
Ergonomics contributed the cognitive and physical human-factors basis that usability engineering drew on when setting criteria for interface usability. The passage runs through the human-factors tradition within HCI.
Ergonomics influenced Information Processing and Human Performance in Human Factors
Ergonomics supplied the human performance data and display-control design questions that information-processing accounts of the operator then formalised as channels and processing stages.
Ergonomics led to Macroergonomics in Human Factors
Macroergonomics is a descendant of the ergonomics tradition, retaining its human-centred design stance while raising the level of analysis to teams and organisations.
Carried by Hal W. Hendrick.
Ergonomics influenced by Motion Study in Human Factors
Motion study's time-and-motion analysis of work tasks passed into ergonomics as a technique for analysing and redesigning human work, though ergonomics reframed it around human capacities rather than efficiency alone.
Carried by Frank B. Gilbreth.
Ergonomics influenced by Industrial Fatigue and Applied Psychology in Human Factors
Industrial fatigue research and applied psychology supplied ergonomics with its methods of measuring workload, fatigue and performance, which early human-factors researchers took up in wartime studies.

Cognitive Hci is a planet in Nousfarer
Its city has a tower for each of these 11 frameworks. Land, walk in, and climb one concept at a time.
Land on Cognitive HciRelated fields
Fields its ideas are linked to
- Human Factors 10 links
- Human Computer Interaction 5 links
- Learning Sciences 4 links
- Embodied Interaction 3 links
- Interaction Design 3 links
- Computational Cognitive Science 2 links
- Multiagent Systems 1 link
- Interaction Design Theory 1 link
- Cognitive Science 1 link
- Embodied Cognition 1 link
- Reasoning Decision Making 1 link
- Virtual Reality 1 link