Loading field map
From the earliest days of personal computing, the human body was treated as a problem to be managed: eyes fixed on a screen, fingers poised over a keyboard, the rest of the body rendered irrelevant. But a growing line of inquiry has insisted that interaction is never disembodied. The subfield of embodied interaction in HCI asks a deceptively simple question: which aspects of the body matter for designing interactive systems? The answers have shifted dramatically over the past three decades, producing four major frameworks that continue to shape research and design today. At the heart of the subfield lies a persistent tension between the body as a physical tool for manipulating digital information and the body as a sensing, meaning-making presence that experiences the world from the inside.
The first framework to give the body a central role was Tangible User Interfaces (TUIs), which emerged in the late 1990s. TUIs challenged the prevailing screen-and-mouse paradigm by giving digital information physical form. Instead of clicking on icons, users could grasp, move, and stack physical objects that were computationally augmented. The landmark work of Hiroshi Ishii and Brygg Ullmer at the MIT Media Lab introduced the concept of "tangible bits"—physical representations of digital data that could be manipulated with the hands. TUIs treated the body primarily as a skilled manipulator of objects, drawing on people's everyday ability to handle physical things. This framework narrowed the focus of earlier HCI approaches like Direct Manipulation, which had already emphasized directness but remained anchored to graphical interfaces. TUIs extended that principle into the physical world, arguing that the richness of tangible interaction could make digital information more accessible and intuitive. The framework remains active today, especially in domains like interactive surfaces, museum exhibits, and educational tools, where physical objects serve as both input and output.
Just a few years later, the Embodied Interaction framework, articulated most influentially by Paul Dourish in his 2001 book Where the Action Is, deepened the conversation. Dourish argued that TUIs, while valuable, still treated the body as a mere input device. Drawing on phenomenology—especially the work of Maurice Merleau-Ponty—he proposed that meaning arises from embodied action in a social and physical world. Embodied Interaction shifted the focus from the body as a physical object to the body as a site of lived experience. It challenged the cognitivist assumption that interaction could be understood purely as information processing inside the head. Instead, Dourish insisted that interaction is always situated, embodied, and meaningful. This framework did not replace TUIs but coexisted with them, providing a philosophical foundation that TUIs had lacked. Embodied Interaction opened the door to studying how people make sense of technology through their whole bodies—not just their hands—and how context, culture, and physical setting shape that sense-making. It remains a central theoretical lens in HCI, informing studies of collaborative work, ubiquitous computing, and everyday practice.
By the mid-2000s, researchers began to ask what happens when the body is not just a site of meaning but a source of dynamic, expressive movement. Movement-Based Design emerged from the intersection of dance, choreography, and interaction design. Pioneers like Caroline Hummels, Thecla Schiphorst, and others argued that designing for movement required treating the body's kinetic potential as a primary design material. This framework narrowed the focus of Embodied Interaction: while Embodied Interaction emphasized situated meaning, Movement-Based Design zeroed in on the qualities of movement itself—its rhythm, flow, effort, and spatial relationships. Design methods borrowed from choreography, such as bodystorming and movement sketching, became central. Movement-Based Design also revived interest in the body's expressiveness, which had been somewhat sidelined by TUIs' emphasis on object manipulation. It coexists with Embodied Interaction, but with a different emphasis: where Embodied Interaction asks what an action means, Movement-Based Design asks how the movement feels and what it can communicate. This framework has been especially influential in designing for dance, sports, rehabilitation, and interactive art.
The most recent framework, Somaesthetic Design, emerged around 2007 and pushed the inquiry inward. Inspired by philosopher Richard Shusterman's concept of somaesthetics—the study of the body as a site of sensory appreciation and self-cultivation—researchers like Kristina Höök and colleagues argued that HCI had neglected the internal, felt experience of the body. Somaesthetic Design focuses on first-person, subjective bodily awareness: how we feel our own posture, breath, tension, and emotion. This framework transformed the earlier focus on external movement by turning attention to the inner sensations that accompany action. It also complemented Embodied Interaction by emphasizing that meaning is not only situated in the world but also felt in the body. Somaesthetic Design introduced methods such as somaesthetic appreciation workshops, slow interaction, and design that aims to cultivate bodily awareness rather than efficiency. It remains a vibrant research area, particularly in health, well-being, and mindfulness technologies.
Today, all four frameworks remain active, and researchers often draw on multiple perspectives. They agree on a fundamental point: the body matters for interaction, and cognitivist models that ignore embodiment are incomplete. They also share a commitment to designing for the whole person, not just the visual and cognitive channels. But they disagree on which aspects of the body to prioritize. TUIs emphasize physical manipulation and tangible feedback; Embodied Interaction stresses situated meaning and social context; Movement-Based Design foregrounds dynamic, expressive motion; Somaesthetic Design privileges internal sensory awareness. These differences lead to practical tensions. For example, a system designed for efficient tangible manipulation may ignore the user's felt experience, while a somaesthetic design that encourages slow, mindful interaction may conflict with task-oriented goals. Researchers today navigate these tensions by combining frameworks: a movement-based system might incorporate somaesthetic feedback, or a tangible interface might be designed with attention to the embodied meaning of the objects. The subfield's vitality comes from this ongoing debate about what the body is and what it should be allowed to become in interaction.
Embodied interaction has grown from a niche concern into a central thread in HCI, challenging the field to take the body seriously. Its frameworks offer not a single answer but a set of lenses, each revealing different facets of the human experience of technology.