Loading field map
How does a photograph, a film frame, or a fashion style carry meaning? For Cultural Studies, that question is never purely technical. Meaning is where power lives: who gets to define what a sign means, whose interpretations are heard, and how signs reinforce or unsettle social hierarchies. Semiotics—the study of signs and sign systems—has provided Cultural Studies with its most precise tools for answering those questions, but the tools have changed dramatically as the field has grappled with context, instability, and the material diversity of communication.
The first systematic semiotic framework to enter Cultural Studies was built on the linguistics of Ferdinand de Saussure and the pragmatist philosophy of Charles Sanders Peirce. Saussure’s key move was to define the sign as a two-sided entity: a signifier (the sound or image) and a signified (the concept). Meaning, in this model, arises not from reference to the world but from differences within a closed system—‘cat’ means what it does because it is not ‘cap’ or ‘bat’. Peirce offered a more expansive typology (icon, index, symbol), but it was Saussure’s dyadic, system-centred model that proved most influential for early cultural analysis.
Roland Barthes applied this structuralist apparatus to popular culture in works such as Mythologies (1957). He showed that everyday objects—wine, wrestling, a magazine cover—operate as signs that naturalise bourgeois ideology. A photograph of a Black soldier saluting the French flag, for Barthes, was not a neutral image but a sign that worked to erase colonial history and present French imperialism as a happy, natural fact. The method was powerful because it revealed ideology embedded in the very structure of cultural forms. Yet it treated meaning as something fixed by the code, leaving little room for variation across readers, contexts, or historical change. The sign seemed too stable, the system too closed.
Social Semiotics emerged from the recognition that meaning is not a property of abstract systems but a product of social practice. Where Structuralist Semiotics had focused on the internal relations of the sign, Social Semiotics insisted that signs are made and remade by people in specific historical and institutional settings. The shift was not a rejection of structuralist tools but a reorientation: codes still matter, but they are always negotiated, contested, and transformed through use.
Stuart Hall’s encoding/decoding model (1973) became a landmark of this approach. Hall argued that media producers encode messages with preferred meanings, but audiences can decode them in dominant, negotiated, or oppositional ways. A news report about a strike, for instance, might be encoded to frame workers as unreasonable, but a viewer with trade-union experience could decode it against the grain. This was a direct challenge to the structuralist assumption that the text’s meaning is fully determined by its internal code. Social Semiotics also expanded the range of sign systems under study: it treated images, gestures, sound, and spatial arrangement as equally meaningful, not merely as illustrations of linguistic structures.
Michael Halliday’s functional linguistics provided theoretical backbone, especially the idea that language is shaped by the social functions it serves. Semioticians such as Gunther Kress and Robert Hodge adapted Halliday’s insights to argue that sign-making is always motivated by the interests of the sign-maker. A child’s drawing, a newspaper layout, or a protest placard are not arbitrary expressions of a code; they are purposeful acts of communication embedded in power relations. Social Semiotics thus preserved the structuralist concern with systematicity while opening the sign to history, conflict, and creativity.
Running alongside Social Semiotics, and partly overlapping with it, Post-Structuralist Semiotics pushed the critique of sign stability much further. Drawing on Jacques Derrida’s deconstruction and Michel Foucault’s analyses of discourse, post-structuralist thinkers argued that meaning is never fully present or fixed. Derrida’s concept of différance suggested that every sign refers not to a stable concept but to an endless chain of other signs; meaning is perpetually deferred. Foucault, meanwhile, shifted attention from the sign itself to the discursive formations that govern what can be said, by whom, and with what authority.
In Cultural Studies, Post-Structuralist Semiotics had its greatest impact on theories of identity and power. If the sign is inherently unstable, then categories such as ‘race’, ‘gender’, and ‘class’ are not natural kinds but contingent constructions that can be rearticulated. Judith Butler’s work on performativity, for example, drew on Derrida and Foucault to argue that gender is not an inner essence expressed through signs but a repeated performance that produces the illusion of a stable identity. This was a radical departure from both Structuralist Semiotics, which treated identity categories as products of a fixed code, and from early Social Semiotics, which still assumed a relatively stable subject who makes and interprets signs.
Post-Structuralist Semiotics never became a self-contained school within Cultural Studies in the way that Social Semiotics did. Instead, its insights were absorbed into feminist, queer, postcolonial, and critical race frameworks. The idea that signs are constitutively unstable now underpins much of the field’s work on representation and ideology, even when researchers do not label themselves post-structuralist. The framework’s legacy is a permanent scepticism toward any claim that a sign has a single, final meaning.
Multimodal Semiotics grew directly out of Social Semiotics, but it responded to a practical pressure that earlier frameworks had not fully addressed: how to analyse texts that combine multiple semiotic modes—image, writing, speech, gesture, colour, layout, sound—in a single communicative event. A website, a film, a textbook page, or a museum exhibit does not just use different modes side by side; it integrates them into a coherent whole whose meaning cannot be captured by analysing each mode separately.
Gunther Kress and Theo van Leeuwen’s Reading Images: The Grammar of Visual Design (1996) provided the foundational toolkit. They adapted Halliday’s three metafunctions (ideational, interpersonal, textual) to visual communication, showing how images represent the world, construct relationships with viewers, and form coherent compositions. A photograph’s angle, framing, and colour saturation, for instance, are not decorative choices but meaningful resources that carry social and ideological weight. Multimodal Semiotics thus extended the social-semiotic principle that all sign-making is motivated, but it gave analysts a more precise vocabulary for describing how different modes interact—how an image can anchor the meaning of a caption, or how typography can reinforce or undermine the authority of written text.
Today, Multimodal Semiotics is the most active and institutionally visible framework within the subfield. Its methods are widely used to analyse digital media, advertising, classroom materials, scientific diagrams, and user interfaces. The framework has also absorbed some post-structuralist caution about fixed meaning: Kress and van Leeuwen emphasise that multimodal texts are open to interpretation and that the ‘grammar’ they describe is not a rigid code but a set of resources shaped by social context.
Social Semiotics and Multimodal Semiotics are the two leading frameworks in contemporary semiotics within Cultural Studies. They agree on several core commitments: meaning is socially produced, sign-making is motivated by the interests of makers, and analysis must attend to the material and institutional conditions in which signs circulate. Both frameworks also reject the structuralist idea of a closed, autonomous code.
Their disagreements are productive. Social Semiotics tends to foreground the social context of sign production and reception—who makes signs, for whom, and under what constraints. Multimodal Semiotics, while sharing that concern, places more emphasis on the material properties of modes themselves: what each mode can and cannot do, how modes interact, and how the affordances of a medium (print, screen, face-to-face interaction) shape meaning. A second tension concerns the stability of the sign. Social Semiotics, especially in Hall’s encoding/decoding tradition, still treats texts as having a preferred meaning that can be negotiated or resisted. Post-Structuralist Semiotics, whose influence lingers in much contemporary theory, insists that no such preference is ever fully stabilised. Multimodal Semiotics has largely sidestepped this debate by focusing on the descriptive grammar of multimodal texts rather than on the metaphysics of meaning.
Post-Structuralist Semiotics no longer operates as a distinct school, but its critique of sign stability remains a live challenge for both Social and Multimodal approaches. Researchers who draw on post-structuralist ideas often argue that multimodal analysis, in its search for systematic patterns, risks re-imposing a kind of structuralist closure that the post-structuralist critique had undone. That tension—between the need for analytical rigour and the recognition that meaning is never fully fixed—is the central methodological debate in semiotics today.