Innovation And R And D
Innovation is the part of economic life where firms deliberately try to make their own markets obsolete.
7 frameworks, from 1942 to today · Industrial Organization · Economics
- Creative destruction 1942-Present
- Appropriability and the Public-Good Theory of Knowledge 1959-Present
- Demand-Pull versus Technology-Push 1966-1985
- Patent Race and Preemption Models 1968-Present
- Endogenous growth theory 1986-Present
- Structural Empirical IO of R&D 1990-Present
- Escape Competition and Distance to the Frontier 1998-Present
Overview
Innovation is the part of economic life where firms deliberately try to make their own markets obsolete. A new product can create a market that did not exist; a new process can let one firm undercut every rival; a new business model can rearrange who holds power in an industry. Industrial organization (IO)—the branch of economics that studies how firms and markets actually work—has therefore treated innovation as both a source of competition and a threat to it. The subfield of innovation and R&D in IO asks a set of linked questions: why do firms spend on research when the results are uncertain and easily copied? Does market power encourage innovation or smother it? How do patents, secrecy, and lead time shape who captures the gains? And how should competition authorities treat a merger or a dominant firm when the relevant market is being transformed from within?
What makes the field distinctive is that its central object—knowledge—behaves unlike ordinary goods. It is costly to produce but cheap to reuse, hard to keep inside a firm, and often valuable only in combination with other knowledge. Much of the history below is the story of economists learning to model that oddity, and then learning to measure it.
Schumpeter and the Creative Destruction of Market Structure
The field's founding provocation came from Joseph Schumpeter1. In Capitalism, Socialism and Democracy (1942) he argued that the relevant competition in modern capitalism is not price competition among many small firms but the competition from a new product, technique, or organization that threatens existing firms' very existence—"creative destruction."2 Schumpeter also suggested, in a famous and much-debated passage, that large firms with some market power may be the main engine of technical progress, since they can fund research and appropriate its rewards.
This posed a sharp question for IO: the standard structure–conduct–performance tradition held that concentrated markets produced poor outcomes, yet Schumpeter implied concentration might buy faster innovation. The empirical answer came in stages. In the 1960s and 1970s, economists such as Jacob Schmookler and later studies of patents and R&D spending found only weak or ambiguous correlations between firm size and inventive output—large firms did more R&D in absolute terms, but not clearly more per dollar or per employee. The Schumpeterian hypothesis survived as a set of distinct claims (about firm size, about market power, about the importance of new entrants) that empirical work has treated separately ever since.
Demand-Pull, Technology-Push, and the Turn to Empirical R&D Studies
A second strand asked where the demand for invention comes from. Schmookler's Invention and Economic Growth (1966) argued, using historical patent data across industries such as railroads and agriculture, that inventive activity responds to expected profitability—demand pulls invention—rather than invention arriving exogenously and pulling growth. This "demand-pull" view competed with a "technology-push" view in which scientific opportunity drives innovation independently of market conditions. The debate mattered because it changed what IO researchers looked for: not just the supply of scientists and labs but the market signals that direct them.
The same period produced the first systematic R&D statistics. The U.S. National Science Foundation began collecting industrial R&D data in the 1950s, and economists used these surveys to study how R&D spending varied with firm size, industry, and expected returns. These empirical studies established the basic regularities—R&D is concentrated in a minority of firms, is persistent within firms, and responds to appropriability conditions—that later theory would try to explain.
Appropriability: Why Knowledge Is Hard to Own
The pivotal theoretical move was to treat knowledge as a partially public good3. Kenneth Arrow's 1962 essay on economic welfare and the allocation of resources for invention made the case crisply: information is costly to produce but, once produced, can be reproduced at near-zero marginal cost, and it is difficult to exclude others from using it. Left to itself, a market would therefore underinvest in invention relative to the social optimum.
This created the field's central trade-off. Patents and other intellectual property rights solve the underinvestment problem by granting temporary exclusivity, but that exclusivity creates deadweight loss—prices above marginal cost—and can block follow-on innovation. Richard Nelson (1959) and Arrow framed the problem; later work by economists such as Edwin Mansfield measured how firms actually protect innovations, finding that for many industries patents were less important than lead time, learning-curve advantages, and secrecy. The "appropriability regime"—how easily an innovator can capture the returns—became a standard variable in the analysis, and it explained why innovation rates differ so much across industries even when R&D spending is similar.
Patent Races and Preemption: Innovation as a Game
From the late 1960s onward, IO theorists began modeling innovation as a race. The key insight, developed in work by William Fellner, Morton Kamien and Nancy Schwartz, and later Glenn Loury and others, is that the reward for invention is often "winner-take-all": the first firm to patent or to market gets the prize, while losers recover little. This turns R&D into a strategic game with preemption—firms invest not only for the expected return but to deny rivals the prize.
The game-theoretic literature produced sharp and sometimes counterintuitive results. Under certain conditions, competition in R&D can lead to overinvestment relative to the social optimum, because each firm's private race duplicates effort that a coordinated planner would avoid. The "patent race" model also showed how the structure of the prize (a patent of fixed length, a market lead, a standard) shapes investment. These models gave IO a language for analyzing rivalrous innovation that pure Schumpeterian reasoning lacked, and they connected directly to antitrust questions about whether incumbent firms can preempt entrants by patenting around them.
Endogenous Growth and Knowledge Spillovers
In the 1980s and 1990s, the innovation question migrated into macroeconomics. Paul Romer's endogenous growth models (beginning in the mid-1980s) treated knowledge as a nonrival input that could generate increasing returns, so that investment in R&D could sustain long-run growth rather than merely producing a one-time level effect. This was a major shift: innovation became central to growth theory, not a residual.
For IO, the crucial concept was the spillover—the uncompensated transmission of knowledge from one firm or region to another4. Empirical work by economists such as Zvi Griliches and later Adam Jaffe, Manuel Trajtenberg, and Rebecca Henderson used patent citations to trace spillovers, finding that firms' R&D productivity depends on the research done by others, especially those geographically or technologically close. The spillover concept explained why firms cluster (Silicon Valley, biotech hubs) and why public policy might justify subsidizing R&D even in competitive markets. It also complicated the appropriability story: spillovers are a leakage that weakens private incentives but a benefit that raises social returns.
Escape Competition and Distance to the Frontier
A major synthesis came from Philippe Aghion and Peter Howitt's Endogenous Growth Theory (1998), which built Schumpeterian growth models in which innovation is driven by the prospect of temporary monopoly profits. Their "escape competition" result—that firms facing more competition may innovate more, because they need to escape rivals' pressure—challenged the simple Schumpeterian intuition that market power is good for innovation.
The resolution came through the "distance to the frontier" idea, developed by Aghion, Howitt, and later coauthors including Rachel Griffith and Fabrizio Zilibotti. For firms already near the technological frontier, competition can spur innovation because they can only survive by innovating; for firms far behind the frontier, competition may discourage innovation because they earn enough from imitation or from protected niches. This framework helped reconcile conflicting empirical findings across countries and industries, and it became a standard lens for thinking about how competition policy affects innovation in different settings—a question with direct antitrust consequences.
Structural Empirical IO of R&D
The most recent turn is methodological. Following the broader "empirical revolution" in IO, researchers have moved from reduced-form correlations to structural estimation: building explicit models of firm behavior—dynamic investment in R&D, entry and exit, patenting—and estimating their parameters from data, then using the estimated model to simulate counterfactuals such as a merger, a change in patent length, or an R&D subsidy.
Work in this vein, associated with economists such as Ariel Pakes and later many others, treats R&D as a dynamic investment problem with uncertainty and sunk costs. It allows researchers to ask questions that reduced-form data cannot answer: how much would a merger reduce innovation? What is the social return to a subsidy? How do firms' expectations about future competition shape current research? The approach is demanding—it requires rich data and strong modeling assumptions—but it has become the frontier for policy-relevant questions, especially in merger review and the evaluation of innovation policy.
The Present: Open Questions
Today the field is defined by several live tensions. The first is measurement: R&D spending is an input, not an output, and economists still struggle to measure innovation itself—patents are noisy, and much innovation (process improvements, organizational change, software) leaves little trace. The second is the effect of market structure: the Schumpeterian trade-off between static competition and dynamic innovation remains unresolved, and the rise of dominant digital platforms has made it urgent again. The third is appropriability in a world of complex, cumulative technologies, where a single product may infringe dozens of patents and where "patent thickets" can slow rather than spur innovation. The fourth is the geography of innovation: spillovers are local, but research is increasingly global, and the policy implications are unsettled.
What unites the field is a commitment to treating innovation as an economic activity with identifiable costs, rewards, and strategic interactions—not as an exogenous gift. The history above is the record of IO learning to model that activity, then to measure it, and now to estimate its consequences with enough precision to inform competition policy and innovation policy alike.
References
- Innovation (Economics and innovation, 20th and 21st centuries), Wikipedia
- Creative destruction, Wikipedia
- Internalization theory, Wikipedia
- Knowledge spillover, Wikipedia
The frameworks of Innovation And R And D
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1942-Present
- 1959-Present
Appropriability and the Public-Good Theory of Knowledge
Why do firms underinvest in knowledge?
- 1966-1985
Demand-Pull versus Technology-Push
What drives the direction of invention?
- 1968-Present
- 1986-Present
- 1990-Present
- 1998-Present
Escape Competition and Distance to the Frontier
When does competition spur innovation?
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Escape Competition and Distance to the Frontier grew out of Endogenous growth theory
Aghion and Howitt's escape competition model is a direct outgrowth of their endogenous growth framework, adding the distance-to-frontier dimension to explain when competition spurs innovation. The 1998 book Endogenous Growth Theory presented the synthesis.
Carried by Philippe Aghion; Peter Howitt; Endogenous Growth Theory (1998).
Appropriability and the Public-Good Theory of Knowledge influenced by Creative destruction
Schumpeter's framing of innovation as the central competitive process set the question that appropriability theory answered: how can firms capture returns from innovation when knowledge is a public good? Nelson (1959) and Arrow (1962) built directly on the Schumpeterian premise that innovation is costly and uncertain.
Carried by Joseph Schumpeter; Richard Nelson; Kenneth Arrow.
Demand-Pull versus Technology-Push influenced by Creative destruction
Schmookler's demand-pull thesis was framed as a challenge to the technology-push view, but it also engaged Schumpeter's claim that inventive activity responds to expected monopoly profits. The debate over whether demand or scientific opportunity drives invention grew out of the Schumpeterian question of what motivates innovation.
Carried by Jacob Schmookler; Invention and Economic Growth (1966).
Patent Race and Preemption Models influenced by Creative destruction
The patent race literature formalized Schumpeter's insight that innovation is a winner-take-all contest for temporary monopoly. Fellner, Kamien and Schwartz, and Loury turned the Schumpeterian vision of creative destruction into a game-theoretic model of preemptive R&D.
Carried by William Fellner; Morton Kamien; Nancy Schwartz.
Endogenous growth theory influenced by Creative destruction
Endogenous growth theory revived Schumpeter's vision of innovation as the engine of capitalist growth, formalizing creative destruction in general equilibrium. Romer and later Aghion and Howitt made the Schumpeterian process the core of growth theory.
Carried by Paul Romer; Philippe Aghion; Peter Howitt.
Escape Competition and Distance to the Frontier influenced by Creative destruction
The escape competition result directly challenged the simple Schumpeterian hypothesis that market power fosters innovation, reframing creative destruction as a force that can be strengthened by competition. Aghion and Howitt built their model as a Schumpeterian growth model with an inverted-U relationship.
Carried by Philippe Aghion; Peter Howitt.
Patent Race and Preemption Models influenced by Appropriability and the Public-Good Theory of Knowledge
The patent race models took the appropriability problem—that knowledge is hard to own—and made it strategic: firms race to be first precisely because the patent grants exclusivity. The public-good nature of knowledge, as framed by Nelson and Arrow, is the premise that makes the race winner-take-all.
Carried by Kenneth Arrow; Richard Nelson.
Endogenous growth theory influenced by Appropriability and the Public-Good Theory of Knowledge
Endogenous growth theory built on the appropriability framework by modeling knowledge as a nonrival good with spillovers. Romer's models formalized the trade-off between private incentives and social returns that Arrow had identified, making it the engine of long-run growth.
Carried by Paul Romer; Kenneth Arrow.
Structural Empirical IO of R&D influenced by Appropriability and the Public-Good Theory of Knowledge
Structural empirical IO of R&D built on the appropriability framework by estimating how firms actually capture returns, using data on patents, R&D, and spillovers. The empirical measurement of appropriability conditions, pioneered by Mansfield, became a core input to structural models.
Carried by Edwin Mansfield; Zvi Griliches.
Endogenous growth theory influenced by Patent Race and Preemption Models
Endogenous growth theory incorporated the patent race structure—temporary monopoly as the reward for innovation—into macroeconomic models. The Schumpeterian growth models of Aghion and Howitt later formalized this link directly.
Carried by Paul Romer; Philippe Aghion; Peter Howitt.
Structural Empirical IO of R&D influenced by Patent Race and Preemption Models
Structural empirical models of R&D investment and patenting adopted the dynamic game structure of patent races, estimating the parameters of preemption and entry models. The theoretical race models provided the behavioral foundations for structural estimation.
Structural Empirical IO of R&D influenced by Endogenous growth theory
The spillover concept from endogenous growth theory became a central object of structural estimation, with researchers using patent citations to measure knowledge flows. The empirical spillover literature by Jaffe, Trajtenberg, and Henderson directly informed structural models of R&D productivity.
Carried by Adam Jaffe; Manuel Trajtenberg; Rebecca Henderson.
Escape Competition and Distance to the Frontier influenced by Patent Race and Preemption Models
The escape competition framework inherited the game-theoretic structure of patent races, modeling innovation as a strategic response to rivals. The distance-to-frontier idea added heterogeneity among firms to the race framework.
Carried by Philippe Aghion; Peter Howitt.
Beyond the field
Where Innovation And R And D's ideas came from in other fields, and what they led to there: the strongest 12 of 14 links.
Creative destruction influenced Schumpeterian Growth Theory in Growth Theory
The creative-destruction idea from Schumpeter's Capitalism, Socialism and Democracy supplies the central mechanism of Schumpeterian growth models: new innovations displace incumbent products and firms. Aghion and Howitt's 1992 model is explicitly built on this obsolescence mechanism.
Carried by Joseph Schumpeter; Capitalism, Socialism and Democracy (1942); Philippe Aghion.
Creative destruction influenced Disruptive innovation in Innovation Management
Schumpeter's 1942 formulation of creative destruction in Capitalism, Socialism and Democracy is the source Christensen drew on for disruptive innovation. The idea that new entrants destroy established firms through innovation is carried over directly.
Carried by Joseph A. Schumpeter; Capitalism, Socialism and Democracy (1942); Clayton M. Christensen.
Appropriability and the Public-Good Theory of Knowledge influenced by Pure Theory of Public Expenditure in Public Goods Theory
Arrow's 1962 paper on economic welfare and the allocation of resources for invention explicitly built on Samuelson's 1954 pure theory of public expenditure, applying the non-rivalry criterion to knowledge and concluding markets underprovide it.
Carried by Kenneth Arrow; Paul Samuelson; The Pure Theory of Public Expenditure (1954).
Endogenous growth theory led to Schumpeterian Growth Theory in Growth Theory
Schumpeterian growth theory is a branch of endogenous growth theory: it keeps the endogenous-growth premise that growth is generated within the model by investment in knowledge, but replaces the earlier accumulation-based mechanisms with innovation and creative destruction. Aghion and Howitt's 1992 paper was presented as an alternative within the endogenous growth programme.
Carried by Philippe Aghion; Peter Howitt; Paul Romer.
Structural Empirical IO of R&D grew out of New Empirical Industrial Organization in Market Structure Theory
Structural empirical IO of R&D is a branch of the new empirical industrial organization, which pioneered estimating structural models of firm conduct and market outcomes from data.
Creative destruction influenced by Marxian Economics in History Of Economic Thought
Schumpeter built his theory of capitalist evolution in explicit dialogue with Marx's account of capitalism's dynamics, taking over the idea of an inherently transformative economic system while rejecting Marx's labor theory and socialist conclusions.
Carried by Joseph A. Schumpeter; Capitalism, Socialism and Democracy (1942).
Appropriability and the Public-Good Theory of Knowledge influenced R&D Portfolio Management in Innovation Management
Arrow's analysis of knowledge as a public good and the resulting appropriability problem gave R&D portfolio management its central justification for internalizing research and choosing projects by appropriability. Portfolio decisions about which projects to fund turned on this economics of knowledge.
Carried by Kenneth Arrow.
Appropriability and the Public-Good Theory of Knowledge influenced Knowledge Stickiness and Transfer in Organizational Knowledge
The economics of knowledge as a public good, with its problems of appropriability and spillovers, shaped how the stickiness and transfer literature framed knowledge as hard to contain and costly to move. Arrow's analysis of information as a public good is the source of these concepts.
Carried by Kenneth Arrow.
Patent Race and Preemption Models influenced by Patent in Intellectual Property Law
Patent-race models take the patent as the object of competition, analyzing how the prospect of exclusive rights induces firms to race for invention; the modern patent institution is the prize structure they model.
Patent Race and Preemption Models influenced by Bargain-for-Disclosure Model in Patent Law
The bargain-for-disclosure justification of patents, that the monopoly reward buys public disclosure of the invention, is the welfare rationale that patent-race models formalize and test against the racing cost.
Endogenous growth theory influenced by Schumpeterian innovation and creative destruction in Entrepreneurship
The Schumpeterian innovation and creative destruction tradition supplied the core mechanism that endogenous growth theorists formalized as quality-ladder models of growth through innovation.
Carried by Philippe Aghion; Peter Howitt.
Endogenous growth theory influenced by Schumpeterian Innovation Economics in Innovation Management
Schumpeterian growth models, notably Aghion and Howitt's 1992 work, formalized Schumpeter's creative destruction as quality-ladder growth, making innovation and its destruction of rents the engine of endogenous growth.
Carried by Philippe Aghion; Peter Howitt.

Innovation And R And D is a planet in Nousfarer
Its city has a tower for each of these 7 frameworks. Land, walk in, and climb one concept at a time.
Land on Innovation And R And DRelated fields
Fields its ideas are linked to
- Innovation Management 4 links
- Growth Theory 2 links
- Entrepreneurship 1 link
- History Of Economic Thought 1 link
- Intellectual Property Law 1 link
- Patent Law 1 link
- Comparative Business Systems 1 link
- Organizational Knowledge 1 link
- Market Structure Theory 1 link
- Public Goods Theory 1 link
More in Industrial Organization
See where Innovation And R And D sits on the Map of Human Knowledge