- Atlas
- Computer Science
- Graphics Rendering
Graphics Rendering
Rendering is the part of computer graphics that turns a scene description—shapes, materials, lights, and a camera—into an image.
11 frameworks, from 1967 to today · Computer Graphics · Computer Science
- Local Shading Models 1967-1995
- Hidden-Surface Determination 1970-1985
- Graphics pipeline 1980-Present
- Recursive Ray Tracing 1980-Present
- Radiosity 1984-2000
- Volume Rendering 1985-Present
- Monte Carlo Light Transport 1986-Present
- The Rendering Equation 1986-Present
- Image-Based Rendering 1991-Present
- Physically Based Rendering 2004-Present
- Neural Rendering 2017-Present
Overview
Rendering is the part of computer graphics that turns a scene description—shapes, materials, lights, and a camera—into an image1. The description might be a list of triangles, a mathematical surface, a cloud of particles, or a set of photographs1. The image might be a single frame for a film, a view in a video game that must appear sixty times a second, or a medical scan made visible. What is at stake is a three-way tension that has defined the field since the 1960s: an image should be convincing (physically or perceptually plausible), fast (cheap enough in time and memory for its purpose), and controllable (artists and engineers can predict and direct what comes out). Every era of rendering has answered that tension differently, and the answers have shaped film, design, medicine, and the screens in daily life.
The 1960s: Lines, Hidden Surfaces, and the First Shading
Early computer graphics grew out of military and scientific plotting2. Ivan Sutherland's Sketchpad (1963) let a user draw and manipulate line figures interactively, and the first displays drew only lines—vectors—not filled surfaces. The immediate problem was that a scene of solid objects drawn as wireframes is ambiguous: which edge is in front3? Hidden-surface determination became the first great rendering problem. The Watkins algorithm (1970) and later the z-buffer, developed at the University of Utah by Edwin Catmull and others around 1974, solved it by storing, for each pixel, the depth of the nearest surface found so far. The z-buffer's simplicity—compare depths, keep the closer one—made it the foundation of nearly all real-time rendering that followed14.
Filling surfaces raised the next question: what colour should a surface be? In 1967 Henri Gouraud introduced smooth shading, interpolating colours across a polygon's interior so that faceted models looked curved. Bui Tuong Phong's 1975 shading model went further, computing a highlight from the angle between the surface, the light, and the viewer15. These local shading models treat each point independently, using only the light that arrives directly from sources6. They are cheap and were enormously influential, but they cannot produce shadows, reflections between objects, or the soft light of a room—because that light depends on the rest of the scene.
The 1970s–1980s: Ray Tracing and the Idea of Global Light
A different strategy appeared in 1968, when Arthur Appel cast rays from the eye through each pixel to find what it hits—an early form of ray casting17. Turner Whitted's 1980 paper on recursive ray tracing made the idea powerful: when a ray hits a shiny surface, spawn a reflected ray; when it hits glass, spawn a refracted one; follow these recursively and combine the results189. For the first time a simple algorithm produced mirror reflections and transparent glass, and it did so elegantly1. Its weakness was cost and aliasing—one ray per pixel gives hard edges and misses small details—and it still handled only perfect mirrors, not the blurry reflections of real materials1.
Meanwhile the question of global light—light that bounces between surfaces—was being attacked from another direction. In 1984, researchers at Cornell (Cindy Goral, Kenneth Torrance, Donald Greenberg, and Bennett Battaile) adapted a method from thermal engineering called radiosity. They divided surfaces into patches, computed how much light each patch exchanged with every other, and solved the resulting system1. Radiosity gave soft, physically plausible indirect light and contact shadows, and it was view-independent: solve once, then look from anywhere. Its limitation was that it assumed surfaces diffuse light evenly, so it could not do glossy highlights or mirrors1. For a time, radiosity and ray tracing were seen as complementary rivals—one for soft diffuse light, one for sharp specular effects—and hybrid systems combined them.
1986: The Rendering Equation Unifies the Field
The conceptual turning point came in 1986, when James Kajiya and, independently, David Immel and colleagues formulated the rendering equation110. It states, in one integral, that the light leaving a point in a direction equals the light it emits plus the light arriving from every other direction, weighted by how the surface reflects it10. This was not a new algorithm but a unifying statement: radiosity, ray tracing, and local shading were all approximations of the same equation. It gave the field a common language and a target.
The equation's integral is generally impossible to solve exactly, so the practical answer was Monte Carlo light transport: estimate the integral by taking random samples of light paths and averaging19. Kajiya's 1986 paper introduced path tracing, which follows randomly chosen bouncing paths from the camera19. The method is conceptually simple and handles arbitrary materials and geometry, but early images were noisy, because random sampling converges slowly—noise falls only as the square root of the number of samples. Making Monte Carlo practical became a decades-long project: better sampling strategies, importance sampling (concentrating samples where they matter), and variance-reduction techniques gradually turned a beautiful but impractical idea into the backbone of film-quality rendering19.
The 1980s–1990s: The Rasterization Pipeline and Real-Time Graphics
While offline rendering pursued physical accuracy, interactive graphics took a different path. The rasterization pipeline—the hardware-and-software assembly line that projects triangles onto the screen, fills pixels, and shades them—became the standard for real-time work111. Its logic is the opposite of ray tracing's: instead of asking what each pixel sees, it takes each triangle and asks which pixels it covers1. The pipeline's stages (vertex transformation, clipping, rasterization, texturing, shading) map naturally onto parallel hardware, and by the late 1990s consumer graphics cards implemented it in silicon1. Texture mapping, developed in the 1970s and refined through the 1980s, let a flat polygon carry a detailed image, multiplying apparent realism at little cost. The pipeline's limitation was that it approximated global light poorly—shadows, reflections, and indirect bounce had to be faked with tricks like shadow maps (Lance Williams, 1978) and environment maps112.
The 1980s–1990s: Volumes and Images as Scene Descriptions
Two further expansions changed what a "scene" could be. Volume rendering addressed data that is not a surface but a field—a cloud, smoke, or a CT scan—where every point in space has a density or value131. Ray casting through such a volume, accumulating colour and opacity, made medical visualization and later realistic smoke and fire possible; the technique matured through the 1980s and 1990s. Image-based rendering took the opposite route: instead of modeling geometry, start from photographs14. Light fields and plenoptic functions, formalized in the 1990s, describe how light varies across space and direction, and techniques such as view morphing and layered depth images showed that convincing new viewpoints could be synthesized from a set of captured images. The appeal was fidelity and speed—real photographs carry detail no model can match—while the limitation was that you could only move so far from the captured views.
The 2000s–2010s: Physically Based Rendering Matures
The 2000s saw the rendering equation's promise realized in production. The book Physically Based Rendering (first edition 2004, by Matt Pharr and Greg Humphreys) codified the theory and practice of Monte Carlo rendering, and the field converged on physically based materials—descriptions of how surfaces reflect light that obey energy conservation15. Bidirectional methods, which trace paths from both the camera and the lights, and Metropolis light transport (1997) helped with difficult scenes19. By the 2010s, path tracing was producing photorealistic visual effects in film, and the same ideas began migrating to real time as GPUs grew more programmable.
The 2010s–Present: Learning to Render
The most recent turn is neural rendering: using machine learning, especially neural networks, to produce or accelerate images1. Its roots run through learned image synthesis and the use of deep networks to denoise Monte Carlo renders—a technique that lets a noisy, low-sample image be cleaned up convincingly, dramatically cutting render times1. A landmark came in 2020 with Neural Radiance Fields (NeRF), which represent a scene as a neural network mapping position and viewing direction to colour and density, trained from a handful of photographs and rendered by ray marching116. Gaussian splatting (2023) offered a faster, explicit alternative117. These methods blur the old boundaries: they are image-based in their inputs, volumetric in their representation, and learned in their machinery1. They inherit the field's oldest ambition—turn a description into a convincing picture—while raising new questions about how to control, edit, and trust images produced by networks rather than equations.
Where Rendering Stands
Today two broad families coexist1. Real-time rasterization, now augmented with ray-traced shadows and reflections on dedicated hardware, dominates games and interactive tools1. Offline Monte Carlo path tracing dominates film and product visualization, where accuracy matters more than speed1. Around them, volume rendering serves science and effects, image-based and neural methods serve capture and synthesis, and the rendering equation remains the common reference point against which every approximation is measured. The open questions are familiar in new clothes: how to make learned renderers controllable and editable; how to render at interactive rates without sacrificing physical correctness; and how to represent scenes—geometry, images, or networks—when the goal is not just a picture but a manipulable world.
References
- Rendering (computer graphics) (introduction, 3D geometry, Photogrammetry and scanning, Rasterization, Chronology of algorithms and techniques, Ray casting, Ray tracing, Techniques, Radiosity, Path tracing, History, Volumetric data, Machine learning, Neural approximations and light fields), Wikipedia
- Computer graphics (History), Wikipedia
- Hidden-surface determination, Wikipedia
- Z-buffering, Wikipedia
- Phong reflection model (introduction, History), Wikipedia
- Shading, Wikipedia
- Ray tracing (graphics) (History), Wikipedia
- J. Turner Whitted, Wikipedia
- Path tracing (History, introduction), Wikipedia
- Rendering equation, Wikipedia
- Graphics pipeline, Wikipedia
- Shadow mapping, Wikipedia
- Volume rendering, Wikipedia
- Image-based modeling and rendering, Wikipedia
- Physically based rendering (History), Wikipedia
- Neural radiance field, Wikipedia
- Gaussian splatting, Wikipedia
The frameworks of Graphics Rendering
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1967-1995
Local Shading Models
How should a surface's colour be computed from its lights?
- 1980-Present
- 1980-Present
Recursive Ray Tracing
How can mirrors and glass be drawn by following rays?
- 1984-2000
- 1985-Present
- 1986-Present
Monte Carlo Light Transport
How can random samples estimate the light arriving at a point?
- 1986-Present
- 1991-Present
- 2004-Present
Physically Based Rendering
How can rendering be made physically accurate and practical?
- 2017-Present
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Physically Based Rendering grew out of Monte Carlo Light Transport
Physically based rendering codified Monte Carlo light transport into production practice, with the 2004 Pharr and Humphreys book systematizing sampling, materials and integrators built on path tracing.
Carried by Matt Pharr; Greg Humphreys; Physically Based Rendering (2004).
Monte Carlo Light Transport grew out of The Rendering Equation
Monte Carlo light transport, introduced as path tracing in Kajiya's 1986 paper, was presented as the practical way to estimate the integral of the rendering equation by random sampling.
Carried by James Kajiya.
Graphics pipeline influenced by Local Shading Models
The rasterization pipeline carried local shading models into real-time hardware, computing Gouraud and Phong shading per vertex or per pixel as stages of the assembly line.
Recursive Ray Tracing influenced by Local Shading Models
Whitted's recursive ray tracing kept the local shading models' per-point lighting computation as the shading step at each ray hit, adding reflection and refraction rays around it.
Carried by Turner Whitted.
Graphics pipeline influenced by Hidden-Surface Determination
The z-buffer, developed as a hidden-surface method at the University of Utah, became the depth-test stage of the rasterization pipeline and remains its visibility mechanism.
Carried by Edwin Catmull.
Recursive Ray Tracing influenced by Hidden-Surface Determination
Ray casting for visible-surface determination, as in Appel's 1968 work, was the direct ancestor of Whitted's recursive ray tracing, which reused the eye-ray visibility test and extended it with secondary rays.
Carried by Arthur Appel; Turner Whitted.
Radiosity rival of Recursive Ray Tracing
Recursive ray tracing and radiosity competed through the 1980s as complementary answers to global illumination, one handling specular reflection and the other diffuse interreflection; hybrid systems combined them.
Monte Carlo Light Transport influenced by Recursive Ray Tracing
Path tracing grew out of recursive ray tracing by replacing the deterministic reflection and refraction rays with randomly sampled directions, keeping the recursive ray-following structure.
Carried by James Kajiya.
The Rendering Equation influenced by Recursive Ray Tracing
Kajiya's formulation of the rendering equation generalized the light transport that recursive ray tracing approximated, treating reflection and refraction as terms of a single integral.
Carried by James Kajiya.
The Rendering Equation influenced by Radiosity
Radiosity's patch-based light exchange was one of the approximations the rendering equation unified, showing diffuse interreflection as a special case of the general transport integral.
Carried by James Kajiya.
Neural Rendering influenced by Volume Rendering
Neural radiance fields represent a scene as a network mapping position and direction to colour and density and render it by ray marching through the volume, directly inheriting volume rendering's accumulation of density along rays.
Carried by NeRF (2020).
Physically Based Rendering influenced by The Rendering Equation
Physically based rendering took the rendering equation as its governing statement, building materials and integrators that conserve energy and solve that integral approximately.
Carried by Matt Pharr; Greg Humphreys.
Neural Rendering influenced by Image-Based Rendering
Neural rendering methods such as NeRF take sets of photographs as input and synthesize novel views, continuing image-based rendering's project of building scenes from captured images rather than modelled geometry.
Carried by NeRF (2020).
Radiosity influenced by Local Shading Models
Radiosity replaced the local shading models' direct-light-only assumption with patch-to-patch light exchange, addressing the shadows and indirect light that local models could not produce.
Carried by Cindy Goral; Kenneth Torrance; Donald Greenberg.
The Rendering Equation replaced Local Shading Models
Local shading models became, in the rendering equation, the limiting case where only direct emission from light sources is counted and interreflection is dropped.
Carried by James Kajiya.
Image-Based Rendering influenced by Graphics pipeline
Image-based rendering borrowed the pipeline's texture-mapping machinery, using images as textures on simple geometry to synthesize new viewpoints cheaply.
Beyond the field
Where Graphics Rendering's ideas came from in other fields, and what they led to there: the strongest 12 of 49 links.
Local Shading Models replaced by Global illumination in Computer Graphics
Global illumination replaced local shading models, which computed surface colour from direct light only, with methods that account for interreflected light. Whitted's recursive ray tracing and later radiosity and rendering-equation work defined themselves against the limitation of local shading.
Carried by Turner Whitted.
Local Shading Models replaced by Physically based rendering and Monte Carlo light transport in Computer Graphics
Physically based rendering replaced local shading models with a formulation accounting for all light transport. Local shading survives only as a limiting approximation within the newer framework.
Graphics pipeline led to Fixed-Function Graphics Pipeline in Hardware Accelerators
The fixed-function graphics pipeline implemented in hardware the rendering pipeline stages, such as transformation, clipping and rasterization, that graphics rendering had defined. The hardware pipeline grew directly out of that rendering model.
Recursive Ray Tracing led to Physically based rendering and Monte Carlo light transport in Computer Graphics
Physically based rendering and Monte Carlo light transport generalised recursive ray tracing into a stochastic solution of the full light-transport equation. Whitted's recursion became a special case of path tracing.
Carried by Turner Whitted; James T. Kajiya.
Monte Carlo Light Transport influenced by Monte Carlo method in Computational Physics
Metropolis and Ulam's Monte Carlo method, developed at Los Alamos in the 1940s, supplied the sampling and estimator machinery that Kajiya and others applied to light transport in 1986. Path tracing is a direct application of Monte Carlo integration to the rendering equation.
Carried by Nicholas Metropolis; Stanley Ulam; James Kajiya.
Neural Rendering influenced by Deep learning in Artificial Intelligence
Neural rendering is built on deep learning methods, using convolutional and neural network architectures to synthesise and reconstruct images. The 2012 rise of deep learning supplied the core techniques the field applies.
Local Shading Models influenced by Geometrical optics in Optics
Local shading models such as Lambertian and Phong shading apply the laws of geometrical optics, treating surfaces as reflecting light by reflection and refraction laws. The shading formulas are direct applications of geometrical-optics reflectance concepts.
Carried by Bui Tuong Phong.
Hidden-Surface Determination influenced by Computer-aided design in Mechanical Engineering
Computer-aided design systems generated the geometric models whose display required hidden-surface removal, and CAD work by firms such as Renault and by researchers like Sutherland fed the problem into graphics. The hidden-line and hidden-surface algorithms were developed largely to render CAD wireframe and solid models.
Carried by Ivan Sutherland.
Hidden-Surface Determination influenced by Interactive graphics and direct manipulation in Computer Graphics
Interactive graphics systems needed fast hidden-line and hidden-surface removal to present coherent 3D scenes during direct manipulation. Sutherland's Sketchpad and subsequent interactive systems motivated and hosted early visibility algorithms.
Carried by Ivan Sutherland; Sketchpad (1963).
Graphics pipeline influenced by SIMD architectures in Parallel Computing
SIMD architectures, especially parallel raster and pixel processors, supplied the execution model for the rasterization stage of the graphics pipeline. Graphics hardware pipelines were built as SIMD machines processing fragments in parallel.
Graphics pipeline influenced by Instruction pipelining in Microarchitecture
The graphics pipeline borrowed the staged, buffered organization of instruction pipelining, with geometry and raster stages flowing like pipeline stages. The term and structure of the graphics pipeline were modelled on processor pipelining.
Graphics pipeline influenced by Interactive graphics and direct manipulation in Computer Graphics
Interactive graphics and direct manipulation created the demand for a standardized rendering pipeline that could sustain real-time display. The pipeline was designed to serve interactive 3D graphics systems.

Graphics Rendering is a planet in Nousfarer
Its city has a tower for each of these 11 frameworks. Land, walk in, and climb one concept at a time.
Land on Graphics RenderingRelated fields
Fields its ideas are linked to
- Computer Graphics 22 links
- Virtual Reality 5 links
- Optics 4 links
- Computational Imaging 3 links
- Hardware Accelerators 2 links
- Artificial Intelligence 1 link
- Randomized Algorithms 1 link
- Microarchitecture 1 link
- Parallel Computing 1 link
- Geometric Modeling 1 link
- Digital History 1 link
- Operations Research 1 link
More in Computer Graphics
- Computational Imaging
- Computer Animation
- Computer Graphics
- Game Technology
- Geometric Modeling
- Physical Simulation
- Virtual Reality
See where Graphics Rendering sits on the Map of Human Knowledge