Theoretical Chemistry

Theoretical chemistry is the branch of chemistry that tries to explain and predict chemical behaviour from physical laws and mathematics rather than from experiment alone.

10 frameworks, from 1870 to today · Chemistry · Natural Sciences

still a working view ended · each leads to its entry below

Overview

Theoretical chemistry is the branch of chemistry that tries to explain and predict chemical behaviour from physical laws and mathematics rather than from experiment alone1. Its practitioners ask what a chemical bond actually is, why molecules have the shapes and energies they do, how fast a reaction proceeds, and how a solvent or a protein changes all of this1. What is at stake is enormous: a theory that can compute the energy of a molecule from scratch, without making it in a flask, lets chemists design drugs, catalysts, and materials on a computer before anyone touches a beaker. The field's history is a long argument about how far that ambition can be pushed—and what must be sacrificed to get an answer at all.

From the Mechanical Philosophy to Thermodynamics

The roots lie in the seventeenth-century mechanical philosophy, which held that matter consists of particles whose motions obey natural laws. Robert Boyle's The Sceptical Chymist (1661) argued that chemical phenomena should be explained by the arrangement and motion of corpuscles rather than by the four Aristotelian elements. This was a programme rather than a working theory, but it set the question that theoretical chemistry would pursue for centuries: can chemistry be reduced to mechanics?

The first genuinely predictive theory came from thermodynamics. In the 1870s Josiah Willard Gibbs developed the phase rule and the chemical potential, showing that the direction of chemical change could be determined from a single quantity—the free energy—without knowing anything about molecules. Thermodynamics told chemists whether a reaction could happen and how far it would go, but it was silent on mechanism and on the nature of the bond. It remains the backbone of chemical engineering and of the modern theory of reaction equilibria.

The Quantum Revolution and the Chemical Bond

The decisive break came with quantum mechanics. In 1927 Walter Heitler and Fritz London applied the new wave mechanics to the hydrogen molecule and showed that a covalent bond arises from the exchange of electrons between two atoms—a purely quantum effect with no classical analogue. This was the birth of what became valence bond theory: the idea that a molecule is built from localised bonds, each formed by pairing electrons on neighbouring atoms, with hybridisation invoked to explain geometries such as the tetrahedral carbon of methane23. Linus Pauling's The Nature of the Chemical Bond (1939) systematised this picture and made it the working language of organic chemistry; resonance structures, hybrid orbitals, and electronegativity all belong to it.

A rival appeared almost immediately. In 1929 John Lennard-Jones and others developed molecular orbital theory, in which electrons occupy orbitals spread over the whole molecule rather than being confined to bonds between pairs of atoms. The two approaches are mathematically related but conceptually different: valence bond theory thinks in local bonds and resonance, molecular orbital theory in delocalised orbitals and their symmetries34. Molecular orbital theory won the computational argument because its orbitals are easier to calculate systematically, and it became the basis of the Woodward–Hoffmann rules for predicting reaction stereochemistry in the 1960s. Valence bond theory survived as an interpretive framework and, in modern forms, as a computational method—but the mainstream of quantitative work moved to orbitals4.

Hartree–Fock and the Wavefunction Programme

The central computational problem is the many-electron Schrödinger equation, which cannot be solved exactly for any molecule larger than hydrogen. In the late 1920s Douglas Hartree and Vladimir Fock independently developed an approximation in which each electron moves in the average field of all the others—the Hartree–Fock method. It gives a single determinant wavefunction and captures most of the energy, but it neglects electron correlation: the tendency of electrons to avoid one another beyond the average field. The difference between Hartree–Fock and the exact energy is the correlation energy, and recovering it became the defining challenge of the field5.

From the 1950s onward a hierarchy of methods was built to do this: configuration interaction, in which the wavefunction is written as a mixture of excited determinants; Møller–Plesset perturbation theory (MP2 and beyond); and coupled-cluster theory, which by the 1980s had become the gold standard for small molecules. These methods are systematically improvable—you can, in principle, approach the exact answer—but their cost grows steeply with system size, which is why they remain confined to tens of atoms. The wavefunction programme thus established the benchmark against which every cheaper method is judged.

Density Functional Theory: The Cheap Route

A different route opened in 1964, when Pierre Hohenberg and Walter Kohn proved that the ground-state energy of a system is a unique functional of its electron density—a function of three spatial coordinates rather than the 3N coordinates of a wavefunction. In 1965 Kohn and Lu Jeu Sham turned this into a practical scheme: a set of single-particle equations, like Hartree–Fock, but with an exchange-correlation functional that in principle contains everything missing from the mean field67. The catch is that the exact functional is unknown, so practitioners must approximate it6.

The approximations came in waves. The local density approximation and the generalised gradient approximations of the 1980s and 1990s made density functional theory (DFT) accurate enough for many chemical problems at a fraction of wavefunction cost. Hybrid functionals such as B3LYP, introduced in the early 1990s, mixed in a portion of exact Hartree–Fock exchange and became the workhorse of computational chemistry. DFT's rise is the dominant story of late-twentieth-century theoretical chemistry: it made routine calculations on molecules of fifty to a few hundred atoms feasible, and it is now the most widely used electronic-structure method in the field. Its weakness is that no systematic improvement is guaranteed—results depend on the chosen functional, and some problems (strong correlation, charge-transfer states, dispersion) remain difficult6.

Statistical Mechanics and the Bridge to Bulk Matter

Electronic structure describes a single molecule at zero temperature. To connect to real chemistry—liquids, solutions, proteins, reaction rates at finite temperature—the field turned to statistical mechanics, the theory that derives bulk thermodynamic properties from the statistical behaviour of large numbers of molecules1. Gibbs and Boltzmann had laid its foundations in the nineteenth century; in the twentieth century it became a computational tool. Monte Carlo methods, developed at Los Alamos in the 1940s, sample configurations by random moves; transition-state theory, refined by Henry Eyring and Michael Polanyi in the 1930s, gives reaction rates from the energy barrier between reactants and products89. Together these let theorists predict free energies, equilibrium constants, and rate constants—the quantities chemists actually measure.

Molecular Mechanics and the Classical Approximation

For systems too large for quantum methods—proteins, polymers, liquids—the field developed molecular mechanics, which treats atoms as balls and bonds as springs governed by a force field: a set of parameterised equations for bond stretching, angle bending, torsional rotation, and non-bonded attraction and repulsion1011. The approach dates to the 1940s–1960s work of researchers such as F. H. Westheimer and Norman Allinger, whose MM series of force fields (MM2, MM3) became standard for organic molecules. Force fields are fast and can handle millions of atoms, but they cannot break or form bonds, so they describe structure and dynamics rather than reactivity. Their accuracy depends entirely on the parameters, which must be fitted to experiment or quantum calculation11.

Molecular Dynamics: Watching Molecules Move

Molecular dynamics simulation, introduced by Aneesur Rahman in 1964 for liquid argon and extended to biomolecules from the 1970s, integrates Newton's equations of motion for every atom in a force field, producing a trajectory over time. It turned theoretical chemistry from a static, energy-focused discipline into a dynamic one: one could watch a protein fold, a membrane flex, or a solvent reorganise. The limitation is the timescale—femtosecond steps mean that biologically relevant events taking milliseconds are far out of reach without enhanced sampling techniques, which became a major research area from the 1990s.

Multiscale Methods: QM/MM

The split between quantum accuracy and classical speed suggested a hybrid. In 1976 Arieh Warshel and Michael Levitt introduced QM/MM (quantum mechanics/molecular mechanics), in which a small region—the active site of an enzyme, say—is treated quantum mechanically while the surrounding protein and solvent are treated with a force field12. This made it possible to study reactions in realistic biological environments, and it earned Warshel, Levitt, and Martin Karplus the 2013 Nobel Prize in Chemistry12. Multiscale embedding has since expanded to include continuum solvation models and machine-learned environments, and it remains the standard way to bring quantum chemistry to bear on large systems.

Machine Learning and the New Surrogate Models

The most recent turning point is the use of machine learning to approximate quantum-mechanical potential energy surfaces. The idea—train a flexible model on a set of quantum calculations, then use it to predict energies and forces for new configurations at a fraction of the cost—was demonstrated in the 2000s and 2010s with neural-network potentials and Gaussian process regression. By the 2020s, machine-learned interatomic potentials were reaching near-quantum accuracy for many systems while running orders of magnitude faster, and they are now used for molecular dynamics, materials screening, and reaction discovery. The open questions are familiar ones in new dress: how to guarantee that a model extrapolates safely outside its training data, how to represent the quantum state itself rather than just the energy, and how to keep the physics—symmetries, conservation laws—built in rather than learned.

The Present

Theoretical chemistry today is a layered enterprise. Wavefunction methods and DFT provide electronic structure; statistical mechanics and molecular dynamics provide the bridge to bulk and to time; force fields and machine-learned potentials provide speed; QM/MM and embedding provide the multiscale link. The field's central tension—between systematic accuracy and computational reach—has not been resolved but has been pushed outward, and the newest methods blur the old boundaries between quantum and classical, physics-based and data-driven. What remains open is the same question that animated Boyle: how much of chemistry can be derived from first principles, and what must still be measured rather than calculated.

References

  1. Theoretical chemistry (Overview, introduction, Branches of theoretical chemistry), Wikipedia
  2. Quantum chemistry (History), Wikipedia
  3. Valence bond theory (introduction, History), Wikipedia
  4. Modern valence bond theory, Wikipedia
  5. Post–Hartree–Fock, Wikipedia
  6. Density functional theory (Origins, introduction), Wikipedia
  7. Kohn–Sham equations (History), Wikipedia
  8. Transition state theory, Wikipedia
  9. Monte Carlo method (History), Wikipedia
  10. Molecular mechanics, Wikipedia
  11. Force field (chemistry), Wikipedia
  12. QM/MM, Wikipedia

The frameworks of Theoretical Chemistry

Each framework is a way of working the field has used: when it held, and the question it answers.

  1. 1870-Present

    Chemical thermodynamics

    What determines whether a reaction occurs and how far it goes?

    Fly to its tower in Nousfarer

  2. 1900-Present

    Statistical mechanics

    How do molecular motions produce bulk properties?

    Fly to its tower in Nousfarer

  3. 1927-Present

    Valence Bond Theory

    What holds atoms together in a chemical bond?

    Fly to its tower in Nousfarer

  4. 1928-Present

    Post–Hartree–Fock

    How can we recover the energy missing from a mean-field picture?

    Fly to its tower in Nousfarer

  5. 1929-Present

    Molecular Orbital Theory

    How are electrons arranged across a whole molecule?

    Fly to its tower in Nousfarer

  6. 1946-Present

    Molecular mechanics

    Can molecular shape and motion be described by classical mechanics?

    Fly to its tower in Nousfarer

  7. 1964-Present

    Density Functional Theory

    Can the energy of a molecule be computed from its electron density alone?

    Fly to its tower in Nousfarer

  8. 1964-Present

    Molecular dynamics

    How do molecules move and interact over time?

    Fly to its tower in Nousfarer

  9. 1976-Present
  10. 2007-Present

    Machine-Learned Interatomic Potentials

    Can machine learning replace expensive quantum calculations of energy and forces?

    Fly to its tower in Nousfarer

How the ideas connect

Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.

Chemical thermodynamicsStatistical mechanicsValence Bond TheoryPost–Hartree–FockMolecular Orbital TheoryMolecular mechanicsDensity Functional TheoryMolecular dynamicsQM/MMMachine-Learned Interatomic Potentials

Beyond the field

Where Theoretical Chemistry's ideas came from in other fields, and what they led to there: the strongest 12 of 90 links.

A city in Nousfarer: a red-carpeted stair climbing terraces to a crowned tower on an acropolis, more towers round it, forest and snowy mountains beyond.
A city in Nousfarer, the game played in the browser.

Theoretical Chemistry is a planet in Nousfarer

Its city has a tower for each of these 10 frameworks. Land, walk in, and climb one concept at a time.

Land on Theoretical Chemistry

Related fields

Fields its ideas are linked to

More in Chemistry

See where Theoretical Chemistry sits on the Map of Human Knowledge