- Atlas
- Mathematics
- Time Series Analysis
Time Series Analysis
A time series is a sequence of measurements of the same thing, taken in order over time: a country's quarterly output, a city's daily temperature, the price of a stock at each minute of trading, the number of passengers on an airline each month.
11 frameworks, from 1900 to today · Statistics · Mathematics
- Decomposition of time series 1900-1970
- Stationary process 1930-Present
- Spectral Analysis 1950-Present
- State Space Models and Kalman Filtering 1960-Present
- Structural Time Series Models 1960-Present
- Box–Jenkins method 1970-Present
- Vector Autoregression 1980-Present
- Autoregressive conditional heteroskedasticity 1982-Present
- Cointegration 1987-Present
- Bayesian Time Series Analysis 1990-Present
- Machine Learning for Time Series 2010-Present
Overview
A time series is a sequence of measurements of the same thing, taken in order over time: a country's quarterly output, a city's daily temperature, the price of a stock at each minute of trading, the number of passengers on an airline each month1. What makes such data a distinct statistical problem is that the observations are not independent1. Today's value usually resembles yesterday's, and the order in which the numbers arrive carries information1. Time series analysis is the branch of statistics that builds models and methods for data of this kind—to describe how a series behaves, to forecast where it is going, to separate a signal from noise, and to test whether apparent relationships between series are real.
The field's history is a long argument about how much structure to impose. One camp treats a series as a realization of a random process with a fixed probabilistic law and tries to estimate that law; another decomposes it into interpretable parts—trend, season, cycle, irregular; a third lets the data itself, through flexible algorithms, decide the shape1. These approaches were born in different problems—astronomy, economics, engineering, finance—and they have repeatedly borrowed from and competed with one another.
Astronomy, Economics, and the First Decompositions
Systematic study of periodic variation began in the eighteenth and nineteenth centuries with astronomical and meteorological data. The key mathematical tool was the idea that a complicated periodic curve could be built from simple sine and cosine waves. Joseph Fourier's work on heat conduction, published in the early nineteenth century, supplied the mathematics; Arthur Schuster, working on sunspot and terrestrial-magnetism data, gave the practical instrument in the 1890s when he introduced the periodogram—a plot of how much variance in a series is attributable to each frequency. The periodogram's weakness was soon apparent: with a finite sample, its values fluctuate wildly even when no true periodicity exists, so distinguishing a real cycle from noise required careful distribution theory, developed over the following decades.
A parallel tradition grew in economics, where business-cycle researchers wanted to split a series into components. The standard device was the moving average: replacing each value by the average of a window of nearby values smooths away short-term noise and leaves the trend2. Warren Persons and others at Harvard in the early twentieth century built elaborate "business barometers" on such decompositions, and the classical scheme—trend, seasonal, cyclical, and irregular components, combined either additively or multiplicatively—became standard teaching. Its limitation was that the components were defined by the smoothing procedure rather than by any probability model, so there was no principled way to say how uncertain a decomposition was.
Stationarity and the Stochastic Process View
The decisive shift came when statisticians began treating a series as a random process rather than a deterministic curve plus error. The central concept is stationarity: a series is (weakly) stationary if its mean and variance are constant over time and the covariance between two observations depends only on the distance between them, not on when they occur34. Stationarity is what makes estimation possible—without it, there is no stable quantity to estimate from a finite stretch of data.
The Russian school made the foundational contributions. Andrei Kolmogorov's work in the 1930s and 1940s put the theory of stationary stochastic processes on axiomatic footing. Norbert Wiener, working on anti-aircraft fire control and signal processing during and after the Second World War, developed the parallel engineering theory of prediction and filtering. The synthesis appeared in 1949 as Extrapolation, Interpolation, and Smoothing of Stationary Time Series, Wiener's famously difficult book. Its practical message: if you know the correlation structure of a stationary process, you can compute the best linear forecast of future values. The problem was that the correlation structure had to be known, and in real data it had to be estimated.
Spectral Analysis and the Frequency Domain
The periodogram matured into a full spectral analysis. The spectrum of a stationary process describes how its variance is distributed across frequencies, and the Wiener–Khinchin theorem connects it to the autocovariance function as a Fourier transform pair. In the 1950s and 1960s, statisticians—notably Maurice Bartlett, who proposed smoothing the periodogram to reduce its variance, and later John Tukey, whose Fast Fourier Transform work with James Cooley in the mid-1960s made computation cheap—turned spectral estimation into a practical toolkit. The frequency-domain view proved indispensable in engineering (vibration analysis, communications) and geophysics (tides, seismic signals), and it remains one of the two great languages of the field, alongside the time-domain language of autoregression.
Autoregression, Moving Averages, and the Box–Jenkins Revolution
The time-domain counterpart is the idea that a series can be predicted from its own past. The autoregressive (AR) model expresses each value as a weighted sum of previous values plus a random shock; the moving-average (MA) model expresses it as a weighted sum of past shocks5. The Russian statistician and economist Eugen Slutsky had shown in the 1920s that moving averages of random numbers could mimic business cycles, a result that unsettled the idea that cycles proved anything about causes. The English statistician Udny Yule introduced the autoregressive scheme for sunspot and other data around the same time.
The synthesis that made these models usable came from George Box and Gwilym Jenkins, whose 1970 book Time Series Analysis: Forecasting and Control gave the field its most influential methodology. Their ARIMA framework—autoregressive integrated moving average—handled non-stationary series by differencing (subtracting each value from the previous one) until stationarity was achieved, then fitting AR and MA terms, and checking the fit by examining whether the residuals looked like white noise. The accompanying iterative cycle—identify, estimate, diagnose—was as important as the mathematics: it told practitioners how to work. The method's appeal was that it required only the series itself, no external explanatory variables, and it produced forecasts with defensible uncertainty intervals. It became the default approach in forecasting practice for a generation.
State Space and the Kalman Filter
A different strand came from control engineering. In 1960 Rudolf Kalman published a recursive solution to the problem of estimating the hidden state of a dynamic system from noisy measurements—the Kalman filter6. The idea is to maintain a probability distribution over the unknown state, update it as each new observation arrives, and predict forward6. It is exact for linear systems with Gaussian noise and astonishingly efficient, requiring only matrix arithmetic at each step.
Statisticians recognized that many classical models, including ARIMA, could be written in state-space form, with an unobserved state vector evolving over time and observations generated from it. This unification, pushed by engineers and by statisticians such as Andrew Harvey, allowed missing data, irregular sampling, and time-varying parameters to be handled within one framework. Harvey's structural time series models—explicitly modeling level, trend, seasonal, and irregular components as unobserved stochastic processes—gave the old classical decomposition a probabilistic foundation. The Kalman filter then estimated the components, and the decomposition acquired standard errors.
Multivariate Systems and Vector Autoregression
Real questions are usually about several series at once: does money growth cause inflation, does one market move another? The univariate toolkit could not answer them. Christopher Sims's 1980 paper introduced the vector autoregression (VAR), which treats a set of series symmetrically, each regressed on lags of itself and of all the others. The VAR was deliberately theory-light: rather than imposing economic structure, it let the data reveal dynamic relationships, and its impulse-response functions traced how a shock to one variable propagated through the system. It became a workhorse of empirical macroeconomics, and its descendants—structural VARs with identifying restrictions, Bayesian VARs with shrinkage priors for large systems—remain central.
Volatility: ARCH and GARCH
Financial returns posed a puzzle the standard models could not handle. Returns themselves are nearly unpredictable, but their volatility clusters: turbulent days follow turbulent days7. Robert Engle's 1982 ARCH model (autoregressive conditional heteroskedasticity) let the conditional variance depend on past squared shocks; Tim Bollerslev's 1986 GARCH generalization added lagged variances, capturing volatility persistence with few parameters87. These models made it possible to forecast risk, price options with time-varying volatility, and test whether volatility responds asymmetrically to good and bad news. The 2003 Nobel Prize to Engle and Clive Granger marked the field's arrival as a mature empirical science.
Cointegration and Error Correction
Granger's contribution was the discovery, with Robert Engle in 1987, of cointegration: two non-stationary series can wander individually yet stay tied together, so that some linear combination of them is stationary9. Regressing one on the other in the usual way produces spurious results—the famous "spurious regression" problem—unless the series are cointegrated. The error-correction model captures the adjustment: a deviation from the long-run relationship pulls the series back toward it10. This gave econometrics a rigorous way to model long-run equilibrium alongside short-run dynamics, and it reshaped empirical work on prices, exchange rates, and consumption.
Bayesian and Machine-Learning Turns
Bayesian methods entered time series early—Kalman filtering has a natural Bayesian reading—but became a mainstream alternative with the spread of Markov chain Monte Carlo in the 1990s. Bayesian structural models, dynamic linear models, and Bayesian VARs allowed prior information and hierarchical structure to be incorporated, and they handled parameter uncertainty more directly than plug-in estimates. The approach is now standard in forecasting competitions and central-bank modeling.
The most recent turn is algorithmic. Neural networks and other machine-learning methods—recurrent networks, gradient boosting, and later transformer-based models—can learn complex nonlinear and long-range dependencies without a specified model form. Their record is mixed: on many classical benchmarks, simple statistical methods remain hard to beat, and the field has learned to be skeptical of claims that flexible models automatically forecast better. But for very large datasets, high-frequency data, and problems with many related series, learned models have become serious competitors, and hybrid approaches that combine statistical structure with learned components are an active frontier.
The Present
Today the field is plural. ARIMA and exponential smoothing remain the reliable baseline; state-space models and the Kalman filter underpin everything from macroeconomic nowcasting to satellite tracking; spectral methods serve engineering and the physical sciences; GARCH-family models dominate financial risk; VARs and cointegration anchor empirical macroeconomics; and Bayesian and machine-learning methods expand the range of what can be modeled. The open questions are familiar in new dress: how to forecast when the underlying process shifts, how to combine many models and many data sources, how to quantify uncertainty honestly when models are misspecified, and how to tell whether a flexible algorithm has learned structure or merely memorized noise. The argument between structure and flexibility that has run through the field since the nineteenth century is not settled—it has simply acquired more powerful tools on both sides.
References
- Time series (introduction, Methods for analysis, Estimation, filtering, and smoothing), Wikipedia
- Moving average, Wikipedia
- Stationary ergodic process, Wikipedia
- Stationary process, Wikipedia
- Moving-average model, Wikipedia
- Kalman filter (introduction, History), Wikipedia
- Volatility clustering, Wikipedia
- Autoregressive conditional heteroskedasticity, Wikipedia
- Cointegration (introduction, History), Wikipedia
- Error correction model, Wikipedia
The frameworks of Time Series Analysis
Each framework is a way of working the field has used: when it held, and the question it answers.
- 1900-1970
Decomposition of time series
How can a series be split into trend, season and noise?
- 1930-Present
Stationary process
When does a random process have a stable law to estimate?
- 1950-Present
- 1960-Present
State Space Models and Kalman Filtering
How can a hidden state be tracked from noisy readings?
- 1960-Present
Structural Time Series Models
How can trend and season be modeled as random processes?
- 1970-Present
- 1980-Present
Vector Autoregression
How do several series move and influence one another over time?
- 1982-Present
Autoregressive conditional heteroskedasticity
Why does volatility come in clusters?
- 1987-Present
Cointegration
When do nonstationary series move together in the long run?
- 1990-Present
Bayesian Time Series Analysis
How should prior belief be updated with each new observation?
- 2010-Present
Machine Learning for Time Series
Can flexible algorithms learn patterns better than fixed models?
How the ideas connect
Each arrow runs from an earlier idea to the later one it shaped. The list below says what passed between them.
Spectral Analysis grew out of Stationary process
Spectral analysis rests on the Wiener–Khinchin theorem, which makes the spectrum the Fourier transform of the autocovariance of a stationary process; Bartlett's smoothed periodogram and Tukey's FFT turned this stationary-process theory into a practical toolkit.
Carried by Norbert Wiener; Maurice Bartlett; John Tukey.
Box–Jenkins method grew out of Stationary process
Box and Jenkins built ARIMA directly on the stationary-process framework: differencing to reach stationarity, then AR and MA terms whose estimation and forecasting theory came from the stationary stochastic-process tradition.
Carried by George Box; Gwilym Jenkins; Time Series Analysis: Forecasting and Control (1970).
Structural Time Series Models grew out of State Space Models and Kalman Filtering
Structural time series models are state-space models whose unobserved level, trend, seasonal and irregular components are estimated by the Kalman filter; Harvey's framework is a direct application and refinement of Kalman's recursive estimation.
Carried by Andrew Harvey; Rudolf Kalman.
Cointegration grew out of Vector Autoregression
Engle and Granger's cointegration analysis grew directly out of the VAR framework: it asked when nonstationary series in a multivariate system share a common stochastic trend, and its error-correction models are reparameterized VARs.
Carried by Robert Engle; Clive Granger.
Structural Time Series Models revived Decomposition of time series
Harvey's structural time series models deliberately brought back the classical trend-seasonal-irregular decomposition, but recast its components as unobserved stochastic processes estimated by the Kalman filter, giving the old scheme standard errors.
Carried by Andrew Harvey; Forecasting, Structural Time Series Models and the Kalman Filter (1989).
State Space Models and Kalman Filtering influenced by Stationary process
Kalman filtering was formulated for state-space models driven by stochastic processes, and statisticians soon showed that stationary ARMA models could be written in state-space form, carrying the stationary-process view into the recursive filtering framework.
Carried by Rudolf Kalman.
Vector Autoregression grew out of Box–Jenkins method
Sims's vector autoregression generalized the univariate ARIMA approach to systems of series, regressing each variable on lags of itself and the others; the VAR is the multivariate extension of the autoregressive idea central to Box–Jenkins.
Carried by Christopher Sims.
Autoregressive conditional heteroskedasticity influenced by Box–Jenkins method
Engle's ARCH model extended the Box–Jenkins ARMA framework by letting the conditional variance, rather than only the conditional mean, follow an autoregressive structure; it was framed explicitly as a model for the variance of a time series.
Carried by Robert Engle.
Bayesian Time Series Analysis influenced by Vector Autoregression
Bayesian time series analysis in the 1990s was largely built around Bayesian vector autoregressions, using shrinkage priors to tame the many parameters of large VAR systems; the VAR supplied the model form that Bayesian methods were applied to.
Carried by Christopher Sims; Thomas Doan; Robert Litterman.
Machine Learning for Time Series influenced by Box–Jenkins method
Machine-learning forecasting for time series took up the Box–Jenkins questions of identification, estimation and out-of-sample validation, and early comparisons benchmarked flexible learners against ARIMA models.
Beyond the field
Where Time Series Analysis's ideas came from in other fields, and what they led to there: the strongest 12 of 53 links.
Decomposition of time series influenced by Fourier analysis in Applied Mathematics
Classical decomposition of a series into trend, seasonal and irregular components rests on treating the seasonal component as a periodic function, which Fourier's harmonic representation supplies. The periodogram and harmonic analysis of periodicities in economic and meteorological series were built directly on Fourier's series.
Carried by Joseph Fourier; Théorie analytique de la chaleur (1822).
Decomposition of time series influenced by Fourier analysis in Harmonic Analysis
The harmonic (Fourier) analysis of periodic components is the mathematical basis for extracting seasonal components in time series decomposition. The periodogram used to detect cycles in economic series is a Fourier construction.
Carried by Joseph Fourier.
Stationary process grew out of Stochastic process in Probability Theory
The stationary process is a special class of stochastic process, singled out by Khinchin and others in the early 1930s when the general theory of stochastic processes was being formalised. Stationarity as a property presupposes the stochastic process concept.
Carried by Aleksandr Khinchin.
Spectral Analysis influenced by Fourier analysis in Applied Mathematics
Spectral analysis of time series is the statistical application of Fourier's harmonic decomposition, estimating the spectral density from the Fourier transform of the autocovariance. The whole method descends from Fourier's representation of functions as sums of sinusoids.
Carried by Joseph Fourier.
Spectral Analysis influenced by Fourier analysis in Harmonic Analysis
Harmonic analysis supplied the spectral representation theorem and Fourier transform machinery on which spectral analysis of time series is built. The spectral density is defined through the Fourier transform of the autocovariance function.
Carried by Joseph Fourier.
Structural Time Series Models influenced by Stochastic estimation and Kalman filtering in Control Theory
Stochastic estimation and Kalman filtering supplied the recursive estimation method by which structural time series models fit their unobserved components. The state-space formulation and filter are the technical basis of the structural approach.
Carried by Rudolf Kalman.
Structural Time Series Models influenced by State-Space Models and the Kalman Filter in Time Series Econometrics
Structural time series models are built by casting unobserved trend, seasonal and irregular components into state-space form and estimating them with the Kalman filter. The state-space/Kalman machinery is the computational core of the structural approach.
Carried by Rudolf Kalman; Andrew Harvey.
Structural Time Series Models influenced by Stochastic estimation and Kalman filtering in Control Systems
Kalman filtering from control systems provided the estimation engine for structural time series models, letting unobserved trend and seasonal states be estimated recursively. The structural models are written as state-space systems and fitted with this filter.
Carried by Rudolf Kalman.
Vector Autoregression led to Structural vector autoregression in Macroeconomics
Structural VARs grew directly out of reduced-form VARs by imposing economic identifying restrictions on the innovations, as in Sims's 1986 work on identifying monetary policy shocks.
Carried by Christopher A. Sims.
Vector Autoregression influenced Cointegration in Time Series Econometrics
Engle and Granger built cointegration directly on the vector autoregression framework, showing that cointegrated systems have an error-correction representation within VAR models.
Carried by Robert F. Engle; Clive W. J. Granger.
Vector Autoregression provoked Local Projections in Time Series Econometrics
Local projections were proposed as a direct alternative to vector autoregressions for estimating impulse responses, avoiding the VAR's specification of the full dynamic system.
Carried by Oscar Jorda.
Cointegration grew out of Unit Root and Spurious Regression Analysis in Time Series Econometrics
Cointegration grew directly out of the unit-root and spurious-regression literature: Engle and Granger showed that regressions on nonstationary series can be meaningful when the series are cointegrated.
Carried by Robert F. Engle; Clive W. J. Granger.

Time Series Analysis is a planet in Nousfarer
Its city has a tower for each of these 11 frameworks. Land, walk in, and climb one concept at a time.
Land on Time Series AnalysisRelated fields
Fields its ideas are linked to
- Time Series Econometrics 22 links
- Bayesian Econometrics 3 links
- Econometrics 3 links
- Control Systems 3 links
- Signal Processing 3 links
- Probability Theory 3 links
- Harmonic Analysis 2 links
- Control Theory 2 links
- Signals And Systems 2 links
- Macroeconomics 2 links
- Applied Mathematics 2 links
- Stochastic Processes 2 links
More in Statistics
- Bayesian Statistics
- Causal Inference
- Experimental Design
- Multivariate Statistics
- Nonparametric Statistics
- Regression Analysis
- Spatial Statistics
- Statistical Computing
- Statistical Inference
- Statistical Learning
- Statistics
- Survey Sampling
- Survival Analysis
See where Time Series Analysis sits on the Map of Human Knowledge