Doob's martingale inequality

In mathematics, Doob's martingale inequality, also known as Kolmogorov’s submartingale inequality is a result in the study of stochastic processes. It gives a bound on the probability that a submartingale exceeds any given value over a given interval of time. As the name suggests, the result is usually given in the case that the process is a martingale, but the result is also valid for submartingales.

The inequality is due to the American mathematician Joseph L. Doob.

YouTube Encyclopedic

1/5
Views:
972
1 464
929
2 205
1 324

Transcription

Statement of the inequality

The setting of Doob's inequality is a submartingale relative to a filtration of the underlying probability space. The probability measure on the sample space of the martingale will be denoted by $P$ . The corresponding expected value of a random variable $X$ , as defined by Lebesgue integration, will be denoted by $E[X]$ .

Informally, Doob's inequality states that the expected value of the process at some final time controls the probability that a sample path will reach above any particular value beforehand. As the proof uses very direct reasoning, it does not require any restrictive assumptions on the underlying filtration or on the process itself, unlike for many other theorems about stochastic processes. In the continuous-time setting, right-continuity (or left-continuity) of the sample paths is required, but only for the sake of knowing that the supremal value of a sample path equals the supremum over an arbitrary countable dense subset of times.

Discrete time

Let $X 1, ..., X n$ be a discrete-time submartingale relative to a filtration ${\mathcal {F}}_{1},\ldots ,{\mathcal {F}}_{n}$ of the underlying probability space, which is to say:

X_{i}\leq \operatorname {E} [X_{i+1}\mid {\mathcal {F}}_{i}].

The submartingale inequality^{[clarification needed]} says that

P\left[\max _{1\leq i\leq n}X_{i}\geq C\right]\leq {\frac {\operatorname {E} [{\textrm {max}}(X_{n},0)]}{C}}

for any positive number $C$ . The proof relies on the set-theoretic fact that the event defined by $max(X i) > C$ may be decomposed as the disjoint union of the events $E i$ defined by $X i > C$ and $X j \leq C$ for all $j < i$ . Then

CP(E_{i})=\int _{E_{i}}C\,dP\leq \int _{E_{i}}X_{i}\,dP\leq \int _{E_{i}}{\text{E}}[X_{n}\mid {\mathcal {F}}_{i}]\,dP=\int _{E_{i}}X_{n}\,dP,

having made use of the submartingale property for the last inequality and the fact that $E_{i}\in {\mathcal {F}}_{i}$ for the last equality. Summing this result as $i$ ranges from 1 to $n$ results in the conclusion^{[clarification needed]}

CP(E)\leq \int _{E}X_{n}\,dP,

which is sharper than the stated result. By using the elementary fact that $X n \leq max(X n, 0)$ , the given submartingale inequality follows.

In this proof, the submartingale property is used once, together with the definition of conditional expectation.^[1] The proof can also be phrased in the language of stochastic processes so as to become a corollary of the powerful theorem that a stopped submartingale is itself a submartingale.^[2] In this setup, the minimal index $i$ appearing in the above proof is interpreted as a stopping time.

Continuous time

Now let $X t$ be a submartingale indexed by an interval $[0,T]$ of real numbers, relative to a filtration $F t$ of the underlying probability space, which is to say:

X_{s}\leq \operatorname {E} [X_{t}\mid {\mathcal {F}}_{s}].

for all $s < t .$ The submartingale inequality^{[clarification needed]} says that if the sample paths of the martingale are almost-surely right-continuous, then

P\left[\sup _{0\leq t\leq T}X_{t}\geq C\right]\leq {\frac {\operatorname {E} [{\textrm {max}}(X_{T},0)]}{C}}

for any positive number $C$ . This is a corollary of the above discrete-time result, obtained by writing

\sup _{0\leq t\leq T}X_{t}=\sup\{X_{t}:t\in [0,T]\cap \mathbb {Q} \}=\lim _{i\to \infty }\sup\{X_{t}:t\in [0,T]\cap Q_{i}\}

in which $Q 1 \subset Q 2 \subset \cdot\cdot\cdot$ is any sequence of finite sets whose union is the set of all rational numbers. The first equality is a consequence of the right-continuity assumption, while the second equality is purely set-theoretic. The discrete-time inequality applies to say that

P\left[\sup _{t\in [0,T]\cap Q_{i}}X_{t}\geq C\right]\leq {\frac {\operatorname {E} [{\textrm {max}}(X_{T},0)]}{C}}

for each $i$ , and this passes to the limit to yield the submartingale inequality.^[3] This passage from discrete time to continuous time is very flexible, as it only required having a countable dense subset of $[0,T]$ , which can then automatically be built out of an increasing sequence of finite sets. As such, the submartingale inequality holds even for more general index sets, which are not required to be intervals or natural numbers.^[4]

Further inequalities

There are further submartingale inequalities also due to Doob. Now let $X t$ be a martingale or a positive submartingale; if the index set is uncountable, then (as above) assume that the sample paths are right-continuous. In these scenarios, Jensen's inequality implies that $| X t | p$ is a submartingale for any number $p \geq 1$ , provided that these new random variables all have finite integral. The submartingale inequality is then applicable to say that^[5]

{\text{P}}[\sup _{t}|X_{t}|\geq C]\leq {\frac {{\text{E}}[|X_{T}|^{p}]}{C^{p}}}.

for any positive number $C$ . Here $T$ is the final time, i.e. the largest value of the index set. Furthermore one has

{\text{E}}[|X_{T}|^{p}]\leq {\text{E}}\left[\sup _{0\leq s\leq T}|X_{s}|^{p}\right]\leq \left({\frac {p}{p-1}}\right)^{p}{\text{E}}[|X_{T}|^{p}]

if $p$ is larger than one. This, sometimes known as Doob's maximal inequality, is a direct result of combining the layer cake representation with the submartingale inequality and the Hölder inequality.^[6]

In addition to the above inequality, there holds^[7]

{\text{E}}\left|\sup _{0\leq s\leq T}X_{s}\right|\leq {\frac {e}{e-1}}\left(1+{\text{E}}[\max\{|X_{T}|\log |X_{T}|,0\}]\right)

Related inequalities

Doob's inequality for discrete-time martingales implies Kolmogorov's inequality: if X₁, X₂, ... is a sequence of real-valued independent random variables, each with mean zero, it is clear that

{\begin{aligned}\operatorname {E} \left[X_{1}+\cdots +X_{n}+X_{n+1}\mid X_{1},\ldots ,X_{n}\right]&=X_{1}+\cdots +X_{n}+\operatorname {E} \left[X_{n+1}\mid X_{1},\ldots ,X_{n}\right]\\&=X_{1}+\cdots +X_{n},\end{aligned}}

so S_n = X₁ + ... + X_n is a martingale. Note that Jensen's inequality implies that |S_n| is a nonnegative submartingale if S_n is a martingale. Hence, taking p = 2 in Doob's martingale inequality,

P\left[\max _{1\leq i\leq n}\left|S_{i}\right|\geq \lambda \right]\leq {\frac {\operatorname {E} \left[S_{n}^{2}\right]}{\lambda ^{2}}},

which is precisely the statement of Kolmogorov's inequality.^[8]

Application: Brownian motion

Let B denote canonical one-dimensional Brownian motion. Then^[9]

P\left[\sup _{0\leq t\leq T}B_{t}\geq C\right]\leq \exp \left(-{\frac {C^{2}}{2T}}\right).

The proof is just as follows: since the exponential function is monotonically increasing, for any non-negative λ,

\left\{\sup _{0\leq t\leq T}B_{t}\geq C\right\}=\left\{\sup _{0\leq t\leq T}\exp(\lambda B_{t})\geq \exp(\lambda C)\right\}.

By Doob's inequality, and since the exponential of Brownian motion is a positive submartingale,

{\begin{aligned}P\left[\sup _{0\leq t\leq T}B_{t}\geq C\right]&=P\left[\sup _{0\leq t\leq T}\exp(\lambda B_{t})\geq \exp(\lambda C)\right]\\[8pt]&\leq {\frac {\operatorname {E} [\exp(\lambda B_{T})]}{\exp(\lambda C)}}\\[8pt]&=\exp \left({\tfrac {1}{2}}\lambda ^{2}T-\lambda C\right)&&\operatorname {E} \left[\exp(\lambda B_{t})\right]=\exp \left({\tfrac {1}{2}}\lambda ^{2}t\right)\end{aligned}}

Since the left-hand side does not depend on λ, choose λ to minimize the right-hand side: λ = C/T gives the desired inequality.

References

^ Billingsley 1995, Theorem 31.3; Doob 1953, Theorem VII.3.2; Hall & Heyde 1980, Theorem 2.1; Shiryaev 2019, Theorem 7.3.1.
^ Doob 1953, Theorem VII.3.2; Durrett 2019, Theorem 5.4.2; Kallenberg 2021, Theorem 9.16; Revuz & Yor 1999, Proposition II.1.5.
^ Karatzas & Shreve 1991, Theorem 1.3.8.
^ Doob 1953, p. 353; Loève 1978, Section 39.
^ Revuz & Yor 1999, Corollary II.1.6 and Theorem II.1.7.
^ Hall & Heyde 1980, Theorem 2.2; Karatzas & Shreve 1991, Theorem 1.3.8; Revuz & Yor 1999, Corollary II.1.6 and Theorem II.1.7.
^ Durrett 2019, p. 55, Theorem 5.4.4; Revuz & Yor 1999; Shiryaev 2019, Theorem 7.3.2.
^ Durrett 2019, Example 5.4.1.
^ Revuz & Yor 1999, Proposition II.1.8.

Sources

Billingsley, Patrick (1995). Probability and measure. Wiley Series in Probability and Mathematical Statistics (Third edition of 1979 original ed.). New York: John Wiley & Sons, Inc. ISBN 0-471-00710-2. MR 1324786.
Doob, J. L. (1953). Stochastic processes. New York: John Wiley & Sons, Inc. MR 0058896.
Durrett, Rick (2019). Probability – theory and examples. Cambridge Series in Statistical and Probabilistic Mathematics. Vol. 49 (Fifth edition of 1991 original ed.). Cambridge: Cambridge University Press. doi:10.1017/9781108591034. ISBN 978-1-108-47368-2. MR 3930614. S2CID 242105330.
Hall, P.; Heyde, C. C. (1980). Martingale limit theory and its application. Probability and Mathematical Statistics. San Diego, CA: Academic Press. doi:10.1016/C2013-0-10818-5. ISBN 0-12-319350-8.
Kallenberg, Olav (2021). Foundations of modern probability. Probability Theory and Stochastic Modelling. Vol. 99 (Third edition of 1997 original ed.). Springer, Cham. doi:10.1007/978-3-030-61871-1. ISBN 978-3-030-61871-1. MR 4226142.
Karatzas, Ioannis; Shreve, Steven E. (1991). Brownian motion and stochastic calculus. Graduate Texts in Mathematics. Vol. 113 (Second edition of 1988 original ed.). New York: Springer-Verlag. doi:10.1007/978-1-4612-0949-2. ISBN 0-387-97655-8. MR 1121940.
Loève, Michel (1978). Probability theory. II. Graduate Texts in Mathematics. Vol. 46 (Fourth edition of 1955 original ed.). New York–Heidelberg: Springer-Verlag. ISBN 0-387-90262-7. MR 0651018.
Revuz, Daniel; Yor, Marc (1999). Continuous martingales and Brownian motion. Grundlehren der mathematischen Wissenschaften. Vol. 293 (Third edition of 1991 original ed.). Berlin: Springer-Verlag. doi:10.1007/978-3-662-06400-9. ISBN 3-540-64325-7. MR 1725357.
Shiryaev, Albert N. (2019). Probability—2. Graduate Texts in Mathematics. Vol. 95. Translated by Boas, R. P.; Chibisov, D. M. (Third edition of 1980 original ed.). New York: Springer. doi:10.1007/978-0-387-72208-5. ISBN 978-0-387-72207-8. MR 3930599.

External links

Shiryaev, Albert N. (2001) [1994], "Martingale", Encyclopedia of Mathematics, EMS Press

v t e Stochastic processes
Discrete time	Bernoulli process Branching process Chinese restaurant process Galton–Watson process Independent and identically distributed random variables Markov chain Moran process Random walk Loop-erased Self-avoiding Biased Maximal entropy
Continuous time	Additive process Bessel process Birth–death process pure birth Brownian motion Bridge Excursion Fractional Geometric Meander Cauchy process Contact process Continuous-time random walk Cox process Diffusion process Empirical process Feller process Fleming–Viot process Gamma process Geometric process Hawkes process Hunt process Interacting particle systems Itô diffusion Itô process Jump diffusion Jump process Lévy process Local time Markov additive process McKean–Vlasov process Ornstein–Uhlenbeck process Poisson process Compound Non-homogeneous Schramm–Loewner evolution Semimartingale Sigma-martingale Stable process Superprocess Telegraph process Variance gamma process Wiener process Wiener sausage
Both	Branching process Galves–Löcherbach model Gaussian process Hidden Markov model (HMM) Markov process Martingale Differences Local Sub- Super- Random dynamical system Regenerative process Renewal process Stochastic chains with memory of variable length White noise
Fields and other	Dirichlet process Gaussian random field Gibbs measure Hopfield model Ising model Potts model Boolean network Markov random field Percolation Pitman–Yor process Point process Cox Poisson Random field Random graph
Time series models	Autoregressive conditional heteroskedasticity (ARCH) model Autoregressive integrated moving average (ARIMA) model Autoregressive (AR) model Autoregressive–moving-average (ARMA) model Generalized autoregressive conditional heteroskedasticity (GARCH) model Moving-average (MA) model
Financial models	Binomial options pricing model Black–Derman–Toy Black–Karasinski Black–Scholes Chan–Karolyi–Longstaff–Sanders (CKLS) Chen Constant elasticity of variance (CEV) Cox–Ingersoll–Ross (CIR) Garman–Kohlhagen Heath–Jarrow–Morton (HJM) Heston Ho–Lee Hull–White LIBOR market Rendleman–Bartter SABR volatility Vašíček Wilkie
Actuarial models	Bühlmann Cramér–Lundberg Risk process Sparre–Anderson
Queueing models	Bulk Fluid Generalized queueing network M/G/1 M/M/1 M/M/c
Properties	Càdlàg paths Continuous Continuous paths Ergodic Exchangeable Feller-continuous Gauss–Markov Markov Mixing Piecewise-deterministic Predictable Progressively measurable Self-similar Stationary Time-reversible
Limit theorems	Central limit theorem Donsker's theorem Doob's martingale convergence theorems Ergodic theorem Fisher–Tippett–Gnedenko theorem Large deviation principle Law of large numbers (weak/strong) Law of the iterated logarithm Maximal ergodic theorem Sanov's theorem Zero–one laws (Blumenthal, Borel–Cantelli, Engelbert–Schmidt, Hewitt–Savage, Kolmogorov, Lévy)
Inequalities	Burkholder–Davis–Gundy Doob's martingale Doob's upcrossing Kunita–Watanabe Marcinkiewicz–Zygmund
Tools	Cameron–Martin formula Convergence of random variables Doléans-Dade exponential Doob decomposition theorem Doob–Meyer decomposition theorem Doob's optional stopping theorem Dynkin's formula Feynman–Kac formula Filtration Girsanov theorem Infinitesimal generator Itô integral Itô's lemma Karhunen–Loève theorem Kolmogorov continuity theorem Kolmogorov extension theorem Lévy–Prokhorov metric Malliavin calculus Martingale representation theorem Optional stopping theorem Prokhorov's theorem Quadratic variation Reflection principle Skorokhod integral Skorokhod's representation theorem Skorokhod space Snell envelope Stochastic differential equation Tanaka Stopping time Stratonovich integral Uniform integrability Usual hypotheses Wiener space Classical Abstract
Disciplines	Actuarial mathematics Control theory Econometrics Ergodic theory Extreme value theory (EVT) Large deviations theory Mathematical finance Mathematical statistics Probability theory Queueing theory Renewal theory Ruin theory Signal processing Statistics Stochastic analysis Time series analysis Machine learning
List of topics Category

This page was last edited on 31 October 2023, at 15:44

From Wikipedia, the free encyclopedia