To install click the Add extension button. That's it.

The source code for the WIKI 2 extension is being checked by specialists of the Mozilla Foundation, Google, and Apple. You could also do it yourself at any point in time. 4,5
Kelly Slayton
Congratulations on this excellent venture… what a great idea!
Alexander Grigorievskiy
I use WIKI 2 every day and almost forgot how the original Wikipedia looks like.
Live Statistics
English Articles
Improved in 24 Hours
Languages
Recent
Show all languages
What we do. Every page goes through several hundred of perfecting techniques; in live mode. Quite the same Wikipedia. Just better.
.
Leo
Newton
Brights
Milds Heavy-tailed distribution

In probability theory, heavy-tailed distributions are probability distributions whose tails are not exponentially bounded: that is, they have heavier tails than the exponential distribution. In many applications it is the right tail of the distribution that is of interest, but a distribution may have a heavy left tail, or both tails may be heavy.

There are three important subclasses of heavy-tailed distributions: the fat-tailed distributions, the long-tailed distributions and the subexponential distributions. In practice, all commonly used heavy-tailed distributions belong to the subexponential class.

There is still some discrepancy over the use of the term heavy-tailed. There are two other definitions in use. Some authors use the term to refer to those distributions which do not have all their power moments finite; and some others to those distributions that do not have a finite variance. The definition given in this article is the most general in use, and includes all distributions encompassed by the alternative definitions, as well as those distributions such as log-normal that possess all their power moments, yet which are generally considered to be heavy-tailed. (Occasionally, heavy-tailed is used for any distribution that has heavier tails than the normal distribution.)

• 1/5
Views:
22 512
9 581
318
1 358
1 439
• ✪ The Law of Large Numbers and Fat Tailed Distributions
• ✪ 5. Poisson Combining and Splitting
• ✪ Daniel Pele | UPESW 2013: Fractals and Heavy Tails in the Romanian Stock Market
• ✪ From Data to Knowledge - 104 - Yan Liu
• ✪ Mircea Gligor | UPESW 2013: Statistical Properties of Small World Networks

Definitions

Definition of heavy-tailed distribution

The distribution of a random variable X with distribution function F is said to have a heavy (right) tail if the moment generating function of X, MX(t), is infinite for all t > 0.

That means

$\int _{-\infty }^{\infty }e^{tx}\,dF(x)=\infty \quad {\mbox{for all }}t>0.$ An implication of this is that

$\lim _{x\to \infty }e^{tx}\Pr[X>x]=\infty \quad {\mbox{for all }}t>0.\,$ This is also written in terms of the tail distribution function

${\overline {F}}(x)\equiv \Pr[X>x]\,$ as

$\lim _{x\to \infty }e^{tx}{\overline {F}}(x)=\infty \quad {\mbox{for all }}t>0.\,$ Definition of long-tailed distribution

The distribution of a random variable X with distribution function F is said to have a long right tail if for all t > 0,

$\lim _{x\to \infty }\Pr[X>x+t\mid X>x]=1,\,$ or equivalently

${\overline {F}}(x+t)\sim {\overline {F}}(x)\quad {\mbox{as }}x\to \infty .\,$ This has the intuitive interpretation for a right-tailed long-tailed distributed quantity that if the long-tailed quantity exceeds some high level, the probability approaches 1 that it will exceed any other higher level.

All long-tailed distributions are heavy-tailed, but the converse is false, and it is possible to construct heavy-tailed distributions that are not long-tailed.

Subexponential distributions

Subexponentiality is defined in terms of convolutions of probability distributions. For two independent, identically distributed random variables $X_{1},X_{2}$ with common distribution function $F$ the convolution of $F$ with itself, $F^{*2}$ is convolution square, using Lebesgue–Stieltjes integration, by:

$\Pr[X_{1}+X_{2}\leq x]=F^{*2}(x)=\int _{0}^{x}F(x-y)\,dF(y).$ The n-fold convolution $F^{*n}$ is defined in the same way. The tail distribution function ${\overline {F}}$ is defined as ${\overline {F}}(x)=1-F(x)$ .

A distribution $F$ on the positive half-line is subexponential if

${\overline {F^{*2}}}(x)\sim 2{\overline {F}}(x)\quad {\mbox{as }}x\to \infty .$ This implies that, for any $n\geq 1$ ,

${\overline {F^{*n}}}(x)\sim n{\overline {F}}(x)\quad {\mbox{as }}x\to \infty .$ The probabilistic interpretation of this is that, for a sum of $n$ independent random variables $X_{1},\ldots ,X_{n}$ with common distribution $F$ ,

$\Pr[X_{1}+\cdots +X_{n}>x]\sim \Pr[\max(X_{1},\ldots ,X_{n})>x]\quad {\text{as }}x\to \infty .$ This is often known as the principle of the single big jump or catastrophe principle.

A distribution $F$ on the whole real line is subexponential if the distribution $FI([0,\infty ))$ is. Here $I([0,\infty ))$ is the indicator function of the positive half-line. Alternatively, a random variable $X$ supported on the real line is subexponential if and only if $X^{+}=\max(0,X)$ is subexponential.

All subexponential distributions are long-tailed, but examples can be constructed of long-tailed distributions that are not subexponential.

Common heavy-tailed distributions

All commonly used heavy-tailed distributions are subexponential.

Those that are one-tailed include:

Those that are two-tailed include:

Relationship to fat-tailed distributions

A fat-tailed distribution is a distribution for which the probability density function, for large x, goes to zero as a power $x^{-a}$ . Since such a power is always bounded below by the probability density function of an exponential distribution, fat-tailed distributions are always heavy-tailed. Some distributions, however, have a tail which goes to zero slower than an exponential function (meaning they are heavy-tailed), but faster than a power (meaning they are not fat-tailed). An example is the log-normal distribution. Many other heavy-tailed distributions such as the log-logistic and Pareto distribution are, however, also fat-tailed.

Estimating the tail-index[when defined as?]

There are parametric (see Embrechts et al.) and non-parametric (see, e.g., Novak) approaches to the problem of the tail-index estimation.

To estimate the tail-index using the parametric approach, some authors employ GEV distribution or Pareto distribution; they may apply the maximum-likelihood estimator (MLE).

Pickand's tail-index estimator

With $(X_{n},n\geq 1)$ a random sequence of independent and same density function $F\in D(H(\xi ))$ , the Maximum Attraction Domain of the generalized extreme value density $H$ , where $\xi \in \mathbb {R}$ . If $\lim _{n\to \infty }k(n)=\infty$ and $\lim _{n\to \infty }{\frac {k(n)}{n}}=0$ , then the Pickands tail-index estimation is

$\xi _{(k(n),n)}^{\text{Pickands}}={\frac {1}{\ln 2}}\ln \left({\frac {X_{(n-k(n)+1,n)}-X_{(n-2k(n)+1,n)}}{X_{(n-2k(n)+1,n)}-X_{(n-4k(n)+1,n)}}}\right)$ where $X_{(n-k(n)+1,n)}=\max \left(X_{n-k(n)+1},\ldots ,X_{n}\right)$ . This estimator converges in probability to $\xi$ .

Hill's tail-index estimator

Let $(X_{t},t\geq 1)$ be a sequence of independent and identically distributed random variables with distribution function $F\in D(H(\xi ))$ , the maximum domain of attraction of the generalized extreme value distribution $H$ , where $\xi \in \mathbb {R}$ . The sample path is ${X_{t}:1\leq t\leq n}$ where $n$ is the sample size. If $\{k(n)\}$ is an intermediate order sequence, i.e. $k(n)\in \{1,\ldots ,n-1\},$ , $k(n)\to \infty$ and $k(n)/n\to 0$ , then the Hill tail-index estimator is

$\xi _{(k(n),n)}^{\text{Hill}}=\left({\frac {1}{k(n)}}\sum _{i=n-k(n)+1}^{n}\ln(X_{(i,n)})-\ln(X_{(n-k(n)+1,n)})\right)^{-1},$ where $X_{(i,n)}$ is the $i$ -th order statistic of $X_{1},\dots ,X_{n}$ . This estimator converges in probability to $\xi$ , and is asymptotically normal provided $k(n)\to \infty$ is restricted based on a higher order regular variation property . Consistency and asymptotic normality extend to a large class of dependent and heterogeneous sequences, irrespective of whether $X_{t}$ is observed, or a computed residual or filtered data from a large class of models and estimators, including mis-specified models and models with errors that are dependent.

Ratio estimator of the tail-index

The ratio estimator (RE-estimator) of the tail-index was introduced by Goldie and Smith. It is constructed similarly to Hill's estimator but uses a non-random "tuning parameter".

A comparison of Hill-type and RE-type estimators can be found in Novak.

Software

• aest, C tool for estimating the heavy-tail index.

Estimation of heavy-tailed density

Nonparametric approaches to estimate heavy- and superheavy-tailed probability density functions were given in Markovich. These are approaches based on variable bandwidth and long-tailed kernel estimators; on the preliminary data transform to a new random variable at finite or infinite intervals which is more convenient for the estimation and then inverse transform of the obtained density estimate; and "piecing-together approach" which provides a certain parametric model for the tail of the density and a non-parametric model to approximate the mode of the density. Nonparametric estimators require an appropriate selection of tuning (smoothing) parameters like a bandwidth of kernel estimators and the bin width of the histogram. The well known data-driven methods of such selection are a cross-validation and its modifications, methods based on the minimization of the mean squared error (MSE) and its asymptotic and their upper bounds. A discrepancy method which uses well-known nonparametric statistics like Kolmogorov-Smirnov's, von Mises and Anderson-Darling's ones as a metric in the space of distribution functions (dfs) and quantiles of the later statistics as a known uncertainty or a discrepancy value can be found in. Bootstrap is another tool to find smoothing parameters using approximations of unknown MSE by different schemes of re-samples selection, see e.g.