To install click the Add extension button. That's it.

The source code for the WIKI 2 extension is being checked by specialists of the Mozilla Foundation, Google, and Apple. You could also do it yourself at any point in time.

Kelly Slayton
Congratulations on this excellent venture… what a great idea!
Alexander Grigorievskiy
I use WIKI 2 every day and almost forgot how the original Wikipedia looks like.
Live Statistics
English Articles
Improved in 24 Hours
Added in 24 Hours
Show all languages
What we do. Every page goes through several hundred of perfecting techniques; in live mode. Quite the same Wikipedia. Just better.

Relative likelihood

From Wikipedia, the free encyclopedia

In statistics, suppose that we have been given some data, and we are constructing a statistical model of that data. The relative likelihood compares the relative plausibilities of different candidate models or of different values of a parameter of a single model.

Relative likelihood of parameter values

Assume that we are given some data x for which we have a statistical model with parameter θ. Suppose that the maximum likelihood estimate for θ is . Relative plausibilities of other θ values may be found by comparing the likelihoods of those other values with the likelihood of . The relative likelihood of θ is defined to be[1][2][3][4][5]

where denotes the likelihood function. Thus, the relative likelihood is the likelihood ratio with fixed denominator .

The function

is the relative likelihood function.

Likelihood region

A likelihood region is the set of all values of θ whose relative likelihood is greater than or equal to a given threshold. In terms of percentages, a p% likelihood region for θ is defined to be.[1][3][6]

If θ is a single real parameter, a p% likelihood region will usually comprise an interval of real values. If the region does comprise an interval, then it is called a likelihood interval.[1][3][7]

Likelihood intervals, and more generally likelihood regions, are used for interval estimation within likelihood-based statistics (“likelihoodist” statistics): They are similar to confidence intervals in frequentist statistics and credible intervals in Bayesian statistics. Likelihood intervals are interpreted directly in terms of relative likelihood, not in terms of coverage probability (frequentism) or posterior probability (Bayesianism).

Given a model, likelihood intervals can be compared to confidence intervals. If θ is a single real parameter, then under certain conditions, a 14.65% likelihood interval (about 1:7 likelihood) for θ will be the same as a 95% confidence interval (19/20 coverage probability).[1][6] In a slightly different formulation suited to the use of log-likelihoods (see Wilks' theorem), the test statistic is twice the difference in log-likelihoods and the probability distribution of the test statistic is approximately a chi-squared distribution with degrees-of-freedom (df) equal to the difference in df-s between the two models (therefore, the e−2 likelihood interval is the same as the 0.954 confidence interval; assuming difference in df-s to be 1).[6][7]

Relative likelihood of models

The definition of relative likelihood can be generalized to compare different statistical models. This generalization is based on AIC (Akaike information criterion), or sometimes AICc (Akaike Information Criterion with correction).

Suppose that for some given data we have two statistical models, M1 and M2. Also suppose that AIC(M1 ) ≤ AIC(M2 ). Then the relative likelihood of M2 with respect to M1 is defined as follows.[8]

To see that this is a generalization of the earlier definition, suppose that we have some model M with a (possibly multivariate) parameter θ. Then for any θ, set M2 = M(θ), and also set M1 = M(). The general definition now gives the same result as the earlier definition.

See also


  1. ^ a b c d Kalbfleisch, J.G. (1985). Probability and Statistical Inference. Springer. §9.3..
  2. ^ Azzalini, A. (1996). Statistical Inference — Based on the likelihood. Chapman & Hall. §1.4.2. ISBN 9780412606502..
  3. ^ a b c Sprott, D.A. (2000). Statistical Inference in Science. Springer. chap. 2..
  4. ^ Davison, A.C. (2008). Statistical Models. Cambridge University Press. §4.1.2..
  5. ^ Held, L.; Sabanés Bové, D.S. (2014). Applied Statistical Inference — Likelihood and Bayes. Springer. §2.1..
  6. ^ a b c Rossi, R.J. (2018), Mathematical Statistics, Wiley, p. 267
  7. ^ a b Hudson, D.J. (1971). "Interval estimation from the likelihood function". Journal of the Royal Statistical Society, Series B. 33: 256–262..
  8. ^ Burnham, K. P.; Anderson, D. R. (2002), Model Selection and Multimodel Inference: A practical information-theoretic approach, Springer, §2.8.
This page was last edited on 26 September 2020, at 03:31
Basis of this page is in Wikipedia. Text is available under the CC BY-SA 3.0 Unported License. Non-text media are available under their specified licenses. Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc. WIKI 2 is an independent company and has no affiliation with Wikimedia Foundation.