Register today for our Generative AI Foundations course. Use code GenAI99 for a discount price of $99!
Skip to content

Likelihood Function

Likelihood Function:

Likelihood function is a fundamental concept in statistical inference. It indicates how likely a particular population is to produce an observed sample.

Let P(X; T) be the distribution of a random vector X, where T is the vector of parameters of the distribution. If Xo is the observed realization of vector X, an outcome of an experiment, then the function L(T | Xo) = P(Xo | T) is called a likelihood function. In other words, you have to substitute the observations instead of the random vector into the expression for probability of the random vector, and to consider the new expression as a function of parameters T. The likelihood function varies from outcome to outcome of the same experiment, for example, from sample to sample.

The likelihood function itself is not probability (nor density) because its argument is the parameter T of the distribution, not the random (vector) variable X itself. For example, the sum (or integral) of the likelihood function over all possible values of T should not be equal to 1.

Even if the set of all possible values of the vector T is discrete, the likelihood function still may be continuous (as far as the set of parameters T is continuous).

Suppose you have a sample of 50 balls – 10 white and 40 black. The balls have been drawn randomly from a large bag with black and white balls (population). The question of interest is the proportion of white balls in the population. A Binomial distribution Pb(X; N=50, p=T) is a reasonable statistical model for the number X of black balls in a sample of N=50 balls drawn from a population with proportion T of black balls. To obtain the likelihood function for your data you have to substitute observation X=10 into the formula for the binomial distribution, and to consider the expression as a function of T. (Note: the number of possible outcomes X is finite – 51, but the likelihood function is still a function of a continuous parameter T – the proportion of black balls in the population).

See also: Maximum Likelihood Estimator

 

If the symbols do not display properly, try
the graphic version of this page

Browse Other Glossary Entries

Test Yourself

Planning on taking an introductory statistics course, but not sure if you need to start at the beginning? Review the course description for each of our introductory statistics courses and estimate which best matches your level, then take the self test for that course. If you get all or almost all the questions correct, move on and take the next test.

Data Analytics

Considering becoming adata scientist, customer analyst or our data science certificate program?

Analytics Quiz

Advanced Statistics Quiz

Statistics Quiz

Statistics

Looking at statistics for graduate programs or to enhance your foundational knowledge?

Statistics 1 Quiz

Regression Quiz

Regression Quiz

Biostatistics

Entering the biostatistics field? Test your skill here.

Biostatistics Quiz

Advanced Statistics Quiz

Statistics 2 Quiz

Stay Informed

Our Blog

Read up on our latest blogs

Certificates

Learn about our certificate programs

Courses

Find the right course for you

Contact Us

We'd love to answer your questions

Our mentors and academic advisors are standing by to help guide you towards the courses or program that makes the most sense for you and your goals.

300 W Main St STE 301, Charlottesville, VA 22903

(434) 973-7673

ourcourses@statistics.com

By submitting your information, you agree to receive email communications from Statistics.com. All information submitted is subject to our privacy policy. You may opt out of receiving communications at any time.