Video. Tobit Model MLE Derivation | Tobit Modelling Lecture 2 · 18:58 · YouTube

I cover the mathematical derivation of the Maximum Likelihood Estimation (MLE) log-likelihood function for the Tobit model under left-censoring.

The idea

Standard Ordinary Least Squares (OLS) regression fails when dependent variables are censored or bounded at a threshold (e.g., zero wage or minimum price floors), producing biased parameter estimates. The Tobit model addresses this by introducing an unobserved continuous latent variable yiy_i^* generated by a linear regression process. When the latent variable falls below a threshold CC, the observed response yiy_i is clamped at CC; otherwise, yiy_i equals yiy_i^*.

To estimate model parameters via Maximum Likelihood Estimation, the density function must be partitioned into two components: a discrete probability mass for observations at the censoring threshold and a continuous normal probability density for uncensored observations. By combining these terms into a single joint likelihood using indicator dummy variables, we formulate a differentiable log-likelihood objective.

The mechanism

yi=max(C,yi),yi=xiTβ+ϵi,ϵixiN(0,σ2)y_i = \max(C, y_i^*), \quad y_i^* = x_i^T \beta + \epsilon_i, \quad \epsilon_i \mid x_i \sim \mathcal{N}(0, \sigma^2)

This defines the Tobit framework where yiy_i^* is a latent variable and observed yiy_i is left-censored at threshold CC.

P(yi=Cxi)=Φ(CxiTβσ)P(y_i = C \mid x_i) = \Phi\left( \frac{C - x_i^T \beta}{\sigma} \right)

This calculates the cumulative distribution function (CDF) mass for observations that fall at or below the censoring limit CC.

f(yixi,yi>C)=1σϕ(yixiTβσ)f(y_i \mid x_i, y_i > C) = \frac{1}{\sigma} \phi\left( \frac{y_i - x_i^T \beta}{\sigma} \right)

This calculates the standard normal probability density function (PDF) for uncensored observations above threshold CC.

Qn(θ)=1Ni=1N(dilogΦ(CxiTβσ)+(1di)[logσ+logϕ(yixiTβσ)])\mathcal{Q}_n(\theta) = \frac{1}{N} \sum_{i=1}^N \left( d_i \log \Phi\left( \frac{C - x_i^T \beta}{\sigma} \right) + (1 - d_i) \left[ -\log \sigma + \log \phi\left( \frac{y_i - x_i^T \beta}{\sigma} \right) \right] \right)

This defines the average log-likelihood function optimized to find MLE estimates for parameters β\beta and σ\sigma, where di=I(yi=C)d_i = \mathbb{I}(y_i = C).

Worth knowing

  • Standard linear regression yields biased parameter estimates on censored data because it ignores the probability accumulation at threshold CC.
  • The censoring threshold CC is general and can represent zero, minimum wages, or price floors rather than strictly zero.
  • The likelihood function is a hybrid mixture: a discrete probability mass function for yi=Cy_i = C and a continuous probability density for yi>Cy_i > C.
  • Using an indicator variable di{0,1}d_i \in \{0, 1\} allows combining both piece-wise density conditions into a single continuous product before taking logarithms.

Mathematical derivation steps

  1. Define latent model: Express yi=xiTβ+ϵiy_i^* = x_i^T \beta + \epsilon_i with normal error ϵiN(0,σ2)\epsilon_i \sim \mathcal{N}(0, \sigma^2).
  2. Derive linear regression PDF: Express CDF F(yi)=P(ϵiyixiTβ)=Φ(yixiTβσ)F(y_i) = P(\epsilon_i \le y_i - x_i^T \beta) = \Phi\left(\frac{y_i - x_i^T \beta}{\sigma}\right) and differentiate with respect to yiy_i to obtain f(yi)=1σϕ(yixiTβσ)f(y_i) = \frac{1}{\sigma}\phi\left(\frac{y_i - x_i^T \beta}{\sigma}\right).
  3. Partition density function:
    • For yi<Cy_i < C: density is 00.
    • For yi=Cy_i = C: mass is P(yiC)=Φ(CxiTβσ)P(y_i^* \le C) = \Phi\left(\frac{C - x_i^T \beta}{\sigma}\right).
    • For yi>Cy_i > C: density is 1σϕ(yixiTβσ)\frac{1}{\sigma}\phi\left(\frac{y_i - x_i^T \beta}{\sigma}\right).
  4. Construct individual likelihood: Define indicator di=1d_i = 1 if yi=Cy_i = C and di=0d_i = 0 if yi>Cy_i > C. Form Li=[Φ(CxiTβσ)]di[1σϕ(yixiTβσ)]1diL_i = \left[\Phi\left(\frac{C - x_i^T \beta}{\sigma}\right)\right]^{d_i} \left[\frac{1}{\sigma}\phi\left(\frac{y_i - x_i^T \beta}{\sigma}\right)\right]^{1 - d_i}.
  5. Form log-likelihood: Apply logarithm rules to transform products into sums and average over NN observations.

Use it when / don't use it when

Use it when

  • Dependent variables in your dataset are strictly clustered or censored at a specific lower bound (e.g., 00).
  • You want unbiased estimates of linear model coefficients when working with corner-solution dependent variables like wages or dividend payments.

Don't use it when

  • The dependent variable is continuous and unrestricted across the real line.
  • Zero or boundary values are generated by a distinct qualitative selection process requiring a hurdle or selection model.

Further reading