Exponentially modified Gaussian distribution

From Infogalactic: the planetary knowledge core
Jump to: navigation, search
EMG
Probability density function
Probability density function for the EMG distribution
Cumulative distribution function
Cumulative distribution function for the EMG distribution
Parameters μR — mean of Gaussian component
σ2 > 0 — variance of Gaussian component
λ > 0 — rate of exponential component
Support xR
PDF \frac{\lambda}{2} e^{\frac{\lambda}{2} (2 \mu + \lambda \sigma^2 - 2 x)}
             \operatorname{erfc} (\frac{\mu + \lambda \sigma^2 - x}{ \sqrt{2} \sigma})
CDF 
  \Phi(u, 0, v) - e^{-u + v^2/2+ \log(\Phi(u, v^2, v))\; }
where

  \Phi(x, \mu, \sigma) is the CDF of a Gaussian distribution

  u = \lambda(x - \mu)

  v = \lambda \sigma
Mean \mu + 1/\lambda
Mode x_m = \mu - \operatorname{sgn}\left(\tau\right)\sqrt{2}\sigma\operatorname{erfcxinv}\left(\frac{{{|}}\tau{{|}}}{\sigma}\sqrt{\frac{2}{\pi}}\right) + \frac{\sigma^2}{\tau} f(x_m)=h\exp \left( -\frac {1}{2} \left( \frac {x_m-\mu}{\sigma} \right)^2\right)
Variance \sigma^2 + 1/\lambda^2
Skewness \frac{2}{\sigma^3 \lambda^3} \left(  1 + \frac{1}{\sigma^2 \lambda^2}  \right)^{-3/2}
Ex. kurtosis \frac{3 (1 + \frac{2}{\sigma^2 \lambda^2} + \frac{3}{\lambda^4 \sigma^4})}{\left( 1 + \frac{1}{\lambda^2 \sigma^2} \right)^2  } - 3
MGF \left(1 - \frac{t}{\lambda}\right)^{-1}\,\exp \{ \mu t + \frac{1}{2}\sigma^2 t^2 \}
CF \left(1 - \frac{it}{\lambda}\right)^{-1}\,\exp \{ i\mu t - \frac{1}{2}\sigma^2 t^2 \}

In probability theory, an exponentially modified Gaussian (EMG) distribution (ExGaussian distribution) describes the sum of independent normal and exponential random variables. An exGaussian random variable Z may be expressed as Z = X + Y where X and Y are independent, X is Gaussian with mean μ and variance σ2 and Y is exponential of rate λ. It has a characteristic positive skew from the exponential component.

It may also be regarded as a weighted function of a shifted exponential with the weight being a function of the normal distribution.

Definition

The probability density function (pdf) of the exponentially modified normal distribution is[1]

f(x;\mu,\sigma,\lambda) = \frac{\lambda}{2} e^{\frac{\lambda}{2} (2 \mu + \lambda \sigma^2 - 2 x)}
             \operatorname{erfc} \left(\frac{\mu + \lambda \sigma^2 - x}{ \sqrt{2} \sigma}\right)

where erfc is the complementary error function defined as

\begin{align}
             \operatorname{erfc}(x) & = 1-\operatorname{erf}(x) \\
                                    & = \frac{2}{\sqrt{\pi}} \int_x^\infty e^{-t^2}\,dt.
       \end{align}

This density function is derived via convolution of the normal and exponential probability density functions.

The density function is a solution of the following differential equation:


\left\{\begin{array}{l}
\sigma ^2 f''(x)+f'(x) \left(\lambda  \sigma ^2-\mu +x\right)+\lambda  f(x) (x-\mu)=0, \\[12pt]
f(0)=\frac{1}{2} \lambda  e^{\frac{1}{2} \lambda  \left(\lambda  \sigma ^2+2 \mu
   \right)} \text{erfc}\left(\frac{\lambda  \sigma ^2+\mu }{\sqrt{2} \sigma}\right), \\[12pt]
f'(0)=\frac{\lambda  e^{-\frac{\mu ^2}{2 \sigma ^2}} \left(\sqrt{2}-\sqrt{\pi }
   \lambda  \sigma  e^{\frac{\left(\lambda  \sigma ^2+\mu \right)^2}{2 \sigma ^2}}
   \text{erfc}\left(\frac{\lambda  \sigma ^2+\mu }{\sqrt{2} \sigma }\right)\right)}{2 \sqrt{\pi
   } \sigma } \end{array} \right\}

Alternative forms for computation

An alternative but equivalent form of the EMG distribution is used for description of peak shape in chromatography.[2] This is as follows


f(x; h, \mu, \sigma, \tau )=\frac{h\sigma}{\tau} \sqrt{\frac{\pi}{2}}\exp \left( \frac {1}{2} \left( \frac {\sigma}{\tau} \right)^2 - \frac {x-\mu}{\tau} \right)  \operatorname{erfc} \left( \frac {1}{\sqrt{2}}\  \left( \frac {\sigma}{\tau}  - \frac {x-\mu}{\sigma} \right) \right ) ,
(1)

where

h = the amplitude of Gaussian,
\tau=\frac{1}{\lambda} exponent relaxation time.

This function cannot be calculated for some values of parameters (for example, τ=0) because of arithmetic overflow. Alternative, but equivalent form of writing the function was proposed by Delley[3]


f(x; h, \mu, \sigma, \tau )=h\exp \left( -\frac {1}{2} \left( \frac {x-\mu}{\sigma} \right)^2\right)  \frac{\sigma}{\tau} \sqrt{\frac{\pi}{2}}\operatorname{erfcx} \left( \frac {1}{\sqrt{2}}\  \left( \frac {\sigma}{\tau}  - \frac {x-\mu}{\sigma} \right) \right ) ,
(2)

where  \operatorname{erfcx} \left( t \right)=\exp{ \left( t^2 \right)}\operatorname{erfc} \left( t \right) is a scaled complementary error function

In the case of this formula arithmetic overflow is also possible, region of overflow is different from the first formula, except for very small τ.

For small τ it is reasonable to use asymptotic form of the second formula,


f(x; h, \mu, \sigma, \tau )=\frac{h\exp \left( -\frac {1}{2} \left( \frac {x-\mu}{\sigma} \right)^2\right)}  
  {\left(1- \frac {\left(x-\mu\right)\tau}{\sigma^2}   \right)} ,
(3)

Decision on formula usage is made on the basis of the parameter

z = \frac{1}{\sqrt{2}}\left( \frac {\sigma}{\tau}-\frac {x-\mu}{\sigma}  \right)

for z<0 computation should be made[2] according to the first formula,
for 0<=z<=6.71·107 (in the case of Double-precision floating-point format) according to the second formula,
and for z >6.71·107 according to the third formula.

Mode (position of apex, most probable value) is calculated[2] using derivative of formula 2; inverse of scaled complementary error function erfcxinv() is used for calculation. The apex is always located on the original (unmodified) Gaussian.

Parameter estimation

There are three parameters: the mean of the normal distribution (μ), the standard deviation of the normal distribution (σ) and the exponential decay parameter ( τ = 1 / λ ). A fourth parameter — the shape K = τ / σ — is sometimes used also to characterise the distribution. Depending on the values of the parameters the distribution may vary in shape from almost normal to almost exponential.

The parameters of the distribution can be estimated from the sample data with the method of moments as follows:,[4][5]

 m = \mu + \tau
s^2 = \sigma^2 + \tau^2
 \gamma_1 = \frac{ 2 \tau^{ 3 } } { ( \sigma^2 + \tau^2 )^{3/2} }

where m is the sample mean, s is the sample standard deviation and γ1 is the skewness.

Solving these for the parameters gives

  \hat{ \mu } = m - s \left( \frac{\gamma_1} {2} \right)^{ 1 / 3 }
 \hat{ \sigma^2 } = s^2 \left[ 1 - \left( \frac{ \gamma_1 } { 2 } \right)^{ 2 / 3 } \right]
 \hat{ \tau } = s \left( \frac{ \gamma_1 } { 2 } \right)^{ 1 / 3 }.

Recommendations

Ratcliff has suggested that there be at least 100 data points in the sample before the parameter estimates should be regarded as reliable.[6] Vincent averaging may be used with smaller samples as this procedure only modestly distorts the shape of the distribution.[7] These point estimates may be used as initial values that can be refined with more powerful methods including maximum likelihood.

Confidence intervals

There are currently no published tables available for significance testing with this distribution. The distribution can be simulated by forming the sum of two random variables one drawn from a normal distribution and the other from an exponential.

Skew

The value of the nonparametric skew

 \frac{\text{mean} - \text{median}}{\text{standard deviation}}

of this distribution lies between 0 and 0.31[8][9] The lower limit is approached when the normal component dominates and the upper when the exponential component dominates.

Usage

The distribution is used as a theoretical model for the shape of chromatographic peaks.[1][2][10] It has been proposed as a statistical model of intermitotic time in dividing cells.[11][12] It is also used in modelling cluster ion beams.[13] It is commonly used in psychology and other brain sciences in the study of response times.[14][15]

Related distributions

This family of distributions is a special or limiting case of the normal-exponential-gamma distribution. The distribution is a compound probability distribution in which the mean of a normal distribution varies randomly as a shifted exponential distribution.

References

  1. 1.0 1.1 Lua error in package.lua at line 80: module 'strict' not found.
  2. 2.0 2.1 2.2 2.3 Lua error in package.lua at line 80: module 'strict' not found.
  3. Lua error in package.lua at line 80: module 'strict' not found.
  4. Lua error in package.lua at line 80: module 'strict' not found.
  5. Olivier J and Norberg MM (2010) Positively skewed data: Revisiting the Box−Cox power transformation. Int J Psych Res 3 (1) 68−75
  6. Ratcliff R (1979). Group reaction time distributions and an analysis of distribution statistics. Psych Bull 86, 446−461
  7. Vincent SB (1912) The functions of the vibrissae in the behaviour of the white rat. Behaviour Monographs 1, 7−81
  8. Heathcote A (1996). RTSYS: A DOS application for the analysis of reaction time data. Behavioural Research Methods, Instruments, & Computers 28, 427−445
  9. Ulrich R, & Miller J (1994) Effects of outlier exclusion on reaction time analysis. J Exp Psych: General 123, 34−80
  10. Lua error in package.lua at line 80: module 'strict' not found.
  11. Lua error in package.lua at line 80: module 'strict' not found.
  12. Lua error in package.lua at line 80: module 'strict' not found.
  13. Lua error in package.lua at line 80: module 'strict' not found.
  14. Palmer EM and Horowitz Todd S, Torralba A, Wolfe JM (2011) What are the shapes of response time distributions in visual search? J Exp Psychol 37(1) 58–71
  15. Rohere D, Wixted JT (1994) An analysis of latency and interresponse time in free recall. Memory & Cognition 22 (5) 511–524