Chebyshev's Lemma:
Let X be a random variable with mean μ and variance σ2. Then Chebyshev's lemma states that for any k > 0
P{¦X-μ¦≥ k} ≤ σ2/k2
Proof:
Let X be a continuous random variable with pdf f ( x ). We have
σ2 = Var (X) =
(x-μ)2 f(x)dx
=
(x-μ)2 f(x)dx +
(x-μ)2 f(x)dx
+
(x-μ)2 f(x)dx ≥
(x-μ)2 f(x)dx +
(x-μ)2 f(x)dx
≥ k2 {
f(x) dx +
f(x) dx}
since in both the ranges of integration ( x - μ )2 ≥ k2.
Hence
σ 2 ≥ k2 P(X ≤ μ - k ) u X ≥ μ +k) =k2 p(¦X- μ¦≥ k)
or
P(¦X-μ¦≥ k) ≤ σ2/k2
The inequality can also be proved by taking X to be a discrete random variable.