Chebyshev's Lemma:
Let X be a random variable with mean μ and variance σ2. Then Chebyshev's lemma states that for any k > 0
P{¦X-μ¦≥ k} ≤ σ2/k2
Proof:
Let X be a continuous random variable with pdf f ( x ). We have
σ2 = Var (X) = (x-μ)2 f(x)dx
= (x-μ)2 f(x)dx + (x-μ)2 f(x)dx
+ (x-μ)2 f(x)dx ≥ (x-μ)2 f(x)dx + (x-μ)2 f(x)dx
≥ k2 { f(x) dx + f(x) dx}
since in both the ranges of integration ( x - μ )2 ≥ k2.
Hence
σ 2 ≥ k2 P(X ≤ μ - k ) u X ≥ μ +k) =k2 p(¦X- μ¦≥ k)
or
P(¦X-μ¦≥ k) ≤ σ2/k2
The inequality can also be proved by taking X to be a discrete random variable.