Sampling from Normal Distributions:
The exact sampling distribution of a statistics can be derived in certain cases. For example the distribution of the sample mean x¯ of a random sample X of size n from a normal population follows from case (iii) under distribution of sums of random variables in Section 6.2. From that it follows that Y = Xi =n x¯, has a N (n, μ, n σ2 ) distribution and thus x¯ has N (μ,σ2/n) distribution and
E(x¯) = μ, Var (x¯) = σ2/n
It can be further shown that, for samples from a normal population, x¯ and S2 are independently distributed and ns2/σ2 has x2 (n-1) distribution. The proof of these results is omitted.
Since
(x¯ - μ)/ (σ/√n) ∼ N (0, 1) and nS2/σ2 ∼ x2(n-1)
it follows from equation (6.10) that
Writing s2 for n S 2/ (n - 1), we have
t= X - μ/s-/√n ∼ t n-1
In' particular when μ = 0, the statistics t = x¯ ( s/√n) follows Student's t- distribution with ( n - 1 ) degrees of freedom. Several applications of this result will be considered in Block 3. Note that s2 = n S2/( n - 1 ) and E ( s 2 ) = n E ( s2 )/( n-1)=σ2
If S12 and S22, are the sample variances of two independent random samples
X1 = (X11,X12,...,Xin1)
And
X2 = (X21,X22,...,X2n2)
of sizes nl and n2, from two normal populations N ( μl, σl2 ) and N ( μ2, σ22 ) respectively, then
n1S12/σ12 ∼ x2n1-1
n2S22/σ22 ∼ x2n2-1
And
F=(n1S12/(n1-1) σ12)/( n2S22/(n2-1) σ22) -F(n1-1,n2-1)
Let
S12 = n1S12/(n1-1)' s22 = n2S22/(n2-1)
Then it follows which the statistic F = (s12/ σ12)/ (s22/ σ22) follows the F-distribution with nl - 1and n2 - 1 degree of freedom. Applications of all above results will be considered later.