Page 321 - Probability and Statistical Inference
P. 321

298    6. Sufficiency, Completeness, and Ancillarity

                                 consists of the union of possibilities such as {X  = 0 ∩ X  = 0 ∩ X  = 0}, {X 1
                                                                                 2
                                                                                         3
                                                                         1
                                 = 0 ∩ X  = 1 ∩ X  = 0}, and {X  = 1 ∩ X  = 0 ∩ X  = 0}. Hence, if the event
                                                            1
                                        2
                                                                            3
                                                                    2
                                                3
                                 {U = 0} is observed, we know then that either T = 0 or T = 1 must be
                                 observed. But, the point is that we cannot be sure about a unique observed
                                 value of T. Thus, T can not be a function of U and so there is a contradiction.
                                 Thus, U can not be sufficient for p. !
                                    Example 6.3.3 (Example 6.2.10 Continued) Suppose that X , ..., X  are iid
                                                                                      1
                                                                                           n
                                 N(µ, σ ), where θθ θθ θ = (µ, σ) and both µ, σ are unknown, –∞ < µ < ∞, 0 < σ <
                                       2
                                 ∞. Here, χ = ℜ and Θ = ℜ × ℜ . We wish to find a minimal sufficient statistic
                                                           +
                                 for θθ θθ θ. Now, for two arbitrary data points x = (x , ..., x ) and y = (y , ..., y ),
                                                                          1
                                                                                                n
                                                                                          1
                                                                               n
                                 both from χ, we have:


                                 From (6.3.3), it becomes clear that the last expression would not involve the
                                 unknown parameter θθ θθ θ = (µ, σ) if and only if         as well as
                                                    , that is, if and only if     =            and
                                                 . Hence, by the theorem of Lehmann-Scheffé, we claim
                                 that                    is minimal sufficient for (µ, σ). !
                                    Theorem 6.3.2 Any statistic which is a one-to-one function of a minimal
                                 sufficient statistic is itself minimal sufficient.
                                    Proof Suppose that a statistic S is minimal sufficient for θθ θθ θ. Let us consider
                                 another statistic T = h(S) where h(.) is one-to-one. In Section 6.2.2, we
                                 mentioned that a one-to-one function of a (jointly) sufficient statistic is (jointly)
                                 sufficient and so T is sufficient. Let U be any other sufficient statistic for θθ θθ θ.
                                 Since, S is minimal sufficient, we must have S = g(U) for some g(.). Then,
                                 we obviously have T = h(S) = h(g(U)) = h   g(U) which verifies the minimality
                                 of the statistic T. !
                                    Example 6.3.4 (Example 6.3.3 Continued) Suppose that X , ..., X  are iid
                                                                                     1
                                                                                           n
                                 N(µ, σ ), where θθ θθ θ = (µ, σ) and both µ, σ are unknown, –∞ < µ < ∞, 0 < σ <
                                       2
                                 ∞. We know that                      is minimal sufficient for (µ, σ).
                                 Now, ( , S ) being a one-to-one function of T, we can claim that  (  , S ) is
                                                                                              2
                                           2
                                 also minimal sufficient. !
                                    Example 6.3.5 (Example 6.3.3 Continued) Suppose that X , X , X  are
                                                                                              3
                                                                                        1
                                                                                           2
                                 iid N(µ, σ ) where µ is unknown, but σ is assumed known, –∞ < µ < ∞,
                                          2
   316   317   318   319   320   321   322   323   324   325   326