Page 26 - Elements of Distribution Theory
P. 26

P1: JZP
            052184472Xc01  CUNY148/Severini  May 24, 2005  17:52





                            12                    Properties of Probability Distributions

                            a countable collection. Although this does hold, the proof is more complicated and it is
                            useful, if not essential, to use a more sophisticated method of proof.
                              A number of useful properties of distribution functions follow from the fact a distribution
                            function is nondecreasing. The following result gives one of these.

                            Theorem 1.5. Let F denote the distribution function of a distribution on R. Then the set of
                            points x at which F is not continuous is countable.

                            Proof. Let D denote the set of points at which F has a discontinuity. For each positive
                            integer m, let D m denote the set of points x in R such that F has a jump of at least 1/m at
                            x and let n m denote the number of elements in D m . Note that
                                                                ∞

                                                           D =    D m
                                                               m=1
                            since
                                                lim F(x) = 1  and  lim F(x) = 0,
                                                x→∞               x→−∞
                            n m ≤ m.It follows that the number of points of discontinuity is bounded by    ∞  m. The
                                                                                           m=1
                            result follows.

                            Discrete distributions
                            Hence, although a distribution function is not necessarily continuous, the number of jumps
                            must be countable; in many cases it is finite, or even 0. Let X denote a real-valued random
                            variable with distribution function F.If F is a step function, we say that the X has a discrete
                            distribution or is a discrete random variable.

                            Example 1.11 (Integer random variable). Let X denote a random variable with range
                            X ={1, 2,..., m} for some m = 1, 2,..., and let
                                                  θ j = Pr(X = j),  j = 1,..., m.

                              The distribution function of X is given by
                                                     0              if x < 1
                                                   
                                                   
                                                                   if 1 ≤ x < 2
                                                    θ 1
                                                   
                                                   
                                                   
                                                     θ 1 + θ 2
                                                                   if 2 ≤ x < 3
                                            F(x) =   .
                                                    .
                                                    .
                                                   
                                                   
                                                    θ 1 +· · · + θ m−1
                                                                   if m − 1 ≤ x < m
                                                   
                                                     1              if m ≤ x
                            where θ 1 ,...,θ m are constants summing to 1. Hence, F is a step function and X has a
                            discrete distribution.
                            Distribution functions for random vectors
                                                               d
                            Fora random vector X taking values in R , the distribution function is defined as the
                                        d
                            function F : R → [0, 1] given by
                                 F(x) = Pr{X ∈ (−∞, x 1 ] × (−∞, x 2 ] × ··· (−∞, x d ]},  x = (x 1 ,..., x d ).
   21   22   23   24   25   26   27   28   29   30   31