Page 122 - Comparing Political Communication Theories, Cases, and Challenge
P. 122

P1: JZZ/KAA  P2: KaF
                          0521828317c05.xml  CY425/Esser  0521828317  May 22, 2004  11:55






                                                 Werner Wirth and Steffen Kolb

                                indispensable, especially if the research team is nationally based and is
                                not cooperating with international partners.
                                   It is extremely difficult to prove construct equivalence beyond any
                                doubt. Construct validation is a difficult task in one country alone, so
                                that the international perspective only complicates the situation further.
                                Besides, an identical state of internal and external structures might even
                                be the result of cultural bias and/or occur at random. The probability
                                of a random state of “sameness” decreases with the number of countries
                                included in the study. Moreover, this probability can be calculated sta-
                                tistically and published in the findings. Most procedures of construct
                                validation require multidimensional or item-battery measurement, be-
                                cause the internal structure cannot be tested when measured in just one
                                variable (van de Vijver and Leung 1996, 273; 1997, 17; van Deth 1998). In
                                the face of these problems, one might ask whether the effort undertaken
                                to achieve construct validation is worthwhile. Yet, only the procedures
                                we have presented will lead to a well-founded decision, irrespective of the
                                preferred approach to be undertaken for the enquiry, be it etic, emic, or
                                etic-emic (van de Vijver and Leung 1997, 12–15).


                                Item Equivalence and Item Bias
                                   Even withagiven construct equivalence, bias can still occur on the
                                item level. The verbalization of items in surveys (and of definitions and
                                categories in content analyses) can cause bias due to culture-specific con-
                                notations. Item bias is mostly evoked by bad, in the sense of nonequiva-
                                lent, translation or by culture-specific questions and categories (van de
                                Vijver and Leung 1997, 17). Psychological inventories and item batteries
                                in particular can be tested for item equivalence, using several procedures
                                derived from the “item response theory” (e.g., Lienert and Raatz 1994;
                                van de Vijver and Leung 1997, 62–88). Compared to the complex proce-
                                dures discussed in the case of construct equivalence, the testing for item
                                bias is rather simple (once construct equivalence has been established):
                                Persons from different cultures, who take the same positions or ranks
                                on an imaginary construct scale, must show the same attitude toward
                                every item that measures the construct. Statistically, the correlation of
                                the single items with the total (sum) score have to be identical in every
                                culture, as the test theory generally uses the total score to estimate the
                                position of any individual on the construct scale. Hui and Triandis (1985,
                                135) add scalar equivalence to the list. This tests whether the construct
                                is measured on the same scale. In general, different wordings of ques-
                                tions or categories have to be well-founded and published in the research


                                                              102
   117   118   119   120   121   122   123   124   125   126   127