Page 153 -
P. 153

140    CHAPTER 6  Diaries




                         did not do so? (Carter and Mankoff, 2005) Neither observation nor automated data
                         collection would be able to record that.
                            Despite all of the benefits of using diaries for HCI research, there are some po-
                         tential disadvantages. If you are asking for participants to provide insights as a part
                         of a diary entry, for some individuals, they may not be introspective or aware enough
                         to do that. While time recording may be more accurate using a diary as compared to
                         a survey, automated methods of data collection, when available, may still be more
                         accurate. It can also be challenging sometimes, to get participants to record a suf-
                         ficient number of diary entries. Furthermore, if a diary study requires a high number
                         of diary entries, or very personal information, participants may not want to take part
                         in the study, or again, may record diary entries relatively infrequently. A summary of
                         the strengths and weaknesses of diaries appears in Table 6.1.


                          Table 6.1  Strengths and Weaknesses of Diaries
                          Advantages                        Disadvantages
                          Good for understanding how individuals   Participants are sometimes not
                          utilize technology in nonworkplace,   introspective and not aware of the specifics
                          noncontrolled, or on-the-go settings  of what they are doing; they may therefore
                                                            have trouble recording it in a diary entry
                          Good for understanding the “why” of
                          user interaction with a technology or any   Participants may not follow through and
                          technology phenomenon             record a sufficient number of entries
                          More accurate time recording than in a   Time recording may be less accurate
                          survey                            than in a controlled laboratory setting or
                                                            automated data collection
                          Good for collecting data that is fluid, and
                          changes over time (such as time, mood,   Generally harder to recruit participants for
                          perception, or response)          a diary study than for a less intrusive study,
                                                            such as a survey
                          The limited gap between an event
                          happening and it being recorded can help   Since data is both qualitative and
                          limit the impact of individual personality on   quantitative, data analysis may take a long
                          interpretation of what occurred   time
                          Good for collecting user-defined data (e.g.,   Hard to strike a balance between a
                          when a user intended to perform an action   frequent-enough series of diary entries
                          but did not do so)                and infringement on daily activities (user
                                                            participation may then trail off)


                            Diaries can investigate the use of technology that exists at multiple stages:
                         •  Technology that does not exist yet but could (where researchers investigate
                            communication or information usage patterns, separate from the
                            technology).
                         •  Technology that exists but needs to be improved (how people use existing
                            technology).
                         •  Prototypes of new technology that need to be evaluated.
   148   149   150   151   152   153   154   155   156   157   158