Page 156 -
P. 156

6.4  What type of diary?  143




                    participation in the research should remain anonymous (see Chapter 15 for more
                  information on human subjects protection).



                  6.4  WHAT TYPE OF DIARY?

                  There are a number of different methodological decisions to make when using dia-
                  ries in HCI research: What type of diary? How will the diary be recorded (paper or
                  electronic)? For what period will the users be asked to keep the diary? Diaries are
                  typically kept for a period of 1 or 2 weeks (Rieman, 1993). Any longer than that and
                  participation tends to drop off.
                     At a high level, diaries can be split into two types of purpose: feedback and
                  elicitation (Carter and Mankoff, 2005). A feedback diary is one in which the data
                  from the diary itself provides the feedback to the researchers. The feedback diary
                  is the data collection method; the diary is not meant as a springboard to anything
                  else. In an elicitation diary, the data recorded in the diary is used for prompting,
                  when interviews take place at a later point, and the users are encouraged to ex-
                  pand upon each data point (see Chapter 8 for more information on interviews).
                  Feedback diaries usually focus on the events that interest the researcher, whereas
                  elicitation diaries usually focus on events that interest the user. Feedback diaries
                  tend to have instructions for users that they should make a diary entry when a
                  certain event or threshold occurs. Elicitation diaries tend to encourage users to
                  make diary entries based more on events that have meaning to the user. Feedback
                  diaries can be more accurate (since users record events on a regular basis as they
                  occur) and more objective but elicitation diaries can provide a view that is more
                  representative of what the user is feeling (Carter and Mankoff, 2005). In a similar
                  fashion to a survey, with an elicitation diary users must recall in a later interview
                  what has occurred and this can lead to bias. However, the data points recorded by
                  the user in the elicitation diary can provide some level of validation, which does
                  not exist in a survey.


                  6.4.1  FEEDBACK DIARY
                  Feedback diaries come in many different formats, but probably the most important
                  research question in a feedback diary is how often a diary entry is made. For in-
                  stance, what event, time, or threshold triggers the need for the user to make a diary
                  entry? Users could be asked to make a diary recording when an event occurs, such
                  as when they feel frustrated with an interface, or when they complete a certain task.
                  Users could be asked to make a diary recording at a set time every day (say, 9 p.m.),
                  or during a specified time period (say, from noon to 6 p.m.). Users could be inter-
                  rupted throughout the day at random times, to get a random sample of the user's
                  daily life (Carter and Mankoff, 2005). Historically, an individual in this type of
                  time diary study wears a beeper and must record what they are doing whenever the
   151   152   153   154   155   156   157   158   159   160   161