Page 422 -
P. 422

14.2  Online research  413




                  are still often difficult to use—the use of these tools for usability studies is at least
                  20 years old (Hartson et al., 1996). Web conferencing tools capable of remote screen-
                  sharing (either one window at a time or full-screen) and integrated audio via voice-over
                  IP or telephone, provide a basis for conversations between researcher and participant,
                  both looking at the same screen content. Some tools go further, providing webcam
                  video for participants, recording capabilities, and even remote mouse/keyboard con-
                  trol, providing one participant in the conversation to (with permission) control their
                  interlocutor's computer.
                     Given these features, it is quite possible to conduct contextual inquiry and think-
                  aloud studies online. Contextual inquiries are perhaps easiest: your participant can
                  share his or her screen, start their work, and you can sit back and watch, asking ques-
                  tions as needed. The click-by-click view of the tool at hand will provide a detailed
                  picture of how individual actions are taken to complete tasks, and answers to questions
                  should help you understand the work. Think-aloud studies that use traditional desktop
                  software are slightly more challenging, as your participants will probably not have
                  your software installed on their computers. Thus, web applications are particularly well
                  suited for remote think-aloud studies, as users can access your web site from their com-
                  puter, just as they would if the tool were deployed on a production server. Alternatively,
                  you might be able to send your participants an installable version of the software that
                  they might run locally. If this is not possible, remote mouse and keyboard capabilities
                  might help users control the software on your machine. In any case, once these details
                  are worked out the study can proceed much like any other think-aloud.
                     Choosing the correct tools for this sort of work is critical. Beyond basic screen-
                  sharing and integrated audio, functionality for recording sessions is invaluable. The
                  ability to replay and review sessions will augment your memory and free you up to
                  focus on the participants' comments and actions, rather than on note-taking. Webcam
                  video can be a great way to see the participants' facial expression and body language,
                  restoring some of the fidelity lost when the participant is not in the room with the re-
                  searcher. However, this value is limited—many tools provide only webcam or screen
                  sharing, but not both simultaneously. Remote mouse keyboard/control can be very
                  helpful, but only if it works well. If you are planning on using this remote control
                  facility, do not forget that your computer will be unavailable to you while the par-
                  ticipant is controlling things—you will not be able to use your own machine to take
                  notes. A second computer might be needed. Do your due diligence before relying on
                  one of these tools to conduct your study—compare features, use free trials to see how
                  well services really work, and try multiple pilot sessions.
                     Other technical challenges associated with online observational studies include
                  firewalls and desktop configurations. Some users may work in institutions that might
                  be unfriendly to the use of these tools, potentially blocking access. Network poli-
                  cies at your own institution may be a difficulty as well, as firewall exceptions might
                  be needed to place your web application on a system that is visible to the outside
                  world. Web conferencing tools might require the installation of plugins on the par-
                  ticipants' computers, a process that might be difficult or impossible in some working
                  environments. For these reasons, you might also ask each participant to conduct a
   417   418   419   420   421   422   423   424   425   426   427