Instructions for Usability Testing

These instructions assume you have built a tapeless usability lab as detailed in Usability Lab Setup Instruction.

Day of Test

Prepare the room

• Clean the room
• Turn on the Subject PC
• Prepare the Monitor PC
• Verify that the Monitor PC is already on. (If not, turn it on and then put a "Never turn this off" sign on it.)
• Start Broadcasting
• Double-click microphone encoder session on the desktop.
• On the Windows Media Encoder window, click Start.
• Verify that the volume bar on the left side responds when you speak, and that there is a green bar on the bottom of the window labelled Encoder broadcasting.
• Minimize the Windows Media Encoder window.
• Double-click on the VNC icon in the system tray on the bottom left.
• In the Connection details dialog, the VNC Server should already be yoursubjectpc. Click OK.
• Enter session password, password, and click OK.
• Double-click the Camtasia Recorder icon on the desktop.
• Put up "Usability Test This Way" signs on the front door and in the hallway
• Make a paperwork stack for each test user
• NDA/Consent Form
• Test instructions
• Experience questionnaire
• Copy of test tasks for observers

When the tester arrives

• Have them sign NDA
• Review how the test works. Cover the following points:
• confidentiality, in both directions. 
• don't discuss the unreleased product you are about to see
• your results are anonymous
• The purpose of the test is to test the product, not you. You're part of the testing team. To succeed, all you have to do is keep talking. It doesn't matter if the test tasks are completed.
• feel free to stop and check help at any point that you would normally do so
• The screen and the sound will be recording, and the recording distributed (anonymously)within the company
• be honest. Don't spare our feelings. Don't hold back on incomplete impressions.
• think out loud - ideally, talk the whole time
• you can pause or end the test at any time for any reason.  You'll still be paid.
• There may be bugs in the product. I will intervene if I recognize a known bug.
• please ask questions. I may not answer them, but don't let that stop you.

Starting the test

• Start Recording
• On the Camtasia Recorder window, click the red circle to record.
• The cursor will change into a large rectangle. Align the rectangle over the VNC window so that everything is captured except for the usetest02 title bar at the top.
• When the length counter in the Camtasia Recorder window changes from 00:00, start your watch timer.
• Minimize the Camtasia window. If any pop-ups appear, close them.
• Conduct the test

After the test

• Ask the user to fill out the questionnaire both on paper and verbally.
• "What else do you want to tell me or ask me?"

After the tester leaves

• Stop the recording
• right clicking on the Camtasia icon in the taskbar on the bottom right and clicking Stop. The system will be sluggish as you move the mouse and click so be patient
• Move the new file from G:\Public\usetest-###.avi to G:\Public\Web Site\Test Results and rename it to YYYY_MM_DD_PartN.avi.
• Write up your notes and distribute them.
  

Version History