Think Aloud Script

Think Aloud

Script

Step 1 - Introductions Read: During the next 15-20 minute survey you will be asked to visit the eERL or Electronic Environmental Resources Library, to perform two searches on an environmental topic of your choosing, to evaluate five results from each search. Though this survey will be tape recorded - you will remain anonymous throughout this exercise.





Step 2 - Explain "Think Aloud" Read: You will be asked to vocalize or "think out loud" throughout this survey. Since it is very important for us to understand your reactions and thoughts during this exercise you will be regularly reminded to vocalize your actions on the computer, as well as your thoughts, reactions and decisions.





Step 3 - Begin Taping Before the think aloud begins the interviewer should - turn on the tape recorder and ask the subject the following questions: a. Age b. Gender c. Occupation - (choices) Student, Instructor/Professor, Environmental Professional

Step 4 - Begin Think Aloud Direct subject to the eERL website http://www.eerl.org/ and ask subject to find information on a broad environmental topic of interest. Do NOT suggest a particular mode of searching - Keyword Search or Advanced Search vs. Browse Resources - rather allow the subject to make that choice. Be sure subject is vocalizing topic, choice, and actions ... e.g. I am choosing "air quality" or e.g. I am searching for water pollution using the keyword search


Step 5 - How Many Results Once the subject finds results from their searching/browsing ... Ask the subject - How many results did you get? (If no results ask subject to broaden or change their topic and repeat)




Step 6 - Evaluate Results Ask the subject to skim through each of the first FIVE results (or all results if fewer than five). For each of the first FIVE results ask the subject to rank on a scale of 0 to 5 the usefulness of each resource found. Scale of Usefulness: 5 Very Useful 4 Useful 3 Somewhat Useful 2 Not Useful 1 Poor 0 Very Poor	Be sure that either you or the subject - identify the title of each of the five resources that are ranked! e.g. CADENCEweb was a 3, ESRI: GIS was a 4




Step 7 - Repeat but Switch Methods After reviewing the first five results with the subject - return to the eERL homepage: http://www.eerl.org/ Now ask the subject to again locate information on their (the same) topic of interest ... but... have the subject use the alternative method.

i.e. If the subject used the search engine on their first attempt ask them to now find information on their topic by browsing the subject headings

or


i.e. If the subject first found information by using subject headings - ask them to now use either the Keyword Search or the Advanced Search to locate information on their topic.


Again have subjects review and rank the 1st FIVE results using the 0 - 5 Scale Scale of Usefulness: 5 Very Useful 4 Useful 3 Somewhat Useful 2 Not Useful 1 Poor 0 Very Poor	Be sure that either you or the subject - identify the title of each of the five resources that are ranked! e.g. CADENCEweb was a 3, ESRI: GIS was a 4








Step 8 - Summary Questions After completing steps 1-7 ask the subject the following questions:






Is eERL easy to use? Scale for ease of use : 5 Very Easy 4 Easy 3 Somewhat Easy 2 Somewhat Difficult 1 Difficult 0 Very Difficult







The best way to find information in eERL is to search by - Browsing the eERL Categories or Using the eERL Keyword Search or Advanced Search (Have subject state preference)






Step 9 - Advanced Search


If the Subject has not yet used the Advanced Search (they used Keyword Search instead) have them try their previous search using Advanced Search. Ask the Subject - "what is your impression of the Advanced Search"




Step 10 - Thank You and Follow Up


Thank Subject for their participation!	If the subject has any concerns or would like to ask some follow up questions have them contact: Chris Neuhaus (External Evaluator) --- Chris.Neuhaus@uni.edu


Housekeeping Details!	Before turning off the tape recorder be sure to record/speak: Your Name (Identify Yourself). Date. Where the survey took place (city and location ... e.g. Scott Community College, John Deere, India Gate Restaurant)