• What high school/college/university degrees/diplomas do you have (or expect to have)?

 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

____________________________________
degree                 major                         date

_____________________________________
degree                 major                         date

_____________________________________
degree                 major                         date

_____________________________________
degree                 major                         date

_____________________________________
degree                 major                         date

• What is your occupation?

___________________________________
 
•  What is your gender?

o Female
o Male

• What is your age? ________ years

• Have you participated in previous TREC Searching Studies?

o Yes
o No

• Overall, for how many years have you been doing online searching? _________ years

  Please circle the number closest to your experience.......
 
 

How much experience have you had...	No experience		Some experience		A great deal of experience
1. using a point-and-click interface (e.g., Macintosh, Windows)	1	2	3	4	5
2. searching on computerized library catalogs either locally (e.g., your library) or remotely (e.g., the U.S. Library of Congress)	1	2	3	4	5
3.  searching on commercial online systems (e.g., BRS Afterdark, Dialog, Lexis-Nexis)	1	2	3	4	5
4. searching on world wide web search services (e.g., Alta Vista, Google, Excite, Yahoo, HotBot, WebCrawler)	1	2	3	4	5
5. using Machine Translation software or free web translation services (BabelFish, Systran, Universal Translator, etc).	1	2	3	4	5

 Please circle the number that is closest to your searching behavior....
 

	Never	Once or twice a year	Once or twice a month	Once or twice a week	Once or twice a day
7. How often do you conduct a search on any kind of system?	1	2	3	4	5

 

 Please circle the number that indicates to what extent you agree with the following statement.......
 

	Strongly  Disagree	Disagree	Neutral	Agree	Strongly  Agree
8. I enjoy carrying out information searches.	1	2	3	4	5

Please indicate your knowledge of <DOCUMENT LANGUAGE USED IN SITE (ENGLISH/FRENCH)>
 
 

	none	poor	average	good	Excellent
8. My reading skills in  <ENGLISH/FRENCH> are	1	2	3	4	5

Searcher #___________
Condition ___________
Topic # _____________

Please answer the following questions, as they relate to this specific topic.
 

	Not at all		Somewhat		Extremely
1. Are you familiar with this topic?	1	2	3	4	5
2. Was it easy to get started on this search?	1	2	3	4	5
3. Was it easy to do the relevance judgements on this topic?	1	2	3	4	5
4. Do you have confidence in your judgements?	1	2	3	4	5

Searcher #___________
Condition ___________

• Now, please consider the searching experience that you just had.

• Please write down any other comments that you have about your experience with this system here. Thank you!

Searcher #___________
Condition ___________
Topic # _____________

Make a note of questions or comments that the participants have. You may also make a note of any problems you notice them having or anything that seems interesting to you about their searching behavior.
 
 

Please consider the entire document selection experience that you just had when you respond to the following questions.
 

	Not at all		Somewhat		Completely
1. To what extent did you understand the nature of the document selection task?	1	2	3	4	5
2. How different did you find the systems from one another?	1	2	3	4	5

4.  Which of the two systems did you find easier to learn to use?

 SYSTEM 1  ___________            SYSTEM 2  ___________           No difference  ___________

 SYSTEM 1  ___________            SYSTEM 2  ___________           No difference  ___________

 SYSTEM 1  ___________            SYSTEM 2  ___________           No difference  ___________