Department of Library and Information Science, Graduate School of Education & Information Studies, 2320A Moore Hall, University of California, Los Angeles, Los Angeles, CA, 90095-1521, United States
Copyright 1996 INIST-CNRS CC BY 4.0 Sauf mention contraire ci-dessus, le contenu de cette notice bibliographique peut être utilisé dans le cadre d’une licence CC BY 4.0 Inist-CNRS / Unless otherwise stated above, the content of this bibliographic record may be used under a CC BY 4.0 licence by Inist-CNRS / A menos que se haya señalado antes, el contenido de este registro bibliográfico puede ser utilizado al amparo de una licencia CC BY 4.0 Inist-CNRS
Notes:
Sciences of information and communication. Documentation
FRANCIS
Accession Number:
edscal.3168995
Database:
PASCAL Archive
Further Information
Searching information retrieval systems is a highly interactive, iterative process that cannot be understood simply by comparing the output of a search session (the search product) to a query stated in advance. In this article, we examine evaluation goals and methods for studying information retrieval behavior, drawing examples from our own research and that of others. We limit our review to research that employs online monitoring, also known as transaction log analysis. Online monitoring is one of few methods that can capture detailed data on the search process at a reasonable cost; these data can be used to build quantitative models or to support qualitative interpretations of quantitative results. Monitoring is a data collection technique rather than a research design, and can be employed in experimental or field studies, whether alone or combined with other data collection methods. Based on the research questions of interest, the researcher must determine what variables to collect from each data source, which to treat as independent variables to manipulate, and which to treat as dependent variables to observe effects. Studies of searching behavior often treat search task and searcher characteristics as independent variables and may manipulate other independent variables specific to the research questions addressed. Search outcomes, time, and search paths frequently are treated as dependent variables. We discuss each of these sets of variables, illustrating them with sample results from the literature and from our own research. Our examples are drawn from the Science Library Catalog project, a 7-year study of children's searching behavior on an experimental retrieval system. We close with a brief discussion of the implications of these results for the design of information retrieval systems.
