Assessing Information Search by Task Outcome


  • Faculty of Information Technology and Communication Sciences (ITC) Tampere University, FIN-33014



Information Seeking, Information Search Model, Knowledge Structures, Measuring Search Outcome.


People do not search information as such but seek to get a job done or to manage a situation by the help of search results. Therefore, the ultimate goal of information search is to advance task performance. It should be evaluated accordingly, i.e. by its contribution to task outcome. This implies an extended notion of search process, which also covers the use of information in search results for task outcome. For measuring the effect of search to task outcome we propose both indirect and direct indicators which measure search success.


Download data is not yet available.


Metrics Loading ...


Budzik, N. and Hammond, K. (2000). User interactions with everyday applications as context for just-in-time information access. In Proc. UIU’00 (pp. 44-51). New York, NY: ACM.

Cooper, W. S. (1973). On selecting a measure of retrieval effectiveness. JASIST, 24( 2), 87-100.

Harter, S. (1992). Psychological relevance and information science. JASIST, 43(9), 602-615.<602::AID-ASI3>3.0.CO;2-Q

Hersh, W., Pentecost, J. and Hickam D. (1996). A taskoriented approch to information retrieval. JASIST, 47(1), 50-56.<50::AID-ASI5>3.0.CO;2-1

Ja¨rvelin, K., Vakkari, P., Arvola, P, Baskaya, F., J¨arvelin, A., Kek¨ala¨inen, J., Keskustalo, H., Kumpulainen, S., Saastamoinen, M., Savolainen, R. and Sormunen, E. (2015). Task-based information interaction evaluation: The viewpoint of program theory. ACM Trans. Inf. Syst., 33(1), 3:1-3:30.

Kekäläinen J. and Järvelin, K. (2002). Evaluating information retrieval systems under the challenges of interaction and multi-dimensional dynamic relevance. In Proc. CoLIS4 (pp. 253-270).

Kintsch, W. 1998. Comprehension. A paradigm for cognition. Cambridge UP, Cambridge. Lancaster, W. and Warner A. (1993). Information retrieval today. Arlington, VA: Information Resources Press.

Liu, M., Liu, Y., Mao, X., Luo, C., Zhang, M. and Ma, S. (2018), “Satisfaction with failure” or “unsatisfied success”: Investigating the relationship between search success and user satisfaction. In Proc. WWW2018 (1533-1542). New York, NY: ACM.

Rees, A. (1967). Evaluation of information systems and services. ARIST, 2, 63-86.

Rossi, P., Lipsey, M. and Freeman, H. (2004). Evaluation. A systematic approach. 7th ed. Sage, Thousand Oaks.

Rubin R. J. (2006). Demonstrating results using outcome measurement in your library. Chicago: ALA.

Sperber, D. and Wilson, D. (1986). Relevance: Communication and cognition. Cambridge, MA: Harvard UP.

Syed, R. and Collins-Thompson, K. (2017). Retrieval algorithms optimized for human learning. In Proc. SIGIR’17 (pp. 555-564). New York, NY: ACM. https://doi. org/10.1145/3077136.3080835

Tague-Sutcliffe, J. (1995). Measuring information. Academic Press, San Diego. Vakkari, P. (1999). Task complexity, problem structure and information actions. IP&M, 35, 819-837. https://doi. org/10.1016/S0306-4573(99)00028-X

Vakkari, P. (2003). Task-based information searching. ARIST 2003, vol. 37. Medford, NJ: Information Today, p. 413-464.

Vakkari, P. (2010). Exploratory searching as conceptual exploration. In: Proc. of 4th Workshop on Human-Computer Interaction and Information Retrieval (pp. 24-27). New Brunswick, NJ. Vakkari, P. (2020). The Usefulness of search results. A Systematization of types and predictors. In Proc. CHIIR2020.

Vakkari, P., Völske, M., Potthast, M., Hagen, M. and Stein, B. (2019). Modeling the usefulness of search results as measured by information use. IPM, 56(3), 879-894.

Wildemuth, B.M., de Bliek, R., Friedman, C.P. and File, D.D. (1995). Medical students’ personal knowledge, searching proficiency, and database use in problem solving. JASIST, 46(8), 590-607.<590::AID-ASI7>3.0.CO;2-#

Yu, R., Gadiraju, U., Holtz, P., Rokicki, M., Kemkes, P. and Dietze, S. (2018). Predicting user knowledge gain in informational search sessions. In Proc. SIGIR’18 (pp. 75-84). New York, NY: ACM. Conference Name:ACM Woodstock conference



How to Cite

Vakkari, P. (2023). Assessing Information Search by Task Outcome. Journal of Information and Knowledge, 60(1), 31–37.



Invited Paper