Assessing Information Search by Task Outcome

Authors

  • Faculty of Information Technology and Communication Sciences (ITC) Tampere University, FIN-33014

DOI:

https://doi.org/10.17821/srels/2023/v60i1/170893

Keywords:

Information Seeking, Information Search Model, Knowledge Structures, Measuring Search Outcome.

Abstract

People do not search information as such but seek to get a job done or to manage a situation by the help of search results. Therefore, the ultimate goal of information search is to advance task performance. It should be evaluated accordingly, i.e. by its contribution to task outcome. This implies an extended notion of search process, which also covers the use of information in search results for task outcome. For measuring the effect of search to task outcome we propose both indirect and direct indicators which measure search success.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References

Budzik, N. and Hammond, K. (2000). User interactions with everyday applications as context for just-in-time information access. In Proc. UIU’00 (pp. 44-51). New York, NY: ACM. https://doi.org/10.1145/325737.325776

Cooper, W. S. (1973). On selecting a measure of retrieval effectiveness. JASIST, 24( 2), 87-100. https://doi.org/10.1002/asi.4630240204

Harter, S. (1992). Psychological relevance and information science. JASIST, 43(9), 602-615. https://doi.org/10.1002/(SICI)1097-4571(199210)43:9<602::AID-ASI3>3.0.CO;2-Q

Hersh, W., Pentecost, J. and Hickam D. (1996). A taskoriented approch to information retrieval. JASIST, 47(1), 50-56. https://doi.org/10.1002/(SICI)1097-4571(199601)47:1<50::AID-ASI5>3.0.CO;2-1

Ja¨rvelin, K., Vakkari, P., Arvola, P, Baskaya, F., J¨arvelin, A., Kek¨ala¨inen, J., Keskustalo, H., Kumpulainen, S., Saastamoinen, M., Savolainen, R. and Sormunen, E. (2015). Task-based information interaction evaluation: The viewpoint of program theory. ACM Trans. Inf. Syst., 33(1), 3:1-3:30. https://doi.org/10.1145/2699660

Kekäläinen J. and Järvelin, K. (2002). Evaluating information retrieval systems under the challenges of interaction and multi-dimensional dynamic relevance. In Proc. CoLIS4 (pp. 253-270).

Kintsch, W. 1998. Comprehension. A paradigm for cognition. Cambridge UP, Cambridge. Lancaster, W. and Warner A. (1993). Information retrieval today. Arlington, VA: Information Resources Press.

Liu, M., Liu, Y., Mao, X., Luo, C., Zhang, M. and Ma, S. (2018), “Satisfaction with failure” or “unsatisfied success”: Investigating the relationship between search success and user satisfaction. In Proc. WWW2018 (1533-1542). New York, NY: ACM. https://doi.org/10.1145/3178876.3186065

Rees, A. (1967). Evaluation of information systems and services. ARIST, 2, 63-86.

Rossi, P., Lipsey, M. and Freeman, H. (2004). Evaluation. A systematic approach. 7th ed. Sage, Thousand Oaks.

Rubin R. J. (2006). Demonstrating results using outcome measurement in your library. Chicago: ALA.

Sperber, D. and Wilson, D. (1986). Relevance: Communication and cognition. Cambridge, MA: Harvard UP.

Syed, R. and Collins-Thompson, K. (2017). Retrieval algorithms optimized for human learning. In Proc. SIGIR’17 (pp. 555-564). New York, NY: ACM. https://doi. org/10.1145/3077136.3080835

Tague-Sutcliffe, J. (1995). Measuring information. Academic Press, San Diego. Vakkari, P. (1999). Task complexity, problem structure and information actions. IP&M, 35, 819-837. https://doi. org/10.1016/S0306-4573(99)00028-X

Vakkari, P. (2003). Task-based information searching. ARIST 2003, vol. 37. Medford, NJ: Information Today, p. 413-464. https://doi.org/10.1002/aris.1440370110

Vakkari, P. (2010). Exploratory searching as conceptual exploration. In: Proc. of 4th Workshop on Human-Computer Interaction and Information Retrieval (pp. 24-27). New Brunswick, NJ. Vakkari, P. (2020). The Usefulness of search results. A Systematization of types and predictors. In Proc. CHIIR2020. https://doi.org/10.1145/3343413.3377955

Vakkari, P., Völske, M., Potthast, M., Hagen, M. and Stein, B. (2019). Modeling the usefulness of search results as measured by information use. IPM, 56(3), 879-894. https://doi.org/10.1016/j.ipm.2019.02.001

Wildemuth, B.M., de Bliek, R., Friedman, C.P. and File, D.D. (1995). Medical students’ personal knowledge, searching proficiency, and database use in problem solving. JASIST, 46(8), 590-607.https://doi.org/10.1002/(SICI)1097-4571(199509)46:8<590::AID-ASI7>3.0.CO;2-#

Yu, R., Gadiraju, U., Holtz, P., Rokicki, M., Kemkes, P. and Dietze, S. (2018). Predicting user knowledge gain in informational search sessions. In Proc. SIGIR’18 (pp. 75-84). New York, NY: ACM. https://doi.org/10.1145/3209978.3210064 Conference Name:ACM Woodstock conference

Published

2023-03-27

How to Cite

Vakkari, P. (2023). Assessing Information Search by Task Outcome. Journal of Information and Knowledge, 60(1), 31–37. https://doi.org/10.17821/srels/2023/v60i1/170893

Issue

Section

Invited Paper