Sat, 05 Jul 2008 05:47:16 BST CiteULike: brusilovsky's Pan http://www.citeulike.org/user/brusilovsky/author/Pan CiteULike.org en-gb Copyright © 2004-2008 citeulike.org http://www.citeulike.org/user/brusilovsky/article/2195687 <i>ACM Trans. Inf. Syst., Vol. 25, No. 2. (April 2007)</i><br /><br />This article examines the reliability of implicit feedback generated from clickthrough data and query reformulations in World Wide Web (WWW) search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average. We find that such relative preferences are accurate not only between results from an individual query, but across multiple sets of results within chains of query reformulations. Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search Thorsten Joachims Laura Granka Bing Pan Helene Hembrooke Filip Radlinski Geri Gay doi:10.1145/1229179.1229181 ACM Trans. Inf. Syst., Vol. 25, No. 2. (April 2007) 2008-01-04T21:39:32-00:00 2007 ACM Trans. Inf. Syst. 1046-8188 25 2 ACM en implicit-feedback information-retrieval www-search http://www.citeulike.org/user/brusilovsky/article/343045 <i>(2004), pp. 147-154.</i> The determinants of web page viewing behavior: an eye-tracking study Bing Pan Helene Hembrooke Geri Gay Laura Granka Matthew Feusner Jill Newman doi:10.1145/968363.968391 (2004), pp. 147-154. 2005-10-06T23:46:11-00:00 2004 147 154 ACM Press eye-tracking www http://www.citeulike.org/user/brusilovsky/article/1086212 <i>Inf. Process. Manage., Vol. 42, No. 4. (July 2006), pp. 1123-1131.</i> The influence of task and gender on search and evaluation behavior using Google Lori Lorigo Bing Pan Helene Hembrooke Thorsten Joachims Laura Granka Geri Gay doi:10.1016/j.ipm.2005.10.001 Inf. Process. Manage., Vol. 42, No. 4. (July 2006), pp. 1123-1131. 2007-02-03T17:01:18-00:00 2006 Inf. Process. Manage. 0306-4573 42 4 1123 1131 Pergamon Press, Inc. eye-tracking information-retrieval http://www.citeulike.org/user/brusilovsky/article/379395 <i>(2005), pp. 154-161.</i><br /><br />This paper examines the reliability of implicit feedback generated from clickthrough data in WWW search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average. Accurately interpreting clickthrough data as implicit feedback Thorsten Joachims Laura Granka Bing Pan Helene Hembrooke Geri Gay doi:10.1145/1076034.1076063 (2005), pp. 154-161. 2005-11-03T14:08:57-00:00 2005 154 161 ACM Press eye-tracking implicit-feedback information-retrieval