TY - GEN
T1 - Evaluating server selection for federated search
AU - Thomas, Paul
AU - Shokouhi, Milad
PY - 2010
Y1 - 2010
N2 - Previous evaluations of server selection methods for federated search have either used metrics which are unconnected with user satisfaction, or have not been able to account for confounding factors due to other search components. We propose a new framework for evaluating federated search server selection techniques. In our model, we isolate the effect of other confounding factors such as server summaries and result merging. Our results suggest that state-of-the-art server selection techniques are generally effective but result merging methods can be significantly improved. Furthermore, we show that the performance differences among server selection techniques can be obscured by ineffective merging.
AB - Previous evaluations of server selection methods for federated search have either used metrics which are unconnected with user satisfaction, or have not been able to account for confounding factors due to other search components. We propose a new framework for evaluating federated search server selection techniques. In our model, we isolate the effect of other confounding factors such as server summaries and result merging. Our results suggest that state-of-the-art server selection techniques are generally effective but result merging methods can be significantly improved. Furthermore, we show that the performance differences among server selection techniques can be obscured by ineffective merging.
UR - http://www.scopus.com/inward/record.url?scp=77952312039&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-12275-0_58
DO - 10.1007/978-3-642-12275-0_58
M3 - Conference contribution
SN - 3642122744
SN - 9783642122743
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 607
EP - 610
BT - Advances in Information Retrieval - 32nd European Conference on IR Research, ECIR 2010, Proceedings
PB - Springer Verlag
T2 - 32nd European Conference on Information Retrieval, ECIR 2010
Y2 - 28 March 2010 through 31 March 2010
ER -