Evaluation of Semantic Service Discovery-A Survey and Directions for Future Research

NETL's Office of Coal and Environmental Systems: Sensors and Controls Workshop?

Ulrich KÄuster ; Holger Lausen ; Birgitta KÄonig-Ries

Others  :  http://CEUR-WS.org/Vol-313/paper3.pdf
PID  :  2618

来源: CEUR

【 摘 要 】

In recent years a huge amount of effort and money has been invested in the area of semantic service discovery and presented approaches have become more sophisticated and mature. Nevertheless surprisingly little effort is being put into the evaluation of these approaches. We argue that the lack of established and theoretically well-founded methodologies and test beds for comparative evaluation of semantic service discovery is a major blocker of the advancement of the field. To lay the ground for a comprehensive treatment of this problem we discuss the applicability of well-known evaluation methodologies from information retrieval and provide an exhaustive survey of the current evaluation approaches.