Evaluating social applications
Speaker: Sihem Amer-Yahia, directrice de recherche at CNRS, Université de Grenoble, Grenoble, France
Social applications have been receiving increasing attention from both industry and academia. A social application is characterized by the addition of value to a context where users interact with each other and with existing resources, tagging them, rating them or simply browsing them. Traditionally, applications on the Web have been evaluated using a multitude of methods ranging from the least intrusive ones such as offline A/B testing to the most intrusive such as online bucket testing. The same methods have been applied to evaluate social applications. I will describe an example of a social application and its evaluation using crowdsourcing and I will end the talk with a discussion on the need to better understand and formalize the evaluation of social applications.