Paper Abstract
"The evaluation of educational technology and concrete training measures is an important task to identify strengths and weaknesses, to elucidate the applicability for specific educational goals, and to make judgements about its effectiveness. This is a non-trivial task and unusually it requires lengthy inquiries with potential end users and clients. In many cases, the evaluation procedures are too much focused on usability-like criteria and superficial aspects of effectives. In this paper, we present a holistic framework based on four distinct dimensions which serves as the conceptual starting point for the set-up of evaluation activities. A special focus of the framework lies in the mutual dependence between evaluation dimensions and evaluation procedures. In order to reduce the efforts required for evaluation procedures we developed very short (10 item) instruments and compared the outcomes with those of a standard test battery of in total 231 items. The results of an exploratory study indicate that the short versions may provide sufficiently valid and reliable results which are not significantly different from the results of the long versions."

The full paper is available through SpringerLink, provided that you have proper access rights.