L3: Evaluation

In subproject L3, function and integration tests, reliability tests and simulation studies take place. The developed design proposals from M2 are tested in a way that enables the control of its realizations in the demonstrators with the help of the further developed evaluation methods from M4. Benchmark for evaluation are the requirements to a socially acceptable technology design that are also compiled in M2. The evaluations are taking place on three levels.

  • Evaluation of technology: In function and integration tests of the application demonstrators, the control of fulfillment of the functional and non-functional requirements is performed.
  • Evaluation of the technology-user-relationship: the investigations of the usability by the users and usability-experts require experiments in the laboratory (e.g. with eye tracking analysis, video surveillance and logfile-registration) and field tests (e.g. physio-logging and GPS-tracking) in order to determine task appropriateness, effectiveness, efficiency and user strain (if necessary also by comparison with alternative solutions) and to identify remaining potentials for optimization.
  • Evaluation of the technology-driven social networking: Especially in simulation studies, (see M4) the use of technology in social contact, the confirmation of trust mechanisms and the changes in conditions of realization for fundamental rights and other aims in law are investigated. For the future real users are enabled to experience how they can fulfill their tasks by using the demonstrators. All VENUS-partners are involved in these tasks and the analysis of these experiences, and use them to evaluate the technology developments and design proposals for which they are responsible.

The findings from these evaluations flow directly back into the design work. By testing the demonstrators at the same time, the design methods from MS and the testing methods from M4 are also evaluated. Thus, the findings from the practical projects are also used for the reflection of the theories and methods that should be used in the laboratory.