Workgroup Prof. Kuhn

Be-greifen (in English: to grasp, to understand)

Create a laboratory experience which connects hands-on experience with theory in science education

The aim of this project is to explore the human-computer-interaction (HCI) in augmented reality (AR) learning environments, where the real and the digital world are merged in real time to help science and engineering students to improve their understanding of the interplay between experiment and theory. 


Technology based approaches for learning scenarios:

In this project a combination of tangible user interfaces and AR is designed to create a new kind of HCI , yielding an intuitive interface for the interaction with science experiments. Using wearable computing devices, it is possible to connect the real world with diverse digital representations such that the experiment itself becomes the user interface. The ubiquitous use of such digital technologies with many different sensors will be able to transform every day live situations to science experiments that can be analyzed and documented directly on-site. 


Access and manipulation of different representations and theoretical background information will be provided by AR in a transient way. This enables us to embed interactions and information for the users directly in the process of experimenting, thereby avoiding a distraction (split attention effect). Thus, students will be given the possibility of conducting experiments on their own in the framework of multimodal interactive analysis exercises (MI-exercises). Here, they will use different sensors to collect data and wearable computing devices to analyze the results on the fly, which can then be shared in a cloud service. 


Another part of the HCI in this project is the dynamical adaption of the interactions to the educational level of the students, to their interaction with the devices and to the learning requirements of the experiment, as well as direct feedback in terms of real time sensor information.


Development of an educational concept considering aspects of cognitive psychology:

  • Enhancing cognitive processing through individual variations of representations in real time
  • direct feedback using multiple simultaneous representations
  • encouraging students to produce different representations on their own
  • individual adaption to cognitive and affective states and predispositions of the students as well as individual feedback
  • enhancing the activity in the laboratory and giving the students the possibility of learning in everyday situations


Improvement of science and engineering education: 

  • practically oriented education, transferable to science and engineering courses at other universities
  • unproblematic integration in existing learning concepts and curricula 
  • evaluation of the learning progress


more Information:



Prof. Dr. Jochen Kuhn (

Michael Thees (theesm(at)

Sebastian Kapp (kapp(at)


Back to main page

Go to top