| Abstract | Virtual and Augmented Reality can support applications in medicine, e.g. for training, planning or therapy. This lecture derives the technical principles of multimodal (audiovisual, haptic, etc.) input devices, displays, and rendering techniques. Examples are presented in the fields of surgical training, intra-operative support, and rehabilitation. The lecture is accompanied by lab demonstrations. |
| Learning objective | Provide theoretical and practical knowledge of new principles and applications of multi-modal simulation and interface technologies in medical education, therapy, and rehabilitation. |
| Content | Virtual and Augmented Reality have the potential to provide descriptive and practical information for medical applications, while relieving the patient and/or the physician. Multi-modal interactions between the user and the virtual environment facilitate the generation of high-fidelity sensory impressions, by using visual, haptic, and auditory modalities. On the basis of the existing physiological constraints, this lecture derives the technical requirements and principles of multi-modal input devices, displays, and rendering techniques. Several examples are presented that are currently being developed or already applied, for instance in surgical training, intra-operative augmentation, and rehabilitation. The lecture will be accompanied by visits to facilities equipped with current VR and AR equipment. |
| Literature | Recommended readings will be announced in the lecture. Selected books covering some of the presented topics are:
• Virtual Reality in Medicine. Riener, Robert; Harders, Matthias; 2012 Springer.
• Augmented Reality: Principles and Practice (Usability). Schmalstieg, Dieter; Hollerer, Tobias; 2016 Pearson.
• Real-Time Volume Graphics. Rezk-Salama, Christof; Engel, Klaus; Hadwiger, Markus; Kniss, Joe; Weiskopf, Daniel; 2006 Taylor & Francis.
• Haptic Rendering: Foundations, Algorithms, and Applications. Lin, Ming; Otaduy, Miguel; 2008 CRC Press.
• Developing Virtual Reality Applications: Foundations of Effective Design. Craig , Alan; Sherman, William; Will, Jeffrey; 2009 Morgan Kaufmann. |
| Prerequisites / Notice | Notice The course language is English. Any further details will be announced in the first lecture.
The general target group is students of higher semesters as well as PhD students of D-HEST, D-MAVT, D-ITET, D-INFK, D-PHYS. Students of other departments, faculties, and courses are also welcome. |
Performance assessment as a semester course
: Special students and auditors need a special permission from the lecturers