Mixed Reality Tele-Presence: Technology and Applications in the Medical Domain

Overview

Over 30 years ago, researchers already identified the utility of telepresence for supporting medical interventions from afar. With the rise of massively parallel computing architectures, sophisticated AR and VR display devices and modern depth-sensors it is now possible to build high-fidelity telepresence systems that can provide rich context for supporting remote workers. In this seminar, we will cover the basics technologies ranging from 3D real-time reconstruction, network transmission, surface reconstruction, real-time rendering and interaction modalities needed to understand, design and build tele-presence systems that can be used in the medical domain.

Preliminary Meeting

The preliminary meeting will be held on Thursday February 2nd at 10:00 via Zoom. (passcode: tp4m)

Planned Timeslot: Thursdays 10-12

Seminar - Mixed Reality Tele-Presence: Technology and Applications in the Medical Domain (IN0014, IN2107, IN4433)

Lecturer (assistant)
Number0000000906
TypeSeminar
Duration2 SWS
TermSommersemester 2023
Language of instructionEnglish
Position within curriculaSee TUMonline
DatesSee TUMonline

Dates

Admission information

See TUMonline
Note: For registration you have to be identified in TUMonline as a student. Interested students should attend the introductory meeting.

Objectives

Students will understand the current state of the art in the domain of real-time reconstruction and rendering as well as human-machine interfaces for designing and building tele-presence systems.

Description

Over 30 years ago, researchers already identified the utility of telepresence for supporting medical interventions from afar. With the rise of massively parallel computing architectures, sophisticated AR and VR display devices and modern depth-sensors it is now possible to build high-fidelity telepresence systems that can provide rich context for supporting remote workers. In this seminar, we will cover the basics technologies ranging from 3D real-time reconstruction, network transmission, surface reconstruction, real-time rendering and interaction modalities needed to understand, design and build tele-presence systems that can be used in the medical domain.

Prerequisites

Computer Graphics, Computer Vision, GPU Computing

Teaching and learning methods

Self-guided learning to understand one state-of-the-art research paper, presentation to the group and writing a report

Recommended literature

Fuchs, H. and Neumann, U., 1993, October. A vision of telepresence for medical consultation and other applications. In Sixth International Symposium of Robotics Research (pp. 555-571). S. Beck, A. Kunert, A. Kulik, and B. Froehlich, “Immersive group-to-group telepresence,” IEEE Transactions on Visualization and Computer Graphics, vol. 19, no. 4, pp. 616–625, 2013

Links