Dr. Benjamin Busam
Dr. rer. nat. Benjamin Busam
Informatik 16 - Lehrstuhl für Informatikanwendungen in der Medizin (Prof. Navab)
- Tel.: +49 (89) 289 - 19412
- Raum: 5613.03.044
- Homepage
- b.busam@tum.de
News
- Serving as Senior/Lead Area Chair for CVPR 2025
- 4 Paper accepted for NeurIPS 2024
- 14 Papers from CAMP accepted for ECCV 2024 ( two of those with significant contributions from Ben )
- Serving as Senior/Lead Area Chair for ECCV 2024
- 12 Papers from CAMP accepted for CVPR 2024 ( three of those with significant contributions from Ben )
- Glad to receive an CVPR 2024 Outstanding Reviewer Award ( Top 2% of Reviewers )
- Colibri5 won the ICRA 2024 IEEE RAS Best Medical Robotics Paper Award - Finalist
Curriculum Vitae
Benjamin Busam is a Senior Research Scientist with the Technical University of Munich coordinating the Computer Vision activities at the Chair for Computer Aided Medical Procedures. Formerly Head of Research at FRAMOS Imaging Systems, he led the 3D Computer Vision Team at Huawei Research, London from 2018 to 2020. Benjamin studied Mathematics at TUM. In his subsequent postgraduate programme, he continued in Mathematics and Physics at ParisTech, France and at the University of Melbourne, Australia, before he graduated with distinction at TU Munich in 2014. In continuation to a mathematical focus on projective geometry and 3D point cloud matching, he now works on 2D/3D computer vision for pose estimation, depth mapping and mobile AR as well as multi-modal sensor fusion. For his work on adaptable high-resolution real-time stereo tracking he received the EMVA Young Professional Award 2015 from the European Machine Vision Association and was awarded Innovation Pioneer of the Year 2019 by Noah's Ark Laboratory, London. He was given multiple Outstanding Reviewer Awards at 3DV 2020, 3DV 2021, ECCV 2022, and CVPR 2024.
Research Interests
- 3D Computer Vision (Depth, Pose, SLAM, Reconstruction etc.)
- Multi-Modal Sensor Fusion Concepts and their Medical Applications
- Collaborative Robotics & Augmented Reality for Healthcare and Medicine
- Projective & Differential Geometry
- Machine Learning, Neural Models & Neural Fields
Teaching
- Seminar: Modern Computer Vision Methods (WS 2024/25)
- Project Course: 3D Computer Vision (WS 2024/25)
- Lecture: Sensors and Wearables for Automated Detection of Nutrition, Physical Activity, and Sleep (WS 2025/25)
- Project Course: Project Managment and Software Development for Medical Applications (WS 2024/25)
- Project Course: Advanced Topics in 3D Computer Vision (SS 2024)
- Project Course: Foundations in 3D Computer Vision (SS 2024)
- Project Course: Project Managment and Software Development for Medical Applications (SS 2024)
- Project Course: Case Studies in Nonlinear Optimization (SS 2024)
- Invited Lecture: Computer Vision meets Lackiertechnik, HS Esslingen (Prof. Dr. Hendrik Dubbe)
- Seminar: Modern Computer Vision Methods (WS 2023/24)
- Project Course: 3D Computer Vision (WS 2023/24)
- Lecture: Sensors and Wearables for Automated Detection of Nutrition, Physical Activity, and Sleep (WS 2023/24)
- Project Course: Project Managment and Software Development for Medical Applications (WS 2023/24)
- Project Course: Advanced Topics in 3D Computer Vision (SS 2023)
- Lecture: Computer Aided Medical Procedures II (SS 2023)
- Project Course: Project Managment and Software Development for Medical Applications (SS 2023)
- Seminar: Modern Computer Vision Methods (WS 2022/23)
- Project Course: 3D Computer Vision (WS 2022/23)
- Lecture: Medical Augmented Reality (WS 2022/23)
- Project Course: Project Managment and Software Development for Medical Applications (WS 2022/23)
- Project Course: Advanced Topics in 3D Computer Vision (SS 2022)
- Lecture: Computer Aided Medical Procedures II (SS 2022)
- Project Course: Case Studies in Nonlinear Optimization (SS 2022)
- Lab Course: Project Management and Software Development for Medical Applications (SS 2022)
- Project Course: 3D Computer Vision (WS 21/22)
- Project Course: Advanced Topics in 3D Computer Vision (SS 2021)
- Lab Course: Project Management and Software Development for Medical Applications (SS 2021)
- Project Course: Advanced Topics in 3D Computer Vision (WS 20/21)
- Project Course: Perception and Learning in Robotics and Augmented Reality (SS 2020)
- Project Course: Advanced Topics in 3D Computer Vision (WS 18/19)
- Lab Course: Project Management and Software Development for Medical Applications (WS 18/19)
- Seminar: Recent Trends in 3D Computer Vision and Deep Learning (WS 18/19)
- Lecture: Computer Aided Medical Procedures II (SS 2018)
- Project Course: Case Studies in Nonlinear Optimization (SS 2018)
- Lab Course: Project Management and Software Development for Medical Applications (SS 2018)
- Seminar: Recent Trends in 3D Computer Vision and Deep Learning (WS 17/18)
- Lab Course: Project Management and Software Development for Medical Applications (WS 17/18)
- Lecture: Computer Vision (SS 2017)
- Lecture: Computer Aided Medical Procedures II (SS 2017)
- Project Course: Case Studies in Nonlinear Optimization (SS 2017)
- Lab Course: Project Management and Software Development for Medical Applications (SS 2017)
- Seminar: Recent Trends in 3D Computer Vision (WS 16/17)
- Lab Course: Project Management and Software Development for Medical Applications (WS 16/17)
- Lecture: Computer Aided Medical Procedures II (SS 2016)
- Lab Course: Project Management and Software Development for Medical Applications (SS 2016)
- Lab Course: Project Management and Software Development for Medical Applications (WS 15/16)
- Seminar: Recent Trends in 3D Computer Vision (WS 15/16)
- Lab Course: Project Management and Software Development for Medical Applications (SS 2015)
- Seminar: 3D Computer Vision (WS 14/15)
- Seminar: Foundations of Computer Vision (WS 14/15)
- Tutorial: Höhere Mathematik 3 für Maschinenwesen und Chemie-Ingenieurwesen (WS 12/13)
- Tutorial: Differential- und Integralrechnung (MSE) (SS 2012)
- Tutorial: Mathematische Grundlagen (MSE) (WS 11/12)
- Exercise and Exam Correction: Mathematik für Physiker 2 (Analysis 1) (WS 09/10)
Projects
There are always available topics in 3D vision for Master's theses and PhD students with potential industry support.
Our industrial partners are constantly looking for motivated working students, graduates and young professionals. Internships in different fields of application in computer vision are offered.
If you are interested in writing your thesis in 3D vision or some industry experience don't hesitate in contacting me.
- HyunJun Jung: Temporal Depth Sensor Fusion with Multiple Modalities
- Mahdi Saleh: Flexible 3D Matching using Graphs
- Lennart Bastian: Multi-Sensor Intelligent Surgical Workflow Analysis
- Pengyuan Wang: Monocular 6D Pose Estimation for Robotic Interactions
- Shishir Vutukur: Shape and Pose Prediction with Limited Data
- Guangyao Zhai: Collaborative Robotic Grasping
- Shervin Dehghani: Bio-Medical 3D Robotic Applications
- Stefano Gasperini: Multi-modal Sensor Fusion for Autonomous Driving
- Alexander Lehner: Robust 3D Detection through Adversarial Learning
- Mert Karaoglu: Scene Tracking in Surgical Environments
- Ege Özsoy: Holistic 4D Scene Understanding in the OR
- Felix Holm: Surgical Data Science in Workflow Scenarios
- Kristina Mach: Semantic Multimodal Medical Image Understanding
- Junwen Huang: 6D Pose Estimation for Unknown Objects
- Giulia Rizzoli: Multi-Modal 3D Scene Understanding with Photometric Challenges
- Felix Tristram: Neural Fields in Challenging Medical Environments
- Boody Elskhawy: Reinforcement Learning for Intrinsic Exploration
- Mengze Li: Intrinsic Exploration with Graph Neural Networks
- Chantal Pellegrini: Explainable Medical Image Understanding with Multi-Modal Data
- Dekai Zhu: Learning from Limited Data for Simulations in Structural Mechanical Design
- Felix Dülmer: Physics-Inspired Robotic Ultrasound Learning
- Yuchen Rao: Manipulation in 3D Scene Reconstruction
- Alireza Alikhani: 3D Robotics in Ophthalmology
- Mert Kiray: Interaktive Visual Scene Representations
- Evin Pinar: Interaktive 3D Scene Representations
- Magdalena Wysocki: Physics-Inspired Implicit 3D Ultrasound Reconstruction
- Miriam Senne: 3D Radar Sensing with Millimeter Waves
- Shiyu Li: 3D Scene Understanding in the OR
| until | Type | Topic | By | Additional Info |
|---|---|---|---|---|
| MSc Thesis | User Centric Designs for Interactive 3D Scene Editing in the Browser | Ege Ilgaz Şencan | ||
| MSc Thesis | Human Action Recognition with Hyberbolic Contrastive Learning | Claudia Jordan | with Cambridge | |
| MSc Thesis | Category-Level Pose Estimation utilizing Patch Correspondences | Burak Cuhadar | ||
| BSc Thesis | Language-Driven 3D Visual Effects on 3D Gaussian Splats | Paul Uhlenbruck | ||
| Research Project | Learning Dynamics from Visual Observation with Neural ODEs | Hiran Sarkar | ||
| 2024 | PhD Thesis | Pose Estimation for Novel Rigid Objects (@ ENPC ParisTech, Paris) | Van Nguyen Nguyen | |
| 2024 | PhD Thesis | A Path Through Generalization of Visual Object Pose Estimation (@ Sant'Anna, Pisa) | Alberto Remus | Went to Leonardo |
| 2024 | PhD Thesis | Robust Learned 3D-Perception | Patrick Ruhkamp | Went to accenture. Thesis |
| 2024 SS | MSc Thesis | Category Level 6D Pose Estimation Using Parameterized Pointcloud Completion | Weihang Li | |
| 2024 SS | MSc Thesis | Subtle Movement Detection in the context of Therapeutic Functional Relaxation Exercises | Mohammad Shoaib Zafar | with Breathment |
| 2024 SS | MSc Thesis | Category-Level Pose Estiamtion in Cluttered Scenes with Enhanced Depth Prediction | Hongcheng Zhao | |
| 2024 SS | Lab Course | Non-linear Relaxations for Latent Stitching | Kai Eberl Federico Feroggio Hillary Hauger Mario Tuçi | |
| 2024 SS | BSc Thesis | Multi-Skeleton Contrastive Learning for 3D Skeleton-Based Action Recognition | Alvaro Ritter | |
| 2023/24 WS | MSc Thesis | FollowMe: Human Detection and Tracking in the Field based on PointPillars with Range Image Feature Fusion and Unsupervised Domain Adaptation | Wessam Frrag | with Fraunhofer IPA |
| 2023/24 WS | MSc Thesis | Uncertainty Quantification for Deep Learning based 6-DoF Object Pose Estimation | Fabian Scherer | with BMW |
| 2023/24 WS | BSc Thesis | Cart-Based Patient Approach with RGBD Camera Integration in Robot-Assisted Ophthalmic Surgery | Van Dai Nguyen | |
| 2023/24 WS | Practical Project | Influence of Sleep Health on Physical Performance | Fabienne Greier Dominik Langbein Philipp Rehder Maleen Stingl | |
| 2023 | PhD Thesis | Robust 3D Matching | Hao Yu | Defended in China |
| 2023 | PhD Thesis | Intelligent, Applicable and Acceptable Robotic Ultrasound | Christine Eilers | Went to Nvidia. Thesis |
| 2023 | PhD Thesis | Symphony of Time: Temporal Deep Learning for Surgical Activity Recognition | Tobias Czempiel | Went to EnAcuity. Thesis |
| 2023 | PhD Thesis | 6 DoF Pose Estimation of Known and Novel Objects With Dense Correspondences | Ivan Shugurov | Went to meta. Thesis |
| 2023 SS | MSc Thesis | Freehand Online NeRF for Photometrically Challenging Scenes | Manuel Brito | |
| 2023 SS | Guided Research | High-quality 3D Hand Reconstruction from Single Image via Diffusion Model | Sibo Wu | |
| 2023 SS | Research Internship | Video Interpolation with Neural Differential Equations | Aude Bouillé | |
| 2022/23 WS | MSc Thesis | Image-driven Nutrition Data Analysis | Thomas Flecken | |
| 2022/23 WS | MSc Thesis | Understanding Traffic by Observing the Driver: 3D Human Pose for In-Cabin Driver Assistance | Iuliia Skobleva | |
| 2022/23 WS | Guided Research | Class-based Object Pose Estimation for Photometrically Challenging Objects | Wessam Frrag Hongcheng Zhao | |
| 2022/23 WS | Guided Research | Semantic Segmentation with 2D-3D Consistency and Sparse Labels | Fatma Merve Karali Mert Kiray Maximilian Forstenhäusler | |
| 2022 SS | PhD Project | 6G for Computer Vision-based Telemedicine | Konstantinos Zacharis | |
| 2022 SS | MSc Thesis | Augmenting Anatomies through Animal Tracking | Arian Mehrfard | |
| 2022 SS | MSc Thesis | Robust Pedestrian Tracking from Uncalibrated Car Cabin Video (with MIT) | Lisa-Marie Bernhardt | |
| 2022 SS | Practical Project | Self-supervised Semantic Segmentation through Cycle-consistency | Fatma Merve Karali Mert Kiray Maximilian Forstenhäusler Artem Evdokimov | |
| 2022 SS | Research Internship | Continuous Motion Interpolation with Neural ODEs (with École Polytechnique) | Maxime Bonnin | |
| 2022 SS | Lab Course | A Real-Time 3D Viewer for Converted NeRFs | Jingyao Yu | Project |
| 2022 SS | Lab Course | Hydration Status Prediction through Automated Urine Colour Analysis (with TopathlEAT) | Skander Salah | Project |
| 2022 SS | Lab Course | Deformation-Invariant Local Descriptors for Non-Rigid Point Cloud Registration | Eva Voggenreiter David Niederkofler Claus Kratzer Haixin Li | |
| 2022 SS | MSc Thesis | Vehicle Lane Detection from Uncalibrated Car Cabin Video (with MIT) | Andy Chen | |
| 2022 SS | MSc Thesis | NeRF-Enhanced 3D Object Detection | Hanzhi Chen | |
| 2022 SS | MSc Thesis | Polarimetric Pose Estimation of Photometrically Challenging Objects | Daoyi Gao | Paper at ECCV 2022 |
| 2021/22 WS | PhD Project | Flexible Object Pose and Shape Estimation | Fu Li | Google Scholar |
| 2021/22 WS | PhD Project | Completion-driven Active Reconstruction | Mahdi Hamad | |
| 2021/22 WS | MSc Thesis | Deep Synthetic Polarimetric 6D Object Pose Estimation | Arturo Guridi | |
| 2021/22 WS | MSc Thesis | Deforming by experience: Realistic shape morphing of unseen objects with embedding-driven geometric optimization | Mariem Khlifi | |
| 2021 SS | PhD Project | Instance-Agnostic Monocular 6D Pose Estimation | Fabian Manhardt | Went to Google. Thesis |
| 2021 SS | Guided Research | Attention meets Geometry for Consistent Monocular Depth Estimation | Daoyi Gao Hanzhi Chen | Paper at 3DV 2021 |
| 2021 SS | MSc Thesis | Robotic Path Optimization for Ultrasound Compounding | Viviana Sutedjo | Paper at RA-L / IROS 2021 |
| 2021 SS | Lab Course | Visualization of logged athlete-diets (with TopathlEAT) | Haichuan | Project |
| 2021 SS | Lab Course | Automatic Nutrition Analysis from Images (with TopathlEAT) | Thomas Flecken | Project |
| 2020/21 WS | Practical Project | Polarimetric Pose Estimation | Magdalena Gawlinska Yitong Li Iuliia Skobleva | Paper at ECCV 2022 |
| 2020/21 WS | Practical Project | Temporally Consistent Video Depth | Daoyi Gao Hanzhi Chen | |
| 2020 SS | MSc Thesis | Self-supervised Depth Estimation from Polarization Imagery | Barnabé Mas | |
| 2020 SS | Practical Project | Depth-aware Mixed Reality: Capture the AR-Flag | Muhammad Faizan Ihsan B. Balaban Jeremias Neth | |
| 2019/20 WS | MSc Thesis | 6D Pose Tracking as an Action Decision Process | HyunJun Jung | |
| 2019 SS | MSc Thesis | A Geometric View of Rotation Representations in Computer Vision and Deep Learning | Konstantinos Zacharis | |
| 2018/19 WS | Practical Project | Observing Environment Statistics - Anomaly Detection | Elias Marquart Tobias Eder Varnika Tyagi | |
| 2018/19 WS | Practical Project | Mobile Indoor Navigation | Nour AlOrjany Ritvik Ranadive Stefano Gasperini | |
| 2018/19 WS | Seminar Presentation | CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAM | Hooriya Anam | Paper |
| 2018/19 WS | Lab Course | Spatio-temporal Depth Estimation in Real-Time | HyunJun Jung | Project Proposal KickOff |
| 2018 SS | Working Student | Depth Accuracy Improvements for Active Stereo Sensing | HyunJun Jung | Results |
| 2018 SS | Working Student | A modular implementation of feature based SLAM | Miguel Trasobares Baselga | |
| 2018 SS | MSc Thesis | Object Pose Estimation with PointNet | Michael Haberl | Presentation Thesis |
| 2018 SS | Lab Course | Real-time Gaze Estimation | Matthieu Hongtao Zhang | Project Proposal Requirement Presentation Intermediate Presentation Final Presentation |
| 2018 SS | Lab Course | Motion Interpolation and Sensor Fusion | Antoine Keller Violeta Sofia Morales Lennart Bastian | Project Proposal Poster Report Final Presentation |
| 2017/18 WS | MSc Thesis | Hybrid sensor fusion with dual quaternion based EKF for pose estimation in real-time | Charalampos Papathanasis | KickOff Presentation Thesis |
| 2017/18 WS | Interdisciplinary Project | A mixed reality application for needle targeting with trifocal stereo in real-time | Thomas Sennebogen | KickOff Final Presentation |
| 2017/18 WS | Lab Course | Dyna-Eye: A dynamic 2D-3D Stereo Viewer | Ruiqi Gong | Project Proposal Requirement Presentation Intermediate Presentation Final Presentation |
| 2017/18 WS | Lab Course | Gaze Estimation with Pupil Tracking in Real-Time | Tomas Bartipan | Project Proposal Requirement Presentation Intermediate Presentation Final Presentation |
| 2017/18 WS | Seminar Presentation | Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs | Tobias Valinski | Paper Report Presentation |
| 2017/18 WS | BSc Thesis | Pose-aware rendering of live ultrasound data for mixed medical AR | Felix Scheidhammer | KickOff Final Presentation Thesis |
| 2017 SS | Lab Course | Disparity Determination in Stereo Vision | Lu Sang Michael Haberl Raphael Ullmann | MidTerm Presentation Poster Final Presentation |
| 2017 SS | Lab Course | Magic Eye: An adaptive 2D-3D Stereo Viewer | Aleksandr Bulankin | Project Proposal Intermediate Presentation Final Presentation |
| 2017 SS | Lab Course | Pose Interpolation with Dual Quaternion Series | Ekaterina Kanaeva | Project Proposal Intermediate Presentation Final Presentation |
| 2017 SS | Lab Course | Activity Classification with Persistent Homology Barcodes | Ester Molero Hidalgo | Project Proposal Intermediate Presentation Final Presentation |
| 2016/17 WS | MSc Thesis | Monocular Reconstruction and Tracking in non-rigid Environments | Patrick Ruhkamp | KickOff Thesis |
| 2016/17 | MSc Thesis | Natural marker extraction and learning for binocular images and 6D pose estimation | Mahdi Saleh | KickOff Final Presentation Thesis |
| 2016/17 | IFL/FRAMOS Project | Hybrid opto-inertial Tracking Systems | Faisal Kalim | Final Presentation |
| 2016/17 WS | Lab Course | Automatic Pose Synchronization | Charalampos Papathanasis | Project Proposal Project Requirement Presentation Intermediate Presentation Final Presentation |
| 2016/17 WS | Lab Course | A virtual multi-view Optical Tracking System | Mahdi Hamad | Project Proposal Project Requirement Presentation Intermediate Presentation Final Presentation |
| 2016/17 WS | Lab Course | FMtrack - Optical Tracking System for Medical Procedural Simulator | Ramona Schneider | Project Proposal Project Requirement Presentation Intermediate Presentation Final Presentation |
| 2016/17 WS | Seminar Presentation | Fusion4D: Real-Time Performance Capture of Challenging Scenes | Felix Scheidhammer | Report Presentation |
| 2016/17 WS | Seminar Presentation | Learning With Side Information Through Modality Hallucination | Nan Yang | Report Presentation |
| 2016 SS | Lab Course Project | A hybrid opto-inertial Tracking System Prototype | Faisal Kalim | Project Proposal Project Requirement Presentation Intermediate Presentation Final Presentation |
| 2016 SS | Lab Course Project | A vision based anthropometric Scanner for dynamic Scenes | Ahmed El-Gazzar | Project Proposal Project Requirement Presentation Intermediate Presentation Final Presentation |
| 2015/16 WS | Lab Course Project | Needle tracking for ultrasound-guided biopsies with inside-out vision | Thomas Sennebogen | Project Proposal Project Requirement Presentation Intermediate Presentation Final Presentation |
| 2015/16 WS | Lab Course Project | Visualizing the volumetric accuracy of medical tracking solutions | Stefan Matl | Project Proposal Project Requirement Presentation Intermediate Presentation Final Presentation |
| 2015/16 WS | Seminar Presentation | Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture | Christoph Baur | Report Presentation |
| 2015/16 WS | Seminar Presentation | Computing the Stereo Matching Cost with a Convolutional Neural Network | Markus Herb | Report Presentation |
| 2015 SS | Lab Course Project | Reducing the orthopaedic risk of cycling with a vision-based anthropometric scanner | Mahdi Saleh | Project Proposal Project Requirement Presentation Intermediate Presentation Final Presentation |
| 2014/15 WS | Seminar Presentation | Rapid object detection using a boosted cascade of simple features | Christos Stoilas | Report Presentation |
| 2014/15 WS | Seminar Presentation | Distinctive image features from scale-invariant keypoints | Amin Ahantab | Report Presentation |
| 2014 SS | Bachelor's Thesis | Monocular Real Time Tracking With Passive Circular Markers | Ahmed Matar | Thesis |
Awards and Scholarships
- CVPR 2024 Outstanding Reviewer Award ( Top 2% of Reviewers )
- ICRA 2024 IEEE RAS Best Medical Robotics Paper Award - Finalist
- ECCV 2022 Outstanding Reviewer Award
- 3DV 2021 Outstanding Reviewer Award ( 5% of Reviewers, 0.56% of Reviewers to receive this Award in 2020 and 2021 )
- 3DV 2020 Outstanding Reviewer Award ( 9% of Reviewers )
- Sang Uk Lee Best Student Paper Award (ACCV 2020)
- Innovation Pioneer of the Year 2019. Noah's Ark Laboratory, London
- Huawei Future Star 2019
- ICCV MVR3D Best Student Paper Award 2017
- IJCARS MICCAI Best Paper Award 2016
- EMVA Young Professional Award 2015
- Hurwitz-Preis zum ausgezeichneten Studienabschluss
- International TUMexchange Scholarship
- Auszeichnung beim Bundeswettbewerb Mathematik
- E-Fellows Scholarship
- Ehrung als jahrgangsbester Abiturient 2007
- Ferry Porsche Preis für Mathematik und Physik
- Scheffel‐Preis der Literarischen Gesellschaft
Publications
See Google Scholar