Augmented reality based surgical navigation using head-mounted displays

BY MOHAMED BENMAHDJOUB

Object detection models trained on synthetic data for surgical navigation image-to-patient registration

About the author:

Mohamed Benmahdjoub

Mohamed Benmahdjoub is a postdoctoral researcher at the Biomedical Imaging Group Rotterdam (BIGR) and the department of oral and maxillofacial surgery at Erasmus MC hospital, Rotterdam, The Netherlands.

The focus of his research is surgical navigation using augmented reality, more specifically image-to-patient registration, visualization, and 3D perception using head-mounted displays.

References and further reading:

  1. T. Ebker, P. Korn, M. Heiland, and A. Bumann, “Comprehensive virtual orthognathic planning concept in surgery-first patients,” British Journal of Oral and Maxillofacial Surgery, vol. 60, no. 8, pp. 1092–1096, Oct. 2022. doi: 10.1016/J.BJOMS.2022.04.008.
  2. S. H. Kang, M. K. Kim, J. H. Kim, H. K. Park, S. H. Lee, and W. Park. The validity of marker registration for an optimal integration method in mandibular navigation surgery. Journal of Oral and Maxillofacial Surgery, 71:366–375, 2 2013. doi: 10.1016/J.JOMS.2012.03.037
  3. M. Benmahdjoub, et al., "Evaluation of AR visualization approaches for catheter insertion into the ventricle cavity" in IEEE Transactions on Visualization & Computer Graphics, vol. 29, no. 05, pp. 2434-2445, 2023. doi: 10.1109/TVCG.2023.3247042
  4. Benmahdjoub, M., Niessen, W.J., Wolvius, E.B. et al. Multimodal markers for technology-independent integration of augmented reality devices and surgical navigation systems. Virtual Reality 26, 1637–1650 (2022). https://doi.org/10.1007/s10055-022-00653-3
  5. Lepetit, V., Moreno-Noguer, F. & Fua, P. EPnP: An Accurate O(n) Solution to the PnP Problem. Int J Comput Vis 81, 155–166 (2009). https://doi.org/10.1007/s11263-008-0152-6
  6. https://www.unrealengine.com/en-US/metahuman