US & MR/CT Image Fusion with Markerless Skin Registration: A Proof of Concept

Abstract:
This paper presents an innovative automatic fusion imaging system that combines 3D CT/MR images with real-time ultrasound acquisition.
The system eliminates the need for external physical markers and complex training, making image fusion feasible for physicians with different experience levels.
The integrated system involves a portable 3D camera for patient-specific surface acquisition, an electromagnetic tracking system, and US components.
The fusion algorithm comprises two main parts: skin segmentation and rigid co-registration, both integrated into the US machine.
The co-registration aligns the surface extracted from CT/MR images with the 3D surface acquired by the camera, facilitating rapid and effective fusion.
Experimental tests in different settings, validate the system’s accuracy, computational efficiency, noise robustness, and operator independence.
Published:
17 July 2024
RAISE Affiliate:
Spoke 2
Name of the Journal:
Journal of Imaging Informatics in Medicine
Publication type:
Contribution in journal
DOI: