Registration with trajectory information with shape sensing

Abstract

A method and system for automatic landmark registration and registration using trajectory information and shape sensing during an endoscopic procedure, such as bronchoscopy, are described herein. A segmentation centerline of airways of a lung may be generated based on a pre-operative computed tomography (CT) image of the lung. Landmarks may be automatically detected on the segmentation centerline corresponding to bifurcations in the airways of the lung. A location data point cloud of locations of a catheter through the airways of the lung during navigation may be generated. A bounding volume of the airways of the lung may be generated and a bounding volume centerline may be detected. Landmarks may be detected on the bounding volume centerline for the same bifurcations. Then, the two sets of landmarks may be mapped as part of registration. The trajectory information with shape sensing may be used to provide non-rigid or fine registration.

What is claimed is: 
     
         1 . A method for automatic landmark registration during a bronchoscopy procedure, the method comprising:
 generating a location data point cloud based on locations of a catheter during navigation through airways of a lung;   generating a bounding volume of the airways of the lung based on the location data point cloud;   detecting a bounding volume centerline from the bounding volume of the airways of the lung;   automatically detecting a first plurality of landmarks on the bounding volume centerline corresponding to a second plurality of landmarks, wherein the second plurality of landmarks correspond to bifurcations in the airways of the lung based on a pre-operative image of the lung; and   generating a mapping of the first plurality of landmarks to corresponding points in the second plurality of landmarks and using the mapping to integrate the location data point cloud with a map of the airways of the lung.   
     
     
         2 . The method of  claim 1 , further comprising:
 using the mapping to visually display in real-time the locations of the catheter during navigation in the airways of the lungs on the map of the airways of the lung.   
     
     
         3 . The method of  claim 2  wherein the map of the airways of the lung is visually displayed as a two-dimensional (2D) or three-dimensional (3D) image. 
     
     
         4 . The method of  claim 1 , wherein the first plurality of landmarks includes three or more landmarks. 
     
     
         5 . The method of  claim 1 , wherein the automatically detecting the first plurality of landmarks on the bounding volume centerline includes identifying splits in the bounding volume centerline. 
     
     
         6 . The method of  claim 1 , wherein the bifurcations in the airways of the lung include: a first T junction between a trachea of the lung and at least one bronchus of the lung, and a second T junction between a first bronchus of the lung and a second bronchus of the lung. 
     
     
         7 . The method of  claim 1 , wherein the generating the mapping uses singular value decomposition (SVD). 
     
     
         8 . The method of  claim 1 , wherein the pre-operative image of the lung is generated using computed tomography (CT) or magnetic resonance imaging (MRI). 
     
     
         9 . The method of  claim 1 , wherein the navigating the catheter through the airways of the lung includes:
 using trajectory information with shape sensing to identify a distance of the catheter from a T junction in the airways of the lung.   
     
     
         10 . The method of  claim 9 , wherein the shape sensing includes:
 calculating an energy value by comparing lengths, bending angles, and twisting angles of shapes formed by the locations of the catheter during navigation to lengths, bending angles, and twisting angles of matched points in the pre-operative image; and   selecting a path that minimizes the energy value.   
     
     
         11 . A bronchoscopy system configured to perform automatic landmark registration during a bronchoscopy procedure, the bronchoscopy system comprising:
 a processor operatively coupled to a catheter and a visual display device;   the processor configured to generate a location data point cloud based on locations of the catheter during navigation through airways of a lung;   the processor configured to generate a bounding volume of the airways of the lung based on the location data point cloud;   the processor configured to detect a bounding volume centerline from the bounding volume of the airways of the lung;   the processor configured to automatically detect a first plurality of landmarks on the bounding volume centerline corresponding to a second plurality of landmarks, wherein the second plurality of landmarks correspond to bifurcations in the airways of the lung based on a pre-operative image of the lung; and   the processor configured to generate a mapping of the first plurality of landmarks to corresponding points in the second plurality of landmarks and use the mapping to integrate the location data point cloud with a map of the airways of the lung.   
     
     
         12 . The bronchoscopy system of  claim 11 , wherein the visual display is configured to use the mapping to visually display in real-time the locations of the catheter during navigation in the airways of the lungs on the map of the airways of the lung. 
     
     
         13 . The bronchoscopy system of  claim 12 , wherein the visual display displays the map of the airways of the lung as a two-dimensional (2D) or three-dimensional (3D) image. 
     
     
         14 . The bronchoscopy system of  claim 11 , wherein the first plurality of landmarks includes three or more landmarks. 
     
     
         15 . The bronchoscopy system of  claim 11 , wherein the processor is configured to automatically detect the first plurality of landmarks on the bounding volume centerline by identifying splits in the bounding volume centerline. 
     
     
         16 . The bronchoscopy system of  claim 11 , wherein the bifurcations in the airways of the lung include: a first T junction between a trachea of the lung and at least one bronchus of the lung, and a second T junction between a first bronchus of the lung and a second bronchus of the lung. 
     
     
         17 . The bronchoscopy system of  claim 11 , wherein the processor is configured to generate the mapping uses singular value decomposition (SVD). 
     
     
         18 . The bronchoscopy system of  claim 11 , wherein the pre-operative image of the lung is generated using computed tomography (CT) or magnetic resonance imaging (MRI). 
     
     
         19 . The bronchoscopy system of  claim 11 , wherein the navigation of the catheter through the airways of the lung includes the processor using trajectory information with shape sensing to identify a distance of the catheter from a T junction in the airways of the lung. 
     
     
         20 . The bronchoscopy system of  claim 19 , wherein the processor performs shape sensing by calculating an energy value by comparing lengths, bending angles, and twisting angles of shapes formed by the locations of the catheter during navigation to lengths, bending angles, and twisting angles of matched points in the pre-operative image and selecting a path that minimizes the energy value.