System and method for guiding and tracking a region of interest using an endoscope

Abstract

A system and method of repositioning a region of interest within an endoscopic image from a first location to a target location on the display screen of an endoscopy system is provided. The endoscopy system includes an insertion portion having a tip section with at least one viewing element for capturing images of a body cavity having the region of interest. The method includes detecting a region of interest within a body cavity, displaying the region of interest on a display screen in communication with the endoscopy system, marking the region of interest on the display screen, selecting a target location on the display screen, estimating a transformation to be applied to the region of interest, and applying the estimated transformation for causing the region of interest to be displayed at the target location of the display screen.

1 - 21 . (canceled) 
     
     
         22 . A system for displaying a region of interest within a medical image on a target area of at least one display screen, the system comprising:
 an insertion portion having a tip section with at least one viewing element for capturing images comprising the region of interest;   the at least one display screen coupled to the at least one viewing element; and   one or more processors configured for:
 receiving an image of the region of interest captured through the at least one viewing element; 
 transmitting the image of the region of interest to the at least one display screen; 
 recording a demarcation of the region of interest on the display screen; 
 recording a demarcation of the target area on the at least one display screen; 
 determining a transformation to be applied to the region of interest; and 
 transmitting the determined transformation to the at least one display screen to provide guidance to direct a movement of the insertion portion toward the target area based on the recorded demarcation of the target area such that the region of interest is positioned in the target area on the at least one display screen. 
   
     
     
         23 . The system of  claim 22 , wherein the target area comprises a center of one of the at least one display screen. 
     
     
         24 . The system of  claim 22 , wherein the insertion portion comprises a working channel located proximate to the front viewing element 
     
     
         25 . The system of  claim 22 , wherein the at least one viewing element includes a front viewing element, wherein the at least one display screen includes a central display screen coupled with the front viewing element. 
     
     
         26 . The system of  claim 22 , wherein the one or more processors are further configured for receiving a user's selection of a portion of the at least one display screen using a mouse click, an actuator present on a handle of the medical device, a touch screen, a hand gesture, or eye tracking, wherein the selection is indicative of the region of interest. 
     
     
         27 . The system of  claim 22 , wherein determining a transformation to be applied to the region of interest comprises determining an angle between the region of interest and the at least one viewing element. 
     
     
         28 . The system of  claim 22 , wherein the guidance to direct a movement of the insertion portion toward the target area includes generating and electronically displaying a visual guide that directs a movement of the insertion portion such that the region of interest moves into the target area on the at least one display screen. 
     
     
         29 . The system of  claim 22 , wherein the one or more processors are further configured for transmitting the determined transformation to one or more motors to automatically move the insertion portion in order to position the region of interest in the target area. 
     
     
         30 . One or more processors for executing a plurality of programmatic instructions, stored in non-transient memory, for displaying a region of interest within a medical image on a target area of at least one display screen, the plurality of programmatic instructions comprising:
 capturing an image of the region of interest through at least one viewing element of an insertion portion of a medical device, wherein the insertion portion has a tip section including the at least one viewing element;   displaying the region of interest on the at least one display screen;   recording a demarcation of the region of interest on the display screen;   recording a demarcation of the target area on the display screen;   determining a transformation to be applied to the region of interest; and   applying the determined transformation to provide guidance to direct a movement of the insertion portion toward the target area based on said recorded demarcation of the target area such that the region of interest is positioned in the target area on the display screen.   
     
     
         31 . The one or more processors of  claim 30 , wherein determining a transformation to be applied to the region of interest comprises determining an angle between the region of interest and the at least one viewing element. 
     
     
         32 . The one or more processors of  claim 30 , wherein applying the determined transformation comprises generating and electronically displaying a visual guide that directs a movement of the insertion portion such that the region of interest moves into the target area on the display screen. 
     
     
         33 . The one or more processors of  claim 32 , wherein the visual guide includes an image of a handle of the medical device and an indicator indicating a direction to move an actuator of the handle. 
     
     
         34 . The one or more processors of  claim 30 , wherein applying the determined transformation comprises transmitting the determined transformation to one or more motors to automatically move the insertion portion in order to position the region of interest in the target area 
     
     
         35 . The one or more processors of  claim 30 , wherein recording the demarcation of the region of interest on the display screen and/or recording the demarcation of the target area on the display screen includes receiving a user's selection of a portion of the at least one display screen using a mouse click, an actuator present on a handle of the medical device, a touch screen, a hand gesture, or eye tracking, wherein the selection is indicative of the region of interest. 
     
     
         36 . A system for displaying a region of interest within a medical image on a target area of at least one display screen, the system comprising:
 a medical device with at least one viewing element for capturing images comprising the region of interest;   the at least one display screen coupled to the at least one viewing element; and   one or more processors configured for:
 receiving an image of the region of interest captured through the at least one viewing element; 
 transmitting the image of the region of interest to the at least one display screen; 
 recording a demarcation of the region of interest on the display screen; 
 recording a demarcation of the target area on the at least one display screen; 
 determining a transformation to be applied to the region of interest, wherein the transformation comprises generating and displaying on the at least one display screen a visual guide that directs a movement of the medical device such that a portion of the medical device moves towards the region of interest; and 
 transmitting the determined transformation to the at least one display screen. 
   
     
     
         37 . The system of  claim 36 , wherein the target area comprises the center of one of the at least one display screen. 
     
     
         38 . The system of  claim 36 , wherein the at least one viewing element includes a front viewing element, wherein the at least one display screen includes a central display screen coupled with the front viewing element. 
     
     
         39 . The system of  claim 36 , wherein the one or more processors are further configured for receiving a user's selection of a portion of the at least one display screen using a mouse click, an actuator present on a handle of the medical device, a touch screen, a hand gesture, or eye tracking, wherein the selection is indicative of the region of interest. 
     
     
         40 . The system of  claim 36 , wherein determining a transformation to be applied to the region of interest comprises determining an angle between the region of interest and the at least one viewing element. 
     
     
         41 . The system of  claim 36 , wherein the visual guide includes an image of an endoscope handle and an arrow indicating a direction of rotation of a knob on the endoscope handle.