System and method for viewing a subject

Abstract

A viewing system or imaging system is disclosed that includes optical pieces for viewing a subject. The viewing system may include features that allow an augmented mixed view through eyepieces of the viewing system. The mixed view may include graphical representations that are acquired or determined with information separate from the viewing system.

What is claimed is: 
     
         1 . A method of generating a display for viewing in a view through an eyepiece of a microscope, comprising:
 determining a pose of a head of the microscope relative to a subject;   at least one of determining a target within the subject; and   displaying a target graphical representation at the determined or recalled location of the target for simultaneous viewing with a live view of the subject with the eyepiece.   
     
     
         2 . The method of  claim 1 , wherein the head of the microscope further includes at least one objective lens;
 wherein the at least one objective lens is configured to receive light from relative to the subject.   
     
     
         3 . The method of  claim 1 , further comprising:
 determining a surface position viewed by a user;   generating a surface graphical representation to illustrate the surface position; and   displaying the surface graphical representation.   
     
     
         4 . The method of  claim 3 , wherein displaying the target graphical representation includes displaying the target graphical representation relative to the displayed surface graphical representation to illustrate a location of the target relative to the surface. 
     
     
         5 . The method of  claim 1 , further comprising:
 evaluating a view of the subject;   generating a subject graphical representation; and   replacing the view of the subject with the displayed target graphical representation and the subject graphical representation.   
     
     
         6 . The method of  claim 1 , further comprising:
 evaluating a fluorescence from the subject;   determining a target boundary based on the evaluated fluorescence from the subject;   generating an updated target graphical representation based on the determined target boundary; and   displaying the updated target graphical representation.   
     
     
         7 . The method of  claim 6 , wherein determining a target boundary includes segmenting a bright region of the evaluated fluorescence from the subject. 
     
     
         8 . The method of  claim 1 , wherein the target graphical representation is a first target graphical representation, the method further comprising:
 evaluating a geometry of the target;   generating a second target graphical representation illustrating at least one portion of the geometry of the target; and   wherein displaying the target graphical representation includes displaying the second target graphical representation.   
     
     
         9 . The method of  claim 8 , wherein displaying the second target graphical representation further comprises:
 displaying in series each of a generated plurality of target graphical representations to illustrate a three-dimensional boundary of the target.   
     
     
         10 . The method of  claim 1 , further comprising:
 determining a pose of a microscope relative to a pose of the subject.   
     
     
         11 . A method of generating a display for viewing in a view through an eyepiece of a microscope, comprising:
 determining a target pose of a target of a subject relative to a viewing plane through the eyepiece;   determining a target graphical representation of the target in the subject; and   displaying the target graphical representation at the determined target location of the target for simultaneous viewing with a live view of the subject.   
     
     
         12 . The method of  claim 11 , further comprising:
 determining a pose of a head of the microscope relative to the subject;   wherein the determined target pose of the target is based at least in part on the determined pose of the head relative to the subject.   
     
     
         13 . The method of  claim 11 , further comprising:
 receiving an input from a user regarding displaying the target graphical representation;   wherein the input allows the user to select whether or not to display the target graphical representation.   
     
     
         14 . The method of  claim 11 , further comprising:
 acquiring an image of the subject relative to the viewing plane at a first time;   displaying the acquired image at a second time after the first time for viewing through the eyepiece relative to a live view of the subject through the eyepiece.   
     
     
         15 . The method of  claim 14 , further comprising:
 determining movement of the subject between the first time and the second time based on a comparison of the acquired image and the live view.   
     
     
         16 . The method of  claim 11 , further comprising:
 displaying an instrument graphical representation relative to the displayed target graphical representation relative to the viewing plane.   
     
     
         17 . The method of  claim 11 ;
 determining a first target geometry at a first time;   determining a second target geometry at a second time;   evaluating whether a change has occurred regarding the target between the first time and the second time.   
     
     
         18 . A system for viewing a subject through an eyepiece of a microscope, comprising:
 a processor system configured to access a memory system and execute instructions to:
 determine a position of a target relative to a plane that is viewable through the eyepiece; 
 generate a graphical representation of the target; and 
 display the graphical representation of the target relative to the plane; 
 wherein the graphical representation and the subject are viewable through the eyepiece simultaneously. 
   
     
     
         19 . The system of  claim 18 , further comprising:
 an input operable to generate a signal regarding an input from a user to select display of the graphical representation.   
     
     
         20 . The system of  claim 18 , further comprising:
 a pose determining system configured to determine a pose of a head of the microscope relative to the subject;   wherein the graphical representation is displayed based at least in part on the determined relative pose.