System for Volume Dimensioning Via Holographic Sensor Fusion

Abstract

A wearable augmented reality (AR) device (e.g., virtual reality (VR), mixed reality (MR) device is disclosed. The wearable device communicates with a system for volume dimensioning via two-dimensional (2D)/three-dimensional (3D) sensor fusion. The AR device display to the user a two-dimensional (2D) image stream of a field of view (FOV) including target objects and 3D imaging data of the FOV including point clouds of each target object within the FOV. Target objects are identified by correlating the 2D and 3D image streams and generating a holographic model of the target object overlaid on the video stream, with adjustable surface, edge, and vertex guides. Precise dimensions and unique object identifiers of the target object are determined and decoded and displayed to the user via the wearable device; the user may manipulate or adjust the display via gestures or commands detectable by the wearable device.

We claim: 
     
         1 . An augmented reality (AR) viewer device, comprising:
 at least one display surface wearable by a user;   at least one display processor operatively coupled to the display surface, the display processor configured to receive, and display to the user via the display surface, at least one of:
 an image stream corresponding to a field of view (FOV) including at least one target object, the image stream captured by at least one image sensor in communication with the display processor; 
 three-dimensional (3D) image data associated with the FOV, the 3D image data including at least one set of points associated with the target object and generated by at least one 3D imager in communication with the display processor; and 
 a holographic model corresponding to the target object and generated by at least one fusion processor in communication with the display processor by correlating the image stream and the 3D image data, the holographic model including at least one of a plane of the target object, an edge of the target object, and a vertex of the target object; 
   the display processor configured to:
 detect control input provided by the user; and 
 based on the detected control input, manipulate at least one of the image stream, the 3D image data, and the holographic model. 
   
     
     
         2 . The AR viewer device of  claim 1 , wherein the display processor is coupled to the fusion processor via physical link. 
     
     
         3 . The AR viewer device of  claim 1 , wherein:
 the viewer device is remotely located from the fusion processor, the image sensor, the 3D imager, and the target object; and   the display processor is coupled to the fusion processor via wireless link.   
     
     
         4 . The AR viewer device of  claim 1 , further comprising:
 at least one microphone in communication with the display processor; wherein   the control input includes verbal instructions captured by the microphone.   
     
     
         5 . The AR viewer device of  claim 1 , further comprising:
 at least one camera in communication with the display processor; and   the control input includes at least one gesture performed by the user and captured by the camera, the gesture associated with at least one of an instruction and an instruction sequence executable by the display processor.   
     
     
         6 . The AR viewer device of  claim 1 , wherein:
 the display processor is configured to superimpose the holographic model over the image stream by displaying at least one of:
 an adjustable plane guide associated with the plane of the target object; 
 an adjustable edge guide associated with the edge of the target object; and 
 an adjustable vertex guide associated with the vertex of the target object. 
   
     
     
         7 . The AR viewer device of  claim 1 , wherein:
 the display processor is configured to display via the display surface object data corresponding to the target object, the object data acquired by decoding at least one object identifier identified by the fusion processors from one or more of the image stream and the 3D image data.   
     
     
         8 . The AR viewer device of  claim 1 , wherein the display processor is configured to display to the user via the display surface at least one of:
 a dimension of the target object determined by the fusion processor, the dimension corresponding to the at least one edge of the target object; and   a volume of the target object determined by the fusion processor.