Device and method for superimposing patterns on images in real-time, particularly for geographic guidance

Abstract

A device (DS), for superimposing known patterns, characteristic of a region, on (real) images of the region. The device (D) includes, a memory ( 21 ) in which patterns are stored, which are representative of a selected region, of known position and orientation with relation to a common reference and processing element ( 22 ), for determining a pattern representative of the selected portion in the memory ( 21 ), on receipt of the designation of at least one portion of an observed image of the selected region, taken at a selected angle and at least one representative attribute of the region, taking account of the attribute selected, then superimposing the determined pattern on the selected portion of the image taking account of the selected angle.

1 . Communication equipment comprising means of localization, means of display, and means of observation, characterized in that it further includes a device (D) for real-time registration of patterns on images of a region, comprising a memory designed to store a multiplicity of patterns representing portions of a selected region and of known position and orientation relative to a common reference, processing means arranged to determine a pattern representative of the designated portion in said memory, on receipt of the designation of at least one portion of an observed image of the selected region, taken at a selected angle, and at least one representative attribute of this portion, taking account of said designated attribute, then superimposing said determined pattern on said designated portion of the image taking account of said selected angle. 
     
     
         2 . Communication equipment according to  claim 1 , characterized in that said processing means are arranged to perform said registration by successively designating portions of observation images of said selected region and/or attributes representing said portions. 
     
     
         3 . Communication equipment according to  claim 1 , characterized in that said patterns are three-dimensional. 
     
     
         4 . Communication equipment according to  claim 3 , characterized in that said memory is capable of storing a three-dimensional model representing said region within said common reference, and in that said processing means are arranged to perform said registration at least using said stored three-dimensional model. 
     
     
         5 . Communication equipment according to  claim 1 , characterized in that said processing means are arranged to perform a rigid type registration, by minimization of a selected criterion. 
     
     
         6 . Communication equipment according to  claim 5 , characterized in that said processing means are arranged to determine at least one measurement equation from the designation of an image portion, an attribute and at least one hypothesis, and to determine the pattern and its rigid registration as a function of the determined measurement equation. 
     
     
         7 . Communication equipment according to  claim 5 , characterized in that said processing means are arranged to determine several measurement equations from the designation of several image portions, attributes and hypotheses, and to perform said pattern determination and its rigid registration as a function of a combination of said determined measurement equations. 
     
     
         8 . Communication equipment according to  claim 6 , characterized in that said hypotheses are transmitted to said processing means by the user making the designations. 
     
     
         9 . Communication equipment according to  claim 6 , characterized in that said processing means are arranged to determine said hypotheses. 
     
     
         10 . Communication equipment according to  claim 1 , characterized in that said processing means are arranged to deliver image data representing a registered pattern so that said pattern can be observed at the same time as said observation images and in superimposed fashion on the corresponding designated image portion. 
     
     
         11 . Communication equipment according to  claim 1 , characterized in that said memory is capable of storing a table of correspondence between said three-dimensional patterns and information data representing said patterns, and in that said processing means are arranged to deliver on request information data representing a pattern. 
     
     
         12 . Communication equipment according to  claim 10 , characterized in that said processing means are arranged to deliver substantially simultaneously on request image data representing a registered pattern and the information data representing said registered pattern. 
     
     
         13 . Communication equipment according to  claim 1 , characterized in that it has an inertial reference system. 
     
     
         14 . Communication equipment according to  claim 1 , characterized in that it is a mobile telephone. 
     
     
         15 . Installation for guidance by location for geographic guidance, including observation means capable of delivering images of a selected region at a selected angle and a display device enabling said images to be displayed, characterized in that it additionally includes a man/machine interface arranged to enable a user to designate at least one portion of the region represented by said displayed images and at least one attribute representing said portion, and a device for real-time registration of patterns on images of a region, including a memory designed to store a multiplicity of patterns representing portions of a selected region and of known position and orientation relative to a common reference, processing means arranged to determine a pattern representative of the designated portion in said memory, on receipt of the designation of at least one portion of an observed image of the selected region, taken at a selected angle, and at least one representative attribute of this portion, taking account of said designated attribute, then superimposing said determined pattern on said designated portion of the image taking account of said selected angle, said device being furnished with portions and attributes designated by said man/machine interface and delivering image data representing said registered pattern so that said pattern is superimposed by said display device on the designated portion displayed. 
     
     
         16 . Installation according to  claim 15 , characterized in that said registration device is arranged to deliver on request to said display device information data representing a registered pattern substantially at the same time as the image data representing said registered pattern so that this information data is superimposed on said displayed observation images. 
     
     
         17 . Installation according to  claim 15 , characterized in that said display device includes at least one computer monitor. 
     
     
         18 . Installation according to  claim 13 , characterized in that said display device is arranged in the form of observation spectacles. 
     
     
         19 . Installation according to  claim 15 , characterized in that it includes control means arranged, on receipt of a user request designating a pattern of said selected region, to instruct said registration device to determine position data representing the position of said designated pattern relative to said calibration reference, taking account of the registration, then to determine control instructions intended to guide said user to the portion of the region matching said designated pattern. 
     
     
         20 . Installation according to  claim 15 , characterized in that said processing means are arranged to perform said registration by successively designating portions of observation images of said selected region and/or attributes representing said portions. 
     
     
         21 . Installation according to  claim 15 , characterized in that said patterns are three-dimensional. 
     
     
         22 . Installation according to  claim 21 , characterized in that said memory is capable of storing a three-dimensional model representing said region within said common reference, and in that said processing means are arranged to perform said registration at least using said stored three-dimensional model. 
     
     
         23 . Installation according to  claim 15 , characterized in that said processing means are arranged to perform a rigid type registration, by minimization of a selected criterion. 
     
     
         24 . Installation according to  claim 23 , characterized in that said processing means are arranged to determine at least one measurement equation from the designation of an image portion, an attribute and at least one hypothesis, and to determine the pattern and its rigid registration as a function of the determined measurement equation. 
     
     
         25 . Installation according to  claim 23 , characterized in that said processing means are arranged to determine several measurement equations from the designation of several image portions, attributes and hypotheses, and to perform said pattern determination and its rigid registration as a function of a combination of said determined measurement equations. 
     
     
         26 . Installation according to  claim 24 , characterized in that said hypotheses are transmitted to said processing means by the user making the designations. 
     
     
         27 . Installation according to  claim 24 , characterized in that said processing means are arranged to determine said hypotheses. 
     
     
         28 . Installation according to  claim 15 , characterized in that said processing means are arranged to deliver image data representing a registered pattern so that said pattern can be observed at the same time as said observation images and in superimposed fashion on the corresponding designated image portion. 
     
     
         29 . Installation according to  claim 15 , characterized in that said memory is capable of storing a table of correspondence between said three-dimensional patterns and information data representing said patterns, and in that said processing means are arranged to deliver on request information data representing a pattern. 
     
     
         30 . Method of geographic guidance, in real time, characterized in that it consists of:
 storing in a memory patterns representing portions of a selected region and of known position and orientation relative to a common reference,   observing said selected region at a selected angle and delivering observation images of said region in real time,   designating at least one portion of the observation image of said selected region and at least one attribute representing said portion,   determining in said memory a pattern representing said designated portion, taking account of said designated attribute, and   overlaying said pattern on said designated image portion taking into account said selected angle.   
     
     
         31 . Method according to  claim 30 , characterized in that said registration is performed by successively designating portions of observation images of said selected region and/or attributes representing said portions. 
     
     
         32 . Method according to  claim 30 , characterized in that said patterns are three-dimensional. 
     
     
         33 . Method according to  claim 32 , characterized in that a three-dimensional model representing said region within said selected reference is stored in said memory, and in that said registration is performed at least using said stored three-dimensional model. 
     
     
         34 . Method according to  claim 30 , characterized in that a rigid type registration is performed, by minimization of a selected criterion. 
     
     
         35 . Method according to  claim 34 , characterized in that at least one measurement equation is determined from the designation of an image portion, an attribute and at least one hypothesis, and said pattern determination and its rigid registration are performed as a function of the determined measurement equation. 
     
     
         36 . Method according to  claim 34 , characterized in that several measurement equations are determined from the designation of several image portions, attributes and hypotheses, and said pattern determination and its rigid registration are performed as a function of a combination of said determined measurement equations. 
     
     
         37 . Method according to  claim 35 , characterized in that at least some of the said hypotheses are transmitted by the user making the designations. 
     
     
         38 . Method according to  claim 30 , characterized in that image data representing a registered pattern is delivered so that it is observed at the same time as said observation images and in a superimposed fashion on the corresponding designated image portion. 
     
     
         39 . Method according to  claim 30 , characterized in that a correspondence table between said patterns and information data representing said patterns is stored in said memory, and information data representing a pattern is delivered on request. 
     
     
         40 . Method according to  claim 38 , characterized in that said image data representing a registered pattern are displayed. 
     
     
         41 . Method according to  claim 30 , characterized in that said observation images are furnished by observation means the position of which is known at each instant relative to a calibration reference, from which is defined the position of the observed region, and in that said designations are made via a man/machine interface. 
     
     
         42 . Method according to  claim 30 , characterized in that, on receipt of a request from a user designating a pattern of said selected region, position data representing the position of said designated pattern are determined in relation to the calibration reference, taking the registration into account, and control instructions intended to guide said user to the portion of the region matching said designated pattern are then determined.