Customized program insertion system

Abstract

Segments of code are provided, configured to cause a camera of a device to, in real time, take a sequence of images of a subject, the device being a computer that is a portable telephone device, having memory and a processor, and having the camera and a display, the sequence of images being stored. Segments of code are also provided that are configured to cause detecting of portions from each of the sequence of images, the portions corresponding to an object of the subject having features moving in time. The computer-readable media may be the memory of the device, wherein the code is executable by a controller provided in the device. The object in one aspect is a human face. Segments of code may also be provided that are configured to cause the device identifying, for each of plural images within the sequence, a set of object features from the detected portions. The device determines and defines movements of the object features. The device may also insert, in real time as the taken sequence of images are received by the device, a model insertion object into the taken images of the sequence in correspondence with the detected portions, thereby providing new inserted features corresponding to the object features. The device moves the new inserted features similar to the defined movements of the object features.

1 . Computer-readable media non-transiently encoded with code executable by a computer, the code comprising:
 segments of code configured to cause a camera of a device to, in real time, take a sequence of images of a subject, the device being a computer that is a portable telephone device, having memory and a processor, and having the camera and a display, the sequence of images being stored; and   segments of code configured to cause detecting of portions from each of the sequence of images, the portions corresponding to an object of the subject having features moving in time.   
     
     
         2 . The computer-readable media according to  claim 1 , wherein the computer-readable media is the memory of the device, and wherein the code is executable by a controller provided in the device. 
     
     
         3 . The computer-readable media according to  claim 1 , wherein the sequence of images are stored in the memory of the device. 
     
     
         4 . The computer-readable media according to  claim 1 , wherein the object is a human face. 
     
     
         5 . The computer-readable media according to  claim 4 , wherein the code comprises segments of code configured to cause identification of the moving features in the stored images, the identification including obtaining histograms of the object. 
     
     
         6 . The computer-readable media according to  claim 5 , wherein the code comprises segments of code configured to cause determining motion vectors associated with the identified features. 
     
     
         7 . The computer-readable media according to  claim 6 , wherein the code comprises segments of code configured to cause determining an image capture perspective angle in relation to the human face. 
     
     
         8 . The computer-readable media according to  claim 7 , wherein the determining of an image capture perspective angle includes determining a distance between select ones of the detected features. 
     
     
         9 . The computer-readable media according to  claim 8 , wherein the distance, between the select ones of the detected features, is determined based on the histograms and motion vectors corresponding to the select ones of the detected features. 
     
     
         10 . The computer-readable media according to  claim 8 , wherein the select ones include the eyes and nose of the human face. 
     
     
         11 . The computer readable media according to  claim 8 , wherein the select ones include the eyes and hairline of the human face. 
     
     
         12 . The computer-readable media according to  claim 8 , wherein the select ones include points along a perimeter of the head of the human face. 
     
     
         13 . The computer-readable media according to  claim 1 , the code further comprising:
 segments of code configured to cause the device identifying, for each of plural images within the sequence, a set of object features from the detected portions; and   segments of code configured to cause the device determining and defining movements of the object features.   
     
     
         14 . The computer-readable media according to  claim 13 , the code further comprising:
 segments of code configured to cause the device displaying the taken sequence of images on the display;   segments of code configured to cause the device inserting, in real time as the taken sequence of images are received by the device, a model insertion object into the taken images of the sequence in correspondence with the detected portions, thereby providing new inserted features corresponding to the object features; and   segments of code configured to cause the device moving the new inserted features similar to the defined movements of the object features.   
     
     
         15 . The computer-readable media according to  claim 1 , the code further comprising:
 segments of code configured to cause forming, for display by an audience including the device, a video signal from the sequence of images, and over a plurality of such images, obtaining histograms to identify individual features of the object; and   segments of code configured to cause determining motion vectors respectively associated with the identified features of the object.   
     
     
         16 . Computer-readable media non-transiently encoded with code executable by a computer, the code causing the generation of a three-dimensional (3D) model of a subject for insertion in a program, the code comprising:
 segments of code configured to cause determining and recording the 3D positions of the subject relative to the position of an image capture device, and repeating the determining and recording of the relative 3D positions at plural positions surrounding a subject;   segments of code configured to cause capturing an image of the subject at each of the plural positions surrounding the subject;   segments of code configured to cause recording image capture perspective angles in relation to the subject for each of the recorded relative 3D coordinates; and   segments of code configured to cause creating a 3D model of the subject based on the captured surrounding images and associated recorded relative 3D positions and image capture perspective angles.   
     
     
         17 . The computer-readable media according to  claim 16 , wherein the positions of the image capture device include at least a position capturing the face of the subject. 
     
     
         18 . The computer-readable media according to  claim 17 , wherein the position capturing the face of the subject corresponds to an image capture perspective azimuth angle of zero degrees. 
     
     
         19 . The computer-readable media according to  claim 17 , the code further comprising:
 segments of code configured to cause extracting a portion of the 3D model image to provide a model insertion image; and   segments of code configured to cause inserting the model insertion image into a program so as to correspond to features of an object in the program.