System and method of data transfer in-band in video via optically encoded images

Abstract

Data are encoded into one or more optically encoded images. The optically encoded images are then inserted as image data into a video sequence—i.e., in video frames. Data are transmitted in-band within the video, via any conceivable video distribution channel or format. The video may be trans-coded as required—because the data are optically encoded, any video processing that even crudely preserves the frame images will preserve the optically encoded data. This scheme of in-band data transfer in video is very robust. A video receiving apparatus receives the video, inspects the image data from video frames in memory, detects optically encoded images in the image data, and decodes the optically encoded images to recover the data. The frames carrying optically encoded images are typically discarded and not rendered to a display. The data from a plurality of optically encoded images may be concatenated, and further processed.

What is claimed is: 
     
         1 . An efficient and robust method of transferring data in-band in a video sequence via optically encoded images, comprising:
 obtaining digital data to be transferred;   if the data exceeds a predetermined size, segmenting the digital data into one or more data segments, each of or below the predetermined size;   optically encoding each data segment into an optically encoded image;   embedding each optically encoded image into a frame of a video sequence; and   transferring the video to a recipient.   
     
     
         2 . The method of  claim 1  wherein an optically encoded image comprises a one- or two-dimensional bar code. 
     
     
         3 . The method of  claim 2  wherein the two-dimensional code comprises a Quick Response (QR) code. 
     
     
         4 . The method of  claim 1  wherein embedding each optically encoded image into a frame of a video sequence comprises embedding two or more optically encoded images in contiguous frames. 
     
     
         5 . The method of  claim 1  wherein embedding each optically encoded image into a frame of a video sequence comprises interspersing two or more video frames containing optically encoded images with video frames containing video content images. 
     
     
         6 . The method of  claim 1  wherein embedding each optically encoded image into a frame of a video sequence comprises embedding two or more optically encoded images into a single video frame. 
     
     
         7 . The method of  claim 1  wherein embedding each optically encoded image into a frame of a video sequence comprises, for each optically encoded image, altering one or more visual aspects of video content images in one or more frames of video according to the encoded image pattern. 
     
     
         8 . The method of  claim 7  wherein altering one or more visual aspects of video content images in one or more frames of video according to the encoded image pattern comprises altering the visual aspects over a plurality of frames of video, and to a degree that the alterations are imperceptible to humans viewing a rendering of the video on a display. 
     
     
         9 . The method of  claim 1  wherein the video sequence is in any format that decodes to a sequence of still images. 
     
     
         10 . The method of  claim 1  wherein transferring the video to a recipient comprises transcoding the video from one format to another. 
     
     
         11 . A video receiving apparatus configured to extract digital data transferred in-band in a video sequence via optically encoded images, comprising:
 an interface configured to obtain a digital representation of a video sequence;   memory configured to store image data from the video sequence; and   processing circuitry configured to
 detect one or more optically encoded images in the image data stored in memory, and 
 decode each optically encoded image to yield a data segment. 
   
     
     
         12 . The video receiving apparatus of  claim 11  wherein, if more than one optically encoded image is detected and decoded, the processing circuitry is further configured to assemble two or more decoded data segments to recover the full digital data transferred. 
     
     
         13 . The video receiving apparatus of  claim 11  wherein the interface configured to obtain a digital representation of a video sequence comprises a digital video encoder configured to receive and digitize an analog video signal. 
     
     
         14 . The video receiving apparatus of  claim 11  further comprising a video player configured to render at least part of a received video sequence to a display. 
     
     
         15 . The video receiving apparatus of  claim 14  wherein the video receiving apparatus is further configured to suppress frames containing optically encoded images from the video sequence rendered to a display. 
     
     
         16 . The video receiving apparatus of  claim 11  further comprising an asset management system, and wherein data decoded from optically encoded images transmitted in-band in the video sequence comprise metadata related to the video in which they are transmitted and wherein the video receiving apparatus is configured to output at least the metadata to the asset management system. 
     
     
         17 . The video receiving apparatus of  claim 11  wherein data decoded from optically encoded images transmitted in-band in the video sequence comprise control signals configured to control an external device. 
     
     
         18 . The video receiving apparatus of  claim 17  wherein the device is a musical instrument. 
     
     
         19 . The video receiving apparatus of  claim 18  wherein the control signals comply with the Musical Instrument Digital Interface (MIDI) protocol. 
     
     
         20 . A method of improving the operation of a video receiving apparatus by extracting data transferred in-band in a video sequence via optically encoded images, comprising:
 obtaining a digital representation of a video sequence, the video including a least one frame comprising one or more optically encoded images;   determining one or more candidate video frames likely to include one or more optically encoded images; and   for at least each candidate video frame,
 inspecting a digital representation of the frame in memory; 
 detecting one or more optically encoded images in the frame; and 
 decoding each optically encoded image to extract a data segment. 
   
     
     
         21 . The method of  claim 20  further comprising, if more than one optically encoded image was detected and decoded, assembling two or more corresponding data segments. 
     
     
         22 . The method of  claim 20  wherein each optically encoded image comprises a one- or two-dimensional bar code. 
     
     
         23 . The method of  claim 20  wherein the two-dimensional code comprises a Quick Response (QR) code. 
     
     
         24 . The method of  claim 20  further comprising processing or outputting the data extracted from optically encoded images without rendering the frames comprising optically encoded images to a display. 
     
     
         25 . The method of  claim 24  wherein outputting the data comprises outputting one or more text or image files. 
     
     
         26 . The method of  claim 24  wherein outputting the data comprises outputting to a musical instrument control signals complying with the Musical Instrument Digital Interface (MIDI) protocol. 
     
     
         27 . The method of  claim 24  wherein the optically encoded data comprises metadata related to the video sequence, and wherein processing the data comprises updating an asset management system with the metadata.