Information transmission system using light as communication medium, information transmission method, image pickup device, and computer programmed product

Abstract

A CPU 36 of a light emitting unit 30 fetches ith bit of transmission information TX stored in a transmission data memory 33 in synchronization with a clock signal CK from a timing generator 35. The CUP 36 determines the bit value and fetches a first pattern sequence SA from a pattern data memory 44 when the bit is logic signal 1, and fetches a second pattern sequence SB from a pattern data memory 34 when the bit is logic signal 0, and outputs the first pattern sequence SA and second pattern sequence SB to a light emitting section 37. While, a CPU 39 of a light receiving unit 40 extracts a pixel area with a time sequence luminance variation pattern from a frame image captured into a capture image buffer 46, and binarizes the luminance variation pattern, and performs logic determination. A liquid crystal display 44 displays information of a light emitting area to be overlapped with a subject image.

1. An information transmission system comprising a light emitting unit that converts arbitrary information into an optical signal to output and a light receiving unit that receives said optical signal to reproduce said information,
 said light emitting unit including:   determining means for logically determining a bit sequence that structures said arbitrary information;   selecting means for selecting a specific bit pattern sequence from two bit pattern sequences having a low correlation with each other, pre-prepared based on the determination result by said determining means;   modulating means for modulating said arbitrary information to light intensity according to the selection result by said selecting means; and   output controlling means for performing control to output the optical signal with intensity modulated by said modulating means;   said light receiving unit including:   binarizing means for receiving the optical signal output from said light emitting unit to binarize according to the light intensity;   bit pattern determining means for determining whether or not the bit pattern sequence included in the signal binarized by said binarizing means corresponds to any one of said pre-prepared two bit pattern sequences having a low correlation with each other;   signal outputting means for outputting a logic signal corresponding to the bit pattern sequence determined by said bit pattern determining means; and   reproducing means for reproducing said arbitrary information based on the output result from said signal outputting means.   
     
     
       2. The information transmission system according to  claim 1 , wherein said modulating means modulates said arbitrary information to light intensity including an OFF state corresponding to non-lighting state, an ON(L) state corresponding to a low luminance lighting state and an ON(H) corresponding to a high luminance lighting state. 
     
     
       3. The information transmission system according to  claim 1 , wherein said modulating means adds a bit signal such that frequencies of appearance of logic signals different from each other on said light receiving unit side are balanced so as to modulate light intensity in connection with the specific bit sequence selected by said selecting means. 
     
     
       4. The information transmission system according to  claim 1 , wherein said light receiving unit further includes image pickup means, and output light from said light emitting unit is received by performing image pickup by said image pickup means. 
     
     
       5. The information transmission system according to  claim 4 , wherein said light receiving unit further includes scanning means for scanning an area subjected to image pickup by said image pickup means, and means for specifying the area of said output light based on the scanning result by said scanning means, said binarizing means binarizes said specified area, and said bit pattern determining means determines whether or not the bit pattern sequence included in the binarized signal corresponds to any one of said pre-prepared two bit pattern sequences having a low correlation with each other. 
     
     
       6. The information transmission system according to  claim 5 , wherein said light receiving unit further includes dividing means for dividing the area subjected to image pickup by said image pickup means into a plurality of areas, and said scanning means for scanning the respective areas divided by said dividing means, sequentially. 
     
     
       7. The information transmission system according to  claim 6 , wherein said light receiving unit further includes changing means for changing the size of area to be divided by said dividing means with arbitrary timing. 
     
     
       8. The information transmission system according to  claim 6 , wherein said light receiving unit further includes sub-sampling means, and area changing means for changing the size of area to be divided by said dividing means by said sub-sampling means. 
     
     
       9. The information transmission system according to  claim 5 , wherein said light receiving unit further includes means for determining a threshold level of an area scanned by said scanning means, and said binarizing means binarizes the area based on the threshold level determined said means. 
     
     
       10. The information transmission system according to  claim 4 , wherein said light receiving unit further includes display means for displaying the areas subjected to image pickup by said image pickup means, area selecting means for selecting an area of said output light from among the areas displayed on said display means, and designating means for designating said reproducing means to perform information reproduction on the area of output light selected by said area selecting means. 
     
     
       11. The information transmission system according to  claim 10 , wherein said light receiving unit further includes display controlling means for causing said display means to display information reproduced by said reproducing means in response to designation from said designating means. 
     
     
       12. An information transmission method that converts information to be transmitted into an optical signal to output by a light emitting unit and that receives said optical signal by a light receiving unit to reproduce said information, said method comprising the steps of:
 logically determining a bit sequence that structures information to be transmitted;   selecting a bit pattern sequence alternatively from two bit pattern sequences having a low correlation with each other, pre-prepared according to the result determined in said logic determining step;   outputting the optical signal with intensity modulated according to the result selected in said selecting step;   binarizing the optical signal received according to intensity;   determining whether or not the bit pattern sequence included in the result binarized in said binarizing step corresponds to any one of said pre-prepared two bit pattern sequences having a low correlation with each other;   generating a corresponding logic signal when the bit pattern sequence corresponds to any one of said two bit pattern sequences is determined in said determining step; and   reproducing said information based on the logic signal generated in said generating step.   
     
     
       13. The information transmission method according to  claim 12 , further comprising the steps of:
 capturing an output light from said light emitting unit as an image of an area including said output light; and   displaying the image captured in said capturing step and reproduced information.   
     
     
       14. An image pickup device comprising:
 image pickup means;   storage means for storing two bit pattern sequences having a low correlation with each other;   scanning means for scanning an area subjected to image pickup by said image pickup means;   means for specifying an output light area subjected to intensity modulation based on the result scanned by said scanning means;   binarizing means for binarizing the output light area specified by said means according to light intensity;   bit pattern determining means for determining whether or not the bit pattern sequence included in the signal binarized by said binarizing means corresponds to any one of said two bit pattern sequences having a low correlation with each other, stored in said storage means;   signal outputting means for outputting a logic signal corresponding to the bit pattern sequence determined by said bit pattern determining means; and   reproducing means for reproducing information based on the output result from said signal outputting means.   
     
     
       15. The image pickup device according to  claim 14 , further comprising:
 dividing means for dividing the area subjected to image pickup by said image pickup means into a plurality of areas, and said scanning means scanning the respective areas divided by said dividing means, sequentially.   
     
     
       16. The image pickup device according to  claim 15 , further comprising:
 changing means for changing the size of area to be divided by said dividing means with arbitrary timing.   
     
     
       17. The image pickup device according to  claim 15 , further comprising:
 sub-sampling means; and   area changing means for changing the size of area to be divided by said dividing means by said sub-sampling means.   
     
     
       18. The image pickup device according to  claim 14 , further comprising:
 display means for displaying the areas subjected to image pickup by said image pickup means;   area selecting means for selecting said output light area from among the areas displayed on said display means; and   designating means for designating said information output means to perform information output on the output light area selected by said area selecting means.   
     
     
       19. The image pickup device according to  claim 18 , further comprising:
 display controlling means for causing said display means to display information output by said information output means in response to designation from said designating means.   
     
     
       20. A computer programmed product having a computer-program recorded on storage computer-readable storage medium, said computer-program causing a computer, being connected to an image pickup device, to execute steps of:
 scanning an area subjected to image pickup by said image pickup device;   specifying an output light area subjected to intensity modulation based on said scanned result;   binarizing said specified output light area according to light intensity;   determining whether or not a bit pattern sequence included in the signal binarized by said binarizing means corresponds to any one of pre-prepared two bit pattern sequences having a low correlation with each other;   outputting a logic signal corresponding to said determined bit pattern sequence; and   outputting information based on said output result in said signal outputting step.   
     
     
       21. An information transmission system comprising:
 a sending unit; and   a receiving unit;   wherein the sending unit comprises:
 a conversion unit which converts information into a time-series luminance variation pattern; and 
 a light emitting unit which emits light in accordance with the luminance variation pattern; and 
   wherein the receiving unit comprises:
 an image pickup unit; 
 an acquiring unit which continuously, in time series, acquires frame images output from the image pickup unit; 
 a detection unit which detects a pixel in the frame images that has a luminance changed by the light emitted by the light emitting unit; 
 an extraction unit which extracts the luminance variation pattern by continuously reading out the pixel detected by the detecting unit in the frame images; 
 a decoding unit which decodes the luminance variation pattern extracted by the extraction unit, to obtain the information converted into the luminance variation pattern; and 
 an output unit which outputs the information decoded by the decoding unit. 
   
     
     
       22. An information transmission method for a system comprising a sending unit having a light emitting device and a receiving unit having an image pickup device, the method comprising:
 converting, at the sending unit, information into a time-series luminance variation pattern; and   driving the light emitting device of the sending unit to emit light in accordance with the luminance variation pattern;   continuously, in time series, acquiring frame images via the image pickup device of the receiving unit;   detecting, at the receiving unit, a pixel in the frame images that has a luminance changed by the light emitted by the light emitting device;   extracting, at the receiving unit, the luminance variation pattern by continuously reading out the detected pixel in the frame images;   decoding, at the receiving unit, the extracted luminance variation pattern, to obtain the information converted into the luminance variation pattern; and   outputting, at the receiving unit, the decoded information.   
     
     
       23. A receiving device comprising:
 an image pickup unit;   an acquiring unit which continuously, in time series, acquires frame images output from the image pickup unit;   a detection unit which detects a pixel in the frame images that has a luminance varying in accordance with a predetermined pattern;   an extraction unit which extracts the pattern of luminance variation by continuously reading out the pixel detected by the detecting unit in the frame images;   a decoding unit which decodes the pattern of luminance variation extracted by the extraction unit, to obtain information from the pattern of luminance variation; and   an output unit which outputs the information decoded by the decoding unit.   
     
     
       24. The receiving device according to claim 23, further comprising a notification unit which outputs a notification according to the information output by the output unit. 
     
     
       25. The receiving device according to claim 24, wherein the notification unit comprises an audio output unit that outputs the notification by outputting a sound. 
     
     
       26. The receiving device according to claim 24, wherein the notification unit comprises a display unit that outputs the notification on a display. 
     
     
       27. The receiving device according to claim 23, further comprising a display unit which displays the frame images output from the image pickup unit. 
     
     
       28. The receiving device according to claim 27, further comprising a display control unit which controls the frame images to be displayed by the display unit such that the pixel detected by the detection unit is emphasized. 
     
     
       29. The receiving device according to claim 27, further comprising a display control unit which controls the information decoded by the decoding unit to be displayed by the display unit together with the frame images. 
     
     
       30. The receiving device according to claim 29, wherein the display control unit controls the information decoded by the decoding unit to be displayed by the display unit together with the frame images in correspondence with a position of the pixel detected by the detection unit. 
     
     
       31. The receiving device according to claim 29, further comprising:
 a selection unit which, when a plurality of pixels are detected by the detection unit, selects a specific pixel from the plurality of pixels;   wherein the extraction unit extracts the pattern of luminance variation by continuously reading out the specified pixel in the frame images, the decoding unit decodes the pattern of luminance variation extracted by the extraction unit to obtain information from the pattern of luminance variation, and the display control unit controls the information decoded by the decoding unit to be displayed by the display unit together with the frame images.   
     
     
       32. The receiving device according to claim 23, further comprising:
 a selection unit which, when a plurality of pixels are detected by the detection unit, selects a specific pixel from the plurality of pixels;   wherein the extraction unit extracts the pattern of luminance variation by continuously reading out the specified pixel in the frame images.   
     
     
       33. The receiving device according to claim 23, further comprising:
 a setting unit which sets a reference frame image from the frame images continuously acquired by the acquiring unit;   a determination unit which compares the frame images continuously acquired by the acquiring unit with the reference frame image set by the setting unit, and determines whether or not each acquired frame image moves with respect to the reference frame image; and   a correction unit which corrects each acquired frame image that has been determined to have moved by the determination unit, to match the reference frame image.   
     
     
       34. The receiving device according to claim 23, further comprising:
 an area dividing unit which divides the frame image output from the image pickup unit into a plurality of areas;   wherein the acquiring unit acquires, continuously in time series, frame images of the areas divided by the area dividing unit.   
     
     
       35. The receiving device according to claim 23, further comprising:
 a thinning unit which thins out the frame images output from the image pickup unit with respect to a number of pixels of the frame images;   wherein the acquiring unit acquires, continuously in time series, the frame images thinned out by the thinning unit.   
     
     
       36. The receiving device according to claim 35, further comprising:
 a condition storage unit which stores a plurality of pixel thinning conditions for the thinning unit; and   a reading unit which reads out a specific thinning condition from the plurality of thinning conditions stored in the condition storage setting unit;   wherein the acquiring unit sets the thinning condition read out by the reading unit, and acquires the frame image which is thinned out by the thinning unit under the set thinning condition.   
     
     
       37. The receiving device according to claim 36, further comprising a reading control unit which controls the reading unit to read, from the condition storage unit, a thinning condition different from the thinning condition currently set by the acquiring unit, when under the currently set thinning condition the detection unit is not able to detect the pixel having the luminance varying in accordance with the predetermined pattern. 
     
     
       38. The receiving device according to claim 23, further comprising a mode switch unit which switches between a detection mode in which the detection of the pixel by the detection unit is performed, and a decoding mode in which the decoding by the decoding unit is performed. 
     
     
       39. An information decoding method, comprising:
 acquiring, continuously in time series, a plurality of frame images output from an image pickup unit;   detecting a pixel having a luminance that varies according to a predetermined pattern, from the continuously acquired frame images;   extracting the pattern of luminance variation, by continuously reading out the detected pixel;   decoding the extracted pattern of luminance variation to obtain information; and   outputting the decoded information.   
     
     
       40. A non-transitory computer readable storage medium having a computer program stored thereon that is executable by a controller of an apparatus having an image pickup unit to control the apparatus to perform a process comprising:
 acquiring, continuously in time series, a plurality of frame images output from an image pickup unit;   detecting a pixel having a luminance that varies according to a predetermined pattern, from the continuously acquired frame images;   extracting the pattern of luminance variation, by continuously reading out the detected pixel;   decoding the extracted pattern of luminance variation to obtain information; and   outputting the decoded information.