Method and system for scanning images in a photo kiosk

Abstract

A method and system for determining the orientation of an image of a picture within a scanned image, including the steps of locating in the scanned image the contour of the image of the picture, determining a plurality of bounding boxes confining the contour of the image of the picture, selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture, and calculating an angle of rotation of the picture based on the selected bounding box.

1. A method for determining the orientation of an image of a picture within a scanned image, comprising the steps of:
 locating in the scanned image a contour of the image of the picture; 
 determining a plurality of bounding boxes confining the contour of the image of the picture; 
 selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture; and 
 calculating an angle of rotation of the picture based on the selected bounding box. 
 
     
     
       2. The method of  claim 1  and also including the step of applying edge detection to the scanned image, to locate edges of the image of the picture. 
     
     
       3. The method of  claim 2  wherein the edge detection includes use of a Gaussian filter. 
     
     
       4. The method of  claim 2  wherein the edge detection includes use of a Laplace filter. 
     
     
       5. The method of  claim 2  wherein the edge detection includes use of a Laplacian of Gaussian filter. 
     
     
       6. The method of  claim 2  and also including the step of identifying a bounding area of pixel locations that surrounds the image of the picture. 
     
     
       7. The method of  claim 6  and also including the step of pre-scanning the picture at a low resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding area of pixel locations. 
     
     
       8. The method of  claim 6  wherein said locating step comprises locating pixel locations situated at edges of the image of the picture and within the bounding area that are nearest to the border of the bounding area. 
     
     
       9. The method of  claim 1  wherein each of the plurality of bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box. 
     
     
       10. The method of  claim 1  wherein said determining step comprises:
 providing a reference box; and 
 rotating the reference box about its center through multiple angles of rotation. 
 
     
     
       11. The method of  claim 10  wherein said providing step comprises:
 finding a region that bounds the contour of the image of the picture; and 
 generating a box that encloses within it a circle, the circle being large enough to enclose the region. 
 
     
     
       12. The method of  claim 11  wherein the center of the circle is coincident with the center of the reference box. 
     
     
       13. The method of  claim 11  wherein the center of the reference box is coincident with the centroid of the image of the picture. 
     
     
       14. The method of  claim 1  wherein said selecting step includes:
 determining for each of the bounding boxes an average distance between the bounding box and the contour of the image of the picture; and 
 choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is small as compared to the respective average distances between others of the plurality of bounding boxes and the contour of the image of the picture. 
 
     
     
       15. The method of  claim 14  wherein said choosing step includes choosing a bounding box for which the average distance between the bounding box and the contour of the image of the picture is smallest among the respective average distances between the plurality of bounding boxes and the contour of the image of the picture. 
     
     
       16. A method for operating a scanner, comprising:
 detecting that a user has placed a plurality of pictures in arbitrary orientations on a scanner bed of the scanner; 
 scanning the plurality of pictures to generate a scanned image containing a plurality of images of the pictures; and 
 automatically determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image; 
 applying edge detection to the scanned image to locate edges of the plurality of images of the pictures, and 
 identifying bounding areas of pixel locations for each image of a picture from among the plurality of images of pictures, each bounding area surrounding one image of a picture from among the plurality of images of pictures, such that identifying bounding areas includes,
 initializing a plurality of expandable groups of pixel locations; 
 expanding each of the expandable groups of pixel locations until none of the pixel locations on its boundary are situated at edges. 
 
 
     
     
       17. The method of  claim 16  wherein the edge detection includes use of a Gaussian filter. 
     
     
       18. The method of  claim 16  wherein the edge detection includes use of a Laplace filter. 
     
     
       19. The method of  claim 16  wherein the edge detection includes use of a Laplacian of Gaussian filter. 
     
     
       20. The method of  claim 16  and also including the step of pre-scanning the plurality of pictures at a low resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding areas. 
     
     
       21. The method of  claim 16  further comprising the step of coalescing two expandable groups of pixel locations when they overlap as a result of said expanding step. 
     
     
       22. The method of  claim 16  further comprising the steps of:
 determining a separation between two expandable groups of pixel locations; and 
 coalescing the two expandable groups of pixel locations when their separation is smaller than a prescribed threshold. 
 
     
     
       23. A method for operating a scanner, comprising:
 detecting that a user has placed a plurality of pictures in arbitrary orientations on a scanner bed of the scanner; 
 scanning the plurality of pictures to generate a scanned image containing a plurality of images of the pictures; 
 automatically determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image; 
 applying edge detection to the scanned image to locate edges of the plurality of images of the pictures, and 
 identifying bounding areas of pixel locations for each image of a picture from among the plurality of images of pictures, each bounding area surrounding one image of a picture from among the plurality of images of pictures, wherein said automatically determining the orientation comprises, for each image of a picture from among the plurality of images of pictures, the steps of:
 detecting a contour of the image of the picture; 
 determining a plurality of bounding boxes enclosing the contour of the image of the picture; 
 selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture; and 
 calculating an angle of rotation of the picture based on the selected bounding box. 
 
 
     
     
       24. The method of  claim 23  wherein each of the plurality of bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box. 
     
     
       25. The method of  claim 23  wherein said detecting step comprises locating pixel locations situated at edges of the image of the picture and within the bounding area of the image of the picture that are nearest to the border of the bounding area. 
     
     
       26. The method of  claim 23  wherein said determining step comprises:
 providing a reference box; and 
 rotating the reference box about its center through multiple angles of rotation. 
 
     
     
       27. The method of  claim 26  wherein said providing step comprises:
 finding a region that bounds the contour of the image of the picture; and 
 generating a reference box that encloses within it a circle, the circle being large enough to enclose the region. 
 
     
     
       28. The method of  claim 27  wherein the center of the circle is coincident with the center of the center of the reference box. 
     
     
       29. The method of  claim 27  wherein the center of the box is coincident with the centroid of the picture. 
     
     
       30. The method of  claim 23  wherein said selecting step includes: determining for each of the bounding boxes, an average distance between the bounding box and the contour of the image of the picture; and
 choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is small as compared to the respective average distances between others of the plurality of bounding boxes and the contour of the image of the picture. 
 
     
     
       31. The method of  claim 30  wherein said choosing step includes choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is smallest among the respective average distances between the bounding boxes and the contour of the image of the picture. 
     
     
       32. A system for determining the orientation of an image of a picture within a scanned image, comprising:
 an image processor locating in the scanned image a contour of the image of the picture; 
 a box generator determining a plurality of bounding boxes confining the contour of the image of the picture; 
 a box processor selecting one of the plurality of bounding boxes that is significantly aligned with the contour of the image of the picture; and 
 an angle processor calculating an angle of rotation of the picture based on the selected bounding box. 
 
     
     
       33. An apparatus, comprising:
 means for locating in the scanned image a contour of the image of the picture;   means for determining one or more bounding boxes confining the contour of the image of the picture;   means for selecting one of the bounding boxes that is substantially aligned with the contour of the image of the picture; and   means for calculating an angle of rotation of the picture based at least in part on the selected bounding box.   
     
     
       34. An apparatus as claimed in claim 33, further comprising means for applying edge detection to the scanned image, to locate edges of the image of the picture. 
     
     
       35. An apparatus as claimed in claim 34, wherein said means for applying edge detection comprises a Gaussian filter. 
     
     
       36. An apparatus as claimed in claim 34, said means for applying edge detection comprises a Laplace filter. 
     
     
       37. An apparatus as claimed in of claim 34, said means for applying edge detection comprises a Laplacian of Gaussian filter. 
     
     
       38. An apparatus as claimed in claim 34, further comprising means for identifying a bounding area of pixel locations that surrounds the image of the picture. 
     
     
       39. An apparatus as claimed in claim 38, further comprising means for pre-scanning the picture at a low resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding area of pixel locations. 
     
     
       40. An apparatus as claimed in claim 38, said means for locating comprises means for locating pixel locations situated at edges of the image of the picture and within the bounding area that are nearest to the border of the bounding area. 
     
     
       41. An apparatus as claimed in claim 33, wherein one or more of the bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box. 
     
     
       42. An apparatus as claimed in claim 33 wherein said means for determining comprises:
 means for providing a reference box; and   means for rotating the reference box about its center through multiple angles of rotation.   
     
     
       43. An apparatus as claimed in claim 42 wherein said means for providing comprises:
 means for finding a region that bounds the contour of the image of the picture; and   means for generating a box that encloses within it a circle, the circle being large enough to enclose the region.   
     
     
       44. An apparatus as claimed in claim 43, wherein the center of the circle is coincident with the center of the reference box. 
     
     
       45. An apparatus as claimed in claim 43, wherein the center of the reference box is coincident with the centroid of the image of the picture. 
     
     
       46. An apparatus as claimed in claim 33, said means for selecting comprising:
 means for determining for one or more of the bounding boxes an average distance between the bounding box and the contour of the image of the picture; and   means for choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is small as compared to the respective average distances between others of the plurality of bounding boxes and the contour of the image of the picture.   
     
     
       47. An apparatus as claimed in claim 46 wherein said means for choosing comprises means for choosing a bounding box for which the average distance between the bounding box and the contour of the image of the picture is smallest among the respective average distances between the one or more bounding boxes and the contour of the image of the picture. 
     
     
       48. An apparatus, comprising:
 means for detecting that a user has placed one or more pictures in arbitrary orientations on a scanner bed of a scanner;   means for scanning the one or more pictures to generate a scanned image containing one or more images of the pictures; and   means for determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image;   means for applying edge detection to the scanned image to locate edges of the one or more images of the pictures, and   means for identifying bounding areas of pixel locations for one or more image of a picture from among the one or more images of pictures, one or more bounding area surrounding one image of a picture from among the one or more images of pictures, such that said means for identifying bounding areas comprises:   means for initializing one or more expandable groups of pixel locations;   means for expanding one or more of the expandable groups of pixel locations until none, or nearly none, of the pixel locations on its boundary are situated at edges.   
     
     
       49. An apparatus as claimed in claim 48, said means for applying edge detection comprising a Gaussian filter. 
     
     
       50. An apparatus as claimed in claim 48, said means for applying edge detection comprising a Laplace filter. 
     
     
       51. An apparatus as claimed in claim 48, said means for applying edge detection comprising a Laplacian of Gaussian filter. 
     
     
       52. An apparatus as claimed in claim 48, further comprising means for pre-scanning the one or more pictures at a lower resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding areas. 
     
     
       53. An apparatus as claimed in claim 48, further comprising means for coalescing two or more expandable groups of pixel locations when the two or more expandable groups at least partially overlap as a result of said means for expanding. 
     
     
       54. An apparatus as claimed in claim 48, further comprising:
 means for determining a separation between two or more expandable groups of pixel locations; and   means for coalescing the two or more expandable groups of pixel locations when their separation is smaller than a prescribed threshold.   
     
     
       55. An apparatus, comprising:
 means for detecting that a user has placed one or more pictures in arbitrary orientations on a scanner bed of the scanner;   means for scanning the one or more pictures to generate a scanned image containing one or more images of the pictures;   means for determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image;   means for applying edge detection to the scanned image to locate edges of the one or more images of the pictures, and   means for identifying bounding areas of pixel locations for one or more image of a picture from among the one or more images of pictures, one or more bounding area surrounding one image of a picture from among the one or more images of pictures, wherein said means for determining the orientation comprises:   means for detecting a contour of the image of the picture;   means for determining a one or more bounding boxes enclosing the contour of the image of the picture;   means for selecting one of the one or more bounding boxes that is substantially aligned with the contour of the image of the picture; and   means for calculating an angle of rotation of the picture based at least in part on the selected bounding box.   
     
     
       56. An apparatus as claimed in claim 55, wherein one or more of the bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box. 
     
     
       57. An apparatus as claimed in claim 55, said means for detecting comprising means for locating pixel locations situated at edges of the image of the picture and within the bounding area of the image of the picture that are nearest to the border of the bounding area. 
     
     
       58. An apparatus as claimed in claim 55, said means for determining comprising:
 means for providing a reference box; and   means for rotating the reference box about its center through multiple angles of rotation.   
     
     
       59. An apparatus as claimed in claim 58, said means for providing comprising:
 means for finding a region that bounds the contour of the image of the picture; and   means for generating a reference box that encloses within it a circle, the circle being large enough to enclose the region.   
     
     
       60. An apparatus as claimed in claim 59, wherein the center of the circle is coincident with the center of the center of the reference box. 
     
     
       61. An apparatus as claimed in claim 59, wherein the center of the box is coincident with the centroid of the picture. 
     
     
       62. An apparatus as claimed in claim 55, said means for selecting comprising:
 means for determining for one or more of the bounding boxes, an average distance between the bounding box and the contour of the image of the picture; and   means for choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is relatively small as compared to the respective average distances between others of the one or more bounding boxes and the contour of the image of the picture.   
     
     
       63. An apparatus as claimed in claim 62, said means for choosing comprising means for choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is smallest, or nearly smallest, among the respective average distances between the bounding boxes and the contour of the image of the picture. 
     
     
       64. An apparatus, comprising:
 means for locating in a scanned image a contour of the image of a picture;   means for determining one or more bounding boxes confining the contour of the image of the picture;   means for selecting one or more of the bounding boxes that is significantly aligned with the contour of the image of the picture; and   means for calculating an angle of rotation of the picture based at least in part on the selected bounding box.