P
US11095802B2ActiveUtilityPatentIndex 73

Method for processing a captured image and electronic device

Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTDPriority: Apr 28, 2018Filed: Nov 8, 2019Granted: Aug 17, 2021
Est. expiryApr 28, 2038(~11.8 yrs left)· nominal 20-yr term from priority
Inventors:TAN GUOHUIZHOU HAITAOTAN XIAO
H04N 5/067G06V 40/161G06V 10/751G06V 40/172G06V 10/143H04N 23/60H04N 23/611H04N 23/73H04N 23/667H04N 23/45H04N 23/56H04N 23/90H04N 23/20H04N 23/11H04N 5/2226H04N 5/232H04N 5/247
73
PatentIndex Score
4
Cited by
40
References
18
Claims

Abstract

The present disclosure provides a method and an apparatus for controlling image capturing, and an electronic device. The method includes: a second processing unit controlling a second camera to collect a second image according to a data obtaining request and sending an image collection instruction to a first processing unit in response to receiving the data obtaining request; the second processing unit obtaining exposure time periods of the first camera and the second camera in response to receiving a synchronization signal sent by the second camera; the second processing unit calculating a delay time period according to the exposure time periods; the second processing unit forwarding the synchronization signal to the first camera in response to a time period of receiving the synchronization signal reaching the delay time period; and the first processing unit processing the first image, and sending the processed first image to the second processing unit.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A method for controlling image capturing, comprising:
 controlling, by a second processing unit, a second camera to collect a second image according to a data obtaining request, and sending, by the second processing unit, an image collection instruction to a first processing unit, in response to the second processing unit receiving the data obtaining request, the image collection instruction being configured to instruct the first processing unit to control a first camera to collect a first image; 
 obtaining, by the second processing unit, a first exposure time period of the first camera and a second exposure time period of the second camera in response to the second processing unit receiving a synchronization signal, the synchronization signal being a signal sent by the second camera at an exposure start time in response to the second camera collecting the second image; 
 calculating, by the second processing unit, a delay time period according to the first exposure time period and the second exposure time period; 
 forwarding, by the second processing unit, the synchronization signal to the first camera in response to a time period of receiving the synchronization signal reaching the delay time period, the synchronization signal being configured to instruct the first camera to start exposure and collect the first image; and 
 processing, by the first processing unit, the first image and sending the processed first image to the second processing unit, 
 wherein sending the image collection instruction to the first processing unit comprises:
 sending the image collection instruction to the first processing unit by a kernel of the second processing unit operating in a first operation mode, the first operation mode being a trusted execution environment; and 
 sending the processed first image to the second processing unit comprises: 
 sending the processed first image by the first processing unit to the kernel of the second processing unit operating in the first operation mode. 
 
 
     
     
       2. The method of  claim 1 , wherein calculating the delay time period according to the first exposure time period and the second exposure time period comprises:
 calculating an exposure time difference between the first exposure time period and the second exposure time period, and dividing the exposure time difference by 2 to obtain the delay time period. 
 
     
     
       3. The method of  claim 1 , wherein calculating the delay time period according to the first exposure time period and the second exposure time period comprises:
 calculating a first intermediate exposure time point of the first exposure time period and a second intermediate exposure time point of the second exposure time period; and 
 determining a difference value between the first intermediate exposure time point and the second intermediate exposure time point as the delay time period. 
 
     
     
       4. The method of  claim 1 , wherein sending the processed first image to the second processing unit comprises:
 obtaining an application type of an application sending the data obtaining request; 
 determining a security level of the application according to the application type; 
 selecting a data transmission channel corresponding to the security level; 
 sending the processed first image by the first processing unit to the kernel of the second processing unit operating in the first operation mode in response to the data transmission channel being a security channel; and 
 sending the processed first image by the first processing unit to a camera driver in a second operation mode in response to the data transmission channel being a non-security channel, the second operation mode being a rich execution environment. 
 
     
     
       5. The method of  claim 1 , further comprising:
 obtaining a security level of an application sending the data obtaining request; 
 determining an image accuracy corresponding to the security level; and 
 sending image data corresponding to the image accuracy to the application. 
 
     
     
       6. The method of  claim 1 , wherein the first image comprises a speckle image; and processing the first image by the first processing unit and sending the processed first image to the second processing unit comprises:
 obtaining a reference speckle image stored, in which, the reference speckle image comprises reference depth information; 
 matching the reference speckle image with the speckle image to obtain a matching result; and 
 generating a depth parallax map according to the reference depth information and the matching result, sending the depth parallax map to the second processing unit, and processing the depth parallax map by the second processing unit to obtain a depth image. 
 
     
     
       7. An electronic device, comprising a first processing unit, a second processing unit and a camera module, wherein, the first processing unit is coupled to the second processing unit and the camera module respectively, the camera module comprises a first camera and a second camera, the first processing unit is coupled to the first camera via a control line, the second processing unit is coupled to the second camera via a control line, the first processing unit is coupled to the second processing unit, and the second processing unit is coupled to the first camera and the second camera respectively via a signal line;
 the second processing unit is configured to control the second camera to collect a second image according to a data obtaining request, and send an image collection instruction to the first processing unit in response to receiving the data obtaining request; 
 the first processing unit is configured to control the first camera to collect a first image according to the image collection instruction; 
 the second camera is configured to send a synchronization signal to the second processing unit at an exposure start time in response to the second camera collecting the second image; 
 the second processing unit is further configured to obtain a first exposure time period of the first camera and a second exposure time period of the second camera in response to receiving the synchronization signal sent by the second camera, and calculate a delay time period according to the first exposure time period and the second exposure time period; 
 the second processing unit is further configured to forward the synchronization signal to the first camera in response to a time period of receiving the synchronization signal reaching the delay time period; 
 the first camera is configured to start exposure and to collect the first image according to the synchronization signal; 
 the first processing unit is further configured to process the first image and to send the processed first image to the second processing unit; 
 the second processing unit is further configured to send the image collection instruction to the first processing unit by a kernel of the second processing unit operating in a first operation mode, in which, the first operation mode is a trusted execution environment; and 
 the first processing unit is further configured to send the processed first image to the kernel in the second processing unit operating in the first operation mode. 
 
     
     
       8. The electronic device of  claim 7 , wherein, the second processing unit is configured to calculate an exposure time difference between the first exposure time period and the second exposure time period, and divide the exposure time difference by 2 to obtain the delay time period. 
     
     
       9. The electronic device of  claim 7 , wherein, the second processing unit is configured to calculate a first intermediate exposure time point of the first exposure time period and a second intermediate exposure time point of the second exposure time period, and determine a difference value between the first intermediate exposure time point and the second intermediate exposure time point as the delay time period. 
     
     
       10. The electronic device of  claim 7 , wherein, the second processing unit is further configured to: obtain an application type of an application sending the data obtaining request, to determine a security level of the application according to the application type, and select a data transmission channel corresponding to the security level;
 the first processing unit is further configured to send the processed first image to the kernel of the second processing unit operating in the first operation mode in response to the data transmission channel being a security channel; and 
 the first processing unit is further configured to send the processed first image to a camera driver in a second operation mode in response to the data transmission channel being a non-security channel, in which, the second operation mode is a rich execution environment. 
 
     
     
       11. The electronic device of  claim 7 , wherein, the second processing unit is further configured to obtain a security level of an application sending the data obtaining request, determine an image accuracy corresponding to the security level, and send image data corresponding to the image accuracy to the application. 
     
     
       12. The electronic device of  claim 7 , wherein the first image comprises a speckle image;
 wherein the first processing unit is further configured to obtain a reference speckle image stored, in which, the reference speckle image comprises reference depth information; 
 wherein the first processing unit is further configured to match the reference speckle image with the speckle image to obtain a matching result; 
 wherein the first processing unit is further configured to generate a depth parallax map according to the reference depth information and the matching result, and send the depth parallax map to the second processing unit; and 
 wherein the second processing unit is further configured to process the depth parallax map to obtain a depth image. 
 
     
     
       13. An electronic device, comprising a first processing unit, a second processing unit and a camera module, wherein, the first processing unit is coupled to the second processing unit and the camera module respectively, the camera module comprises a first camera and a second camera, the first processing unit is coupled to the first camera via a control line, the second processing unit is coupled to the second camera via a control line, the first processing unit is coupled to the second processing unit, and the first processing unit is coupled to the first camera and the second camera respectively via a signal line;
 the second processing unit is configured to: in response to receiving a data obtaining request, control the second camera to collect a second image according to the data obtaining request, and to send an image collection instruction to the first processing unit; 
 the first processing unit is configured to control the first camera to collect a first image according to the image collection instruction in response to receiving the image collection instruction sent by the second processing unit; 
 the second camera is configured to send a synchronization signal to the first processing unit at an exposure start time in response to collecting the second image; 
 the first processing unit is further configured to obtain a first exposure time period of the first camera and a second exposure time period of the second camera in response to receiving the synchronization signal sent by the second camera; 
 the first processing unit is further configured to calculate a delay time period according to the first exposure time period and the second exposure time period; 
 the first processing unit is further configured to forward the synchronization signal to the first camera in response to a time period of receiving the synchronization signal reaching the delay time period; 
 the first camera is configured to start exposure and to collect the first image according to the synchronization signal; 
 the first processing unit is further configured to process the first image and to send the processed first image to the second processing unit; 
 the second processing unit is further configured to send the image collection instruction to the first processing unit by a kernel of the second processing unit operating in a first operation mode, in which, the first operation mode is a trusted execution environment; and 
 the first processing unit is further configured to send the processed first image to the kernel in the second processing unit operating in the first operation mode. 
 
     
     
       14. The electronic device of  claim 13 , wherein, the first processing unit is configured to calculate an exposure time difference between the first exposure time period and the second exposure time period, and to divide the exposure time difference value by 2 to obtain the delay time period. 
     
     
       15. The electronic device of  claim 13 , wherein, the first processing unit is configured to: calculate a first intermediate exposure time point of the first exposure time period and a second intermediate exposure time point of the second exposure time period; and
 determine a difference value between the first intermediate exposure time point and the second intermediate exposure time point as the delay time period. 
 
     
     
       16. The electronic device of  claim 13 , wherein,
 the first camera is a laser camera and configured to collect a speckle image; 
 the first processing unit is further configured to obtain a reference speckle image stored, and match the reference speckle image with the speckle image to obtain a matching result, in which, the reference speckle image comprises reference depth information; 
 the first processing unit is further configured to generate a depth parallax map according to the reference depth information and the matching result, and send the depth parallax map to the second processing unit; and 
 the second processing unit is further configured to process the depth parallax map to obtain a depth image. 
 
     
     
       17. The electronic device of  claim 16 , wherein, the second processing unit is further configured to: collect a temperature of a laser every collection time period and obtain a reference speckle image corresponding to the temperature; and
 the second processing unit is further configured to write the reference speckle image corresponding to the temperature into the first processing unit in response to the reference speckle image corresponding to the temperature being inconsistent with the reference speckle image stored in the first processing unit. 
 
     
     
       18. The electronic device of  claim 16 , wherein,
 the second processing unit is further configured to obtain a security level of an application in response to receiving a data obtaining request of the application; and 
 the second processing unit is further configured to determine a data transmission channel corresponding to the security level, and to send the depth image to the application through the data transmission channel.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.