Electronic device and method for checking connection of a connector

Abstract

An electronic device according to various embodiments may include a communication circuit and a processor, wherein the processor is configured to receive a streaming image photographed by a first external electronic device through the communication circuit from a first external electronic device, identify a start of a fastening action of a user with respect to a target connector based on the streaming image, periodically obtain sensor data from a second external electronic device worn on the user based on identifying the start of the fastening action, identify an end of the fastening action with respect to the target connector based on the streaming image, and determine whether the target connector is fastened based on the sensor data obtained from the start of the fastening action to the end of the fastening action.

What is claimed is: 
     
       1. An electronic device comprising:
 a communication circuit, 
 at least one processor, and 
 a memory storing instructions that, when executed by the at least one processor, cause the electronic device to:
 receive, through the communication circuit from a first external electronic device, a streaming image in which a target connector is photographed by the first external electronic device, 
 identify a start of a fastening action of a user with respect to the target connector, based on the streaming image, 
 periodically obtain first sensor data and second sensor data from a second external electronic device worn on the user, based on identifying the start of the fastening action, the first sensor data comprising vibration data, and the second sensor data comprising audio data, 
 identify an end of the fastening action with respect to the target connector, based on the streaming image, and 
 determine whether the target connector is fastened, based on the first sensor data and the second sensor data obtained from the start of the fastening action to the end of the fastening action. 
 
 
     
     
       2. The electronic device of  claim 1 , wherein the instructions that, when executed by the at least one processor, cause the electronic device to request a stop of transmission of the first sensor data and the second sensor data from the second external electronic device, based on the identifying of the end of the fastening action. 
     
     
       3. The electronic device of  claim 1 , wherein the instructions that, when executed by the at least one processor, cause the electronic device to identify the target connector among a plurality of connectors, based on the streaming image. 
     
     
       4. The electronic device of  claim 1 , wherein the instructions that, when executed by the at least one processor, cause the electronic device to obtain additional sensor data comprising at least one of data sensed by an acceleration sensor or biometric data. 
     
     
       5. The electronic device of  claim 1 , wherein the instructions that, when executed by the at least one processor, cause the electronic device to transmit, to the second external electronic device, first information indicating whether the target connector is fastened. 
     
     
       6. The electronic device of  claim 5 , wherein the instructions that, when executed by the at least one processor, cause the electronic device to:
 transmit, to the second external electronic device, second information indicating non-fastening based on fastening of the target connector being not normally completed, and 
 transmit, to the second external electronic device, third information indicating fastening based on the fastening being normally completed. 
 
     
     
       7. The electronic device of  claim 1 , wherein the electronic device further comprises a display, and wherein the instructions that, when executed by the at least one processor, cause the electronic device to display, through the display, information indicating whether the target connector is fastened. 
     
     
       8. The electronic device of  claim 1 , wherein the instructions that, when executed by the at least one processor, cause the electronic device to:
 transmit the streaming image to a server, based on receiving the streaming image, and 
 obtain, from the server, information on a start time point of the fastening action with respect to the target connector and information on an end time point of the fastening action with respect to the target connector. 
 
     
     
       9. The electronic device of  claim 8 , wherein the instructions that, when executed by the at least one processor, cause the electronic device to obtain, from the server, information on a type of the target connector together with information on the start time point. 
     
     
       10. The electronic device of  claim 1 , wherein the target connector comprises a fastening part of an automobile part. 
     
     
       11. A method of operating an electronic device, the method comprising:
 receiving, through a communication circuit from a first external electronic device, a streaming image in which a target connector is photographed by the first external electronic device; 
 identifying a start of a fastening action of a user with respect to the target connector, based on the streaming image; 
 periodically obtaining first sensor data and second sensor data from a second external electronic device worn on the user, based on identifying the start of the fastening action, the first sensor data comprising vibration data, and the second sensor data comprising audio data; 
 identifying an end of the fastening action with respect to the target connector, based on the streaming image; and 
 determining whether the target connector is fastened, based on the first sensor data and the second sensor data obtained from the start of the fastening action to the end of the fastening action. 
 
     
     
       12. The method of  claim 11 , further comprising requesting the second external electronic device to stop transmission of the first sensor data and the second sensor data, based on the identifying of the end of the fastening action. 
     
     
       13. The method of  claim 11 , further comprising identifying the target connector among a plurality of connectors, based on the streaming image. 
     
     
       14. The method of  claim 11 , further comprising:
 obtaining additional sensor data comprising at least one of data sensed by an acceleration sensor or biometric data. 
 
     
     
       15. The method of  claim 11 , further comprising transmitting, to the second external electronic device, first information indicating whether the target connector is fastened. 
     
     
       16. The method of  claim 15 , wherein the transmitting of the first information indicating whether the target connector is fastened comprises:
 transmitting, to the second external electronic device, second information indicating non-fastening based on fastening of the target connector being not normally completed; and 
 transmitting, to the second external electronic device, third information indicating fastening based on the fastening being normally completed. 
 
     
     
       17. The method of  claim 11 , further comprising:
 transmitting the streaming image to a server, based on receiving the streaming image; and 
 obtaining, from the server, information on a start time point of the fastening action with respect to the target connector and information on an end time point of the fastening action with respect to the target connector. 
 
     
     
       18. The method of  claim 17 , wherein the obtaining of the information on the start time point comprises obtaining, from the server, information on a type of the target connector together with the information on the start time point. 
     
     
       19. An electronic device comprising:
 a camera, 
 a communication circuit, and 
 a processor, wherein the processor is configured to:
 obtain, through the communication circuit, a streaming image in which a target connector is photographed using the camera, 
 identify a start of a fastening action of a user with respect to the target connector, based on the streaming image, 
 periodically obtain first sensor data and second sensor data from an external electronic device worn on the user, based on identifying the start of the fastening action, the first sensor data comprising vibration data, and the second sensor data comprising audio data, 
 identify an end of the fastening action with respect to the target connector, based on the streaming image, and 
 determine whether the target connector is fastened, based on the first sensor data and the second sensor data obtained from the start of the fastening action to the end of the fastening action. 
 
 
     
     
       20. The electronic device of  claim 19 , wherein the processor is further configured to transmit, to the external electronic device, information indicating whether the target connector is fastened.