Method and apparatus based on 3D camera for automated measurement preparation in MRI system

Abstract

The disclosure relates to techniques for scan preparation in a medical imaging system. The technique includes triggering a 3D camera acquiring a 2D color and depth image of a patient when a patient bed is at an origin position, inputting the image into a pre-trained first body information model to obtain position information of multiple body feature site points, and calculating position information of multiple candidate scanning regions in the patient bed coordinate system. The technique further includes providing the position information of the multiple candidate scanning regions to a medical imaging application apparatus, so that the medical imaging application apparatus determines position information of a current scanning region in the patient bed coordinate system and controls the patient bed to move the current scanning region to a scanning center of a medical imaging device according to the position of the patient bed relative to the scanning center.

What is claimed is: 
     
       1. A method for scan preparation in a medical imaging system, comprising:
 triggering, via one or more processors, a 3D camera mounted above a patient bed associated with the medical imaging system to acquire a 2D color and depth image of a patient when the patient bed is at a predetermined position; 
 inputting, via one or more processors, the 2D color and depth image acquired by the 3D camera into a first body information model; 
 receiving, via one or more processors, position information that is output by the first body information model of multiple body feature site points in accordance with one of a camera coordinate system or a patient bed coordinate system, 
 wherein, when the position information is output in accordance with the camera coordinate system, converting, via one or more processors, the position information in accordance with the camera coordinate system into position information in accordance with the patient bed coordinate system using a conversion relationship between the patient bed coordinate system and the camera coordinate system that is determined from a calibration of the 3D camera; 
 calculating, via one or more processors, position information of multiple candidate scanning regions in accordance with the patient bed coordinate system using the position information of the multiple body feature site points; 
 providing, via one or more processors, the position information of the multiple candidate scanning regions to a medical imaging application apparatus; 
 upon receiving a scan initiation instruction triggered by a user, comparing a height, weight, and posture information of the patient with respective height, weight, and posture information registered in advance by the user; and 
 when (i) a deviation of the height and weight exceeds a respectively set threshold, or (ii) the posture information differs from a predetermined difference threshold, presenting a warning message box and determining height, weight, and posture information to be used in the current scan according to a user selection, 
 wherein the medical imaging application apparatus determines position information of a current scanning region in accordance with the patient bed coordinate system and controls the patient bed to move the current scanning region to a scanning center of a medical imaging device using the position information of the current scanning region and the position of the patient bed relative to the scanning center. 
 
     
     
       2. The method for scan preparation in a medical imaging system as claimed in  claim 1 , further comprising:
 when a coil covers a body region of the patient, obtaining information of the body region covered by the coil that is output by the first body information model; and 
 providing the information of the body region covered by the coil to the medical imaging application apparatus, 
 wherein the medical imaging application apparatus determines one or more candidate scanning regions supported by the medical imaging system using the information of the body region covered by the coil and selects the current scanning region from among the one or more candidate scanning regions. 
 
     
     
       3. The method for scan preparation in a medical imaging system as claimed in  claim 1 , further comprising:
 inputting the 2D color and depth image into a pre-trained second body information model, 
 wherein the height, weight, and posture information of the patient is output by the second body information model, and 
 wherein the second body information model is generated by (i) training, using multiple sets of 2D color and depth images acquired in advance as an input parameter set, and (ii) using height, weight, and posture information corresponding to each set of 2D color and depth images acquired in advance as an output parameter set; and 
 providing the height, weight, and posture information of the patient to the medical imaging application apparatus, 
 wherein the medical imaging application apparatus uses the height, weight, and posture information to perform information registration for the patient. 
 
     
     
       4. The method for scan preparation in a medical imaging system as claimed in  claim 3 , wherein medical imaging application apparatus using the height, weight, and posture information to perform the information registration for the patient comprises:
 pre-filling a corresponding information box with the height, weight, and posture information for presentation to a user as part of a patient registration stage. 
 
     
     
       5. The method for scan preparation in a medical imaging system as claimed in  claim 1 , wherein the predetermined position of the patient bed is an origin position of the patient bed. 
     
     
       6. The method for scan preparation in a medical imaging system as claimed in  claim 1 , wherein the first body information model is generated by (i) training, using multiple sets of predetermined 2D color and depth images as an input parameter set, and (ii) using position information of multiple body feature site points in the camera coordinate system or the patient bed coordinate system corresponding to each set of the predetermined 2D color and depth images as an output parameter set. 
     
     
       7. An acquisition control and image analysis apparatus, comprising:
 an acquisition control module configured to trigger a 3D camera mounted above a patient bed in a medical imaging system to acquire a 2D color and depth image of a patient when the patient bed is at a predetermined position; and 
 an image analysis module configured to: 
 input the 2D color and depth image into a first body information model; 
 receive position information that is output by the first body information model of multiple body feature site points in accordance with one of a camera coordinate system or a patient bed coordinate system; 
 when the position information is output in accordance with the camera coordinate system, convert the position information in accordance with the camera coordinate system into position information in accordance with the patient bed coordinate system using a conversion relationship between the patient bed coordinate system and the camera coordinate system that is determined from a calibration of the 3D camera; 
 calculate position information of multiple candidate scanning regions in accordance with the patient bed coordinate system using the position information of the multiple body feature site points; and 
 providing the position information of the multiple candidate scanning regions to a medical imaging application apparatus, 
 wherein the medical imaging application apparatus is configured to: 
 upon receiving a scan initiation instruction triggered by a user, compare a height, weight, and posture information of the patient with respective height, weight, and posture information registered in advance by the user; and 
 when (i) a deviation of the height and weight exceeds a respectively set threshold, or (ii) the posture information differs from a predetermined difference threshold, present a warning message box and determining height, weight, and posture information to be used in the current scan according to a user selection, and 
 determine position information of a current scanning region in accordance with the patient bed coordinate system and moves the current scanning region to a scanning center of a medical imaging device using the position information of the current scanning region and the position of the patient bed relative to the scanning center. 
 
     
     
       8. The acquisition control and image analysis apparatus as claimed in  claim 7 , wherein the image analysis module is further configured to:
 when a coil covers a body region of the patient, obtain information of the body region covered by the coil that is output by the first body information model; and 
 provide the information of the body region covered by the coil to the medical imaging application apparatus, 
 wherein the medical imaging application apparatus determines one or more candidate scanning regions supported by the medical imaging system using the information of the body region covered by the coil, and selects the current scanning region from among the one or more candidate scanning regions. 
 
     
     
       9. The acquisition control and image analysis apparatus as claimed in  claim 7 , wherein the image analysis module is further configured to:
 input the 2D color and depth image into a trained second body information model; and 
 wherein the height, weight, and posture information of the patient is output by the second body information model, 
 wherein the second body information model is generated by (i) training, using multiple sets of predetermined 2D color and depth images as an input parameter set, and (ii) using height, weight, and posture information corresponding to each set of the predetermined 2D color and depth images as an output parameter set, and 
 provide the height, weight, and posture information of the patient to the medical imaging application apparatus, 
 wherein the medical imaging application apparatus uses the height, weight, and posture information to perform information registration for the patient. 
 
     
     
       10. The acquisition control and image analysis apparatus as claimed in  claim 7 , wherein the first body information model is generated by (i) training, using multiple sets of predetermined 2D color and depth images as an input parameter set, and (ii) using position information of multiple body feature site points in the camera coordinate system or the patient bed coordinate system corresponding to each set of the predetermined 2D color and depth images as an output parameter set. 
     
     
       11. The acquisition control and image analysis apparatus as claimed in  claim 7 , wherein the predetermined position of the patient bed is an origin position of the patient bed. 
     
     
       12. A system for scan preparation in a medical imaging system, comprising:
 a first memory and a first processor, the first memory being configured to store a first computer program, and the first processor being configured to execute the first computer program to trigger a 3D camera mounted above a patient bed associated with the medical imaging system to acquire a 2D color and depth image of a patient when the patient bed is at a predetermined position; and 
 a second memory and a second processor, the second memory being configured to store a second computer program, and the second processor being configured to execute the second computer program to: 
 input the 2D color and depth image into a first body information model; 
 obtain position information that is output by the first body information model of multiple body feature site points in accordance with one of a camera coordinate system or patient bed coordinate system; 
 when the position information is accordance with the camera coordinate system, convert the position information in accordance with the camera coordinate system into position information in accordance with the patient bed coordinate system using a conversion relationship between the patient bed coordinate system and the camera coordinate system that is determined from a calibration of the 3D camera; 
 calculate position information of multiple candidate scanning regions using the position information of the multiple body feature site points; 
 obtain determined position information of a current scanning region using the position information of the multiple candidate scanning regions; 
 upon receiving a scan initiation instruction triggered by a user, compare a height, weight, and posture information of the patient with respective height, weight, and posture information registered in advance by the user; 
 when (i) a deviation of the height and weight exceeds a respectively set threshold, or (ii) the posture information differs from a predetermined difference threshold, present a warning message box and determining height, weight, and posture information to be used in the current scan according to a user selection, 
 and 
 control the patient bed to move the current scanning region to a scanning center of a medical imaging device associated with the medical imaging system according to the position information of the current scanning region and the position of the patient bed relative to the scanning center. 
 
     
     
       13. The system as claimed in  claim 12 , wherein the second processor is further configured to execute the second computer program to:
 when a coil covers a body region of the patient, obtain information of the body region covered by the coil that is output by the first body information model; and 
 provide the information of the body region covered by the coil to the medical imaging system, 
 wherein the medical imaging system determines one or more candidate scanning regions supported by the medical imaging system using the information of the body region covered by the coil, and selects the current scanning region from among the one or more candidate scanning regions. 
 
     
     
       14. The system as claimed in  claim 12 , wherein the second processor is further configured to execute the second computer program to:
 input the 2D color and depth image into a trained second body information model; and 
 wherein the height, weight, and posture information of the patient is output by the second body information model, 
 wherein the second body information model is generated by (i) training, using multiple sets of predetermined 2D color and depth images as an input parameter set, and (ii) using height, weight, and posture information corresponding to each set of the predetermined 2D color and depth images as an output parameter set, and 
 provide the height, weight, and posture information of the patient to the medical imaging system, 
 wherein the medical imaging system uses the height, weight, and posture information to perform information registration for the patient. 
 
     
     
       15. The system as claimed in  claim 12 , wherein the second processor is further configured to execute the second computer program to generate the first body information model by (i) training, using multiple sets of predetermined 2D color and depth images as an input parameter set, and (ii) using position information of multiple body feature site points in the camera coordinate system or the patient bed coordinate system corresponding to each set of the predetermined 2D color and depth images as an output parameter set. 
     
     
       16. The system as claimed in  claim 12 , wherein the predetermined position of the patient bed is an origin position of the patient bed.