US2021196390A1PendingUtilityA1

Systems and methods for intra-operative image acquisition and calibration

Assignee: DEPUY SYNTHES PRODUCTS INCPriority: May 22, 2016Filed: Feb 17, 2021Published: Jul 1, 2021
Est. expiryMay 22, 2036(~9.8 yrs left)· nominal 20-yr term from priority
A61B 6/487G09G 5/363G06T 7/80A61B 34/10A61B 2034/2048G06T 2207/30244G16H 30/20A61B 2034/108A61B 6/46A61B 6/563G06T 2207/30004A61B 6/505G06T 7/70
67
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

A system and method utilizing a camera device containing an inertial measuring unit or similar orientation mechanism to calibrate alignment of the camera device according to a primary image such as an image displayed on an imaging screen, and then utilizing this calibration data to guide the system or user in acquiring a spatially aligned digital image using the camera device. Steps include recording the spatial orientation of the camera in at least two spatial dimensions when aligned with the primary image and guiding the camera into relative alignment with the imaging screen when taking a picture.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A processor-implemented method on a mobile device comprising a camera, an orientation system, and a user-interface, the method comprising:
 determining, for the camera, a current camera orientation relative to a frame of reference associated with a first medical device display, wherein the current camera orientation is determined by the orientation system in a plurality of spatial dimensions;   displaying, on the user interface, a live camera image of an image displayed by the first medical device display, wherein the live camera image is displayed along with an indication of a safe zone for image capture by the mobile device, wherein the safe zone is determined based on one or more orientation parameters being within one or more corresponding orientation parameter thresholds, wherein the one or more orientation parameters are indicative of the current camera orientation; and   enabling capture of the live camera image in response to a determination that camera is in the safe zone for image capture.   
     
     
         2 . The method of  claim 1 , wherein enabling capture of the live camera image comprises initiating capture of the live camera image by activating an image capture icon on the user-interface to accept input. 
     
     
         3 . The method of  claim 2 , further comprising capturing and storing the live camera image on the mobile device in response to an image capture input. 
     
     
         4 . The method of  claim 3 , wherein capturing the live camera image comprises:
 recording the one or more corresponding orientation parameters at the time of image capture; and   associating the recorded orientation parameters with the captured live camera image.   
     
     
         5 . The method of  claim 4 , further comprising transmitting the captured image and the recorded orientation parameters associated with the captured image to a second medical device. 
     
     
         6 . The method of  claim 5 , wherein the transmission of the captured image and the recorded orientation parameters associated with the captured image occur over a wireless communication network. 
     
     
         7 . The method of  claim 5 , wherein the mobile device forms part of an image acquisition subsystem of the second medical device. 
     
     
         8 . The method of  claim 1 , further comprising disabling capture of the live camera image in response to a determination that camera is not in the safe zone. 
     
     
         9 . The method of  claim 1 , wherein enabling capture of the live camera image comprises automatically initiating capture of the live camera image when the camera is in the safe zone. 
     
     
         10 . The method of  claim 1 , wherein the frame of reference associated with the first medical device display is determined at a time of calibration of the camera. 
     
     
         11 . The method of  claim 1 , wherein the method is performed intra-operatively. 
     
     
         12 . A portable computing device comprising:
 a camera;   an orientation system coupled to the camera;   a user interface; and   a processor coupled to the camera, the orientation system, and the user interface, wherein the processor is configured to:
 determine a current camera orientation relative to a frame of reference associated with a first medical device display, wherein the current camera orientation is determined by the orientation system in a plurality of spatial dimensions; 
 display, on the user interface, a live camera image of an image displayed by the first medical device display, wherein the live camera image is displayed along with an indication of a safe zone for image capture, wherein the safe zone is determined based on one or more orientation parameters being within one or more corresponding orientation parameter thresholds, wherein the one or more orientation parameters are indicative of the current camera orientation; and 
 enable capture of the live camera image in response to a determination that camera is in the safe zone for image capture. 
   
     
     
         13 . The portable computing device of  claim 12 , wherein to enable capture of the live camera image, the processor is configured to initiate capture of the live camera image by activating an image capture icon on the user-interface to accept an image-capture input. 
     
     
         14 . The portable computing device of  claim 13 , wherein the processor is further configured to capture and store the live camera image on the mobile device in response to the image-capture input. 
     
     
         15 . The portable computing device of  claim 14 , wherein to capture the live camera image, the processor is configured to:
 record the one or more corresponding orientation parameters at the time of image capture; and   associate the recorded orientation parameters with the captured live camera image.   
     
     
         16 . The portable computing device of  claim 15 , wherein the processor is further configured to initiate transmission of the captured image and the recorded orientation parameters associated with the captured image to a second medical device. 
     
     
         17 . The portable computing device of  claim 16 , wherein the processor is configured to initiate the transmission of the captured image and the recorded orientation parameters associated with the captured image wirelessly. 
     
     
         18 . The portable computing device of  claim 16 , wherein the portable computing device forms part of an image acquisition subsystem of the second medical device. 
     
     
         19 . The portable computing device of  claim 12 , wherein the processor is further configured to disable capture of the live camera image in response to a determination that camera is not in the safe zone. 
     
     
         20 . A non-transitory computer-readable medium comprising executable instructions to configure a processor on a portable computing device comprising a camera to:
 determine a current camera orientation relative to a frame of reference associated with a first medical device display, wherein the current camera orientation is determined by the orientation system in a plurality of spatial dimensions;   display a live camera image of an image displayed by the first medical device display, wherein the live camera image is displayed along with an indication of a safe zone for image capture, wherein the safe zone is determined based on one or more orientation parameters being within one or more corresponding orientation parameter thresholds, wherein the one or more orientation parameters are indicative of the current camera orientation; and   enable capture of the live camera image in response to a determination that camera is in the safe zone for image capture.

Join the waitlist — get patent alerts

Track US2021196390A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.