Gesture-based multimedia casting and slinging command method and system in an interoperable multiple display device environment

Abstract

Novel gesture-based multimedia casting and slinging command methods and systems that are configured to accommodate seamless multimedia data and playback transfers across various electronic devices in a multiple display device environment are disclosed. In one instance, a “casting” of an audio/video (AV), graphical, or photographic multimedia content from a touch-screen electronic device to a targeted device (e.g. a television, another portable electronic display device, a cast-sling box, etc.) is intuitively represented by a finger swipe-up gesture command because a finger swipe-up motion mimics a physical motion of pushing, throwing, or sending an item from the touch-screen electronic device to the targeted device. In another instance, a “slinging” of an audio/video (AV), graphical, or photographic multimedia content from the targeted device is intuitively represented by a finger swipe-down gesture command because a finger swipe-down motion mimics a physical motion of “pulling-in” or receiving an item into the touch-screen electronic device.

What is claimed is: 
     
       1. A gesture-based multimedia casting and slinging command device comprising:
 a cast and sling processing module incorporating a user gesture interpreter, a sling gesture command encoder, and a cast gesture command encoder, wherein the user gesture interpreter determines a user's finger swipe-down gesture as a multimedia sling command from a targeted device to the gesture-based multimedia casting and slinging command device, and wherein the user gesture interpreter further determines the user's finger swipe-up gesture as a multimedia cast command to trigger multimedia content transmissions from the gesture-based multimedia casting and slinging command device to the targeted device, and wherein the cast and sling processing module is also configured to determine and process cast-to-sling-to-cast-to-sling and sling-to-cast-to-sling-to-cast cascaded commands involving multi-level-depth intermediary and multiple target devices; 
 the sling gesture command encoder comprising circuitry configured to encode the multimedia sling command as a multimedia inbound transfer from the targeted device and a localized playback at the gesture-based multimedia casting and slinging command device, wherein an established line-of-sightedness between the gesture-based multimedia casting and slinging command device and the targeted device triggers an intelligent machine-determined selection of a highest throughput and uncompressed communication protocol for the multimedia inbound transfer, and wherein a lost line-of-sightedness between the gesture-based multimedia casting and slinging command device and the targeted device triggers an intelligent machine-determined seamless switchover to a next-best protocol that provides a second-highest data throughput under a current inter-device proximity between the gesture-based multimedia casting and slinging command device and the targeted device; 
 the cast gesture command encoder comprising circuitry configured to encode the multimedia cast command as a multimedia content outbound transfer to the targeted device and a remote playback at the targeted device, wherein an increased inter-device proximity between the gesture-based multimedia casting and slinging command device and the targeted device during an execution of the multimedia cast command triggers an automatic activation of a third electronic device located near the targeted device to enhance a user's viewing experience, and wherein a worsened inter-device proximity between the gesture-based multimedia casting and slinging command device and the targeted device during the execution of the multimedia cast command triggers an automatic deactivation of the third electronic device located near the targeted device; 
 a touchscreen sensor interface, a graphics unit, and a touchscreen display unit operatively connected to the cast and sling processing module to receive, convert, and transmit at least one of the user's finger swipe-down gesture and the user's finger swipe-up gesture as electrical signals to the cast and sling processing module; and 
 a CPU or an APU connected to a memory unit, the touchscreen sensor interface, the graphics unit, the touchscreen display, and the cast and sling processing module, wherein the CPU or the APU is further configured to execute one or more components from the cast and sling processing module. 
 
     
     
       2. The gesture-based multimedia casting and slinging command device of  claim 1 , further comprising at least one of a power management unit, a peripheral device, sensor, and external communication interface, a digital signal processing unit for cloud server access, an audio recording and processing unit, and a camera processing unit. 
     
     
       3. The gesture-based multimedia casting and slinging command device of  claim 1 , wherein the targeted device is a television, a cast-sling box (CSB), a portable electronic device with a display panel, or an audio output device. 
     
     
       4. The gesture-based multimedia casting and slinging command device of  claim 1 , wherein the gesture-based multimedia casting and slinging command device is a smart phone, a tablet computer, a notebook computer, a cast-sling box (CSB), or another electronic device that executes a user gesture interface application associated with the user gesture interpreter in the cast and sling processing module. 
     
     
       5. The gesture-based multimedia casting and slinging command device of  claim 4 , wherein the user gesture interface application is an Android mobile app, an Apple mobile app, a PC-compatible application, or a MAC OS-compatible application. 
     
     
       6. The gesture-based multimedia casting and slinging command device of  claim 1 , wherein the user gesture interpreter in the cast and sling processing module additionally determines the user's finger swipe-left gesture as an audio content sling command and the user's finger swipe-right gesture as an audio content cast command. 
     
     
       7. The gesture-based multimedia casting and slinging command device of  claim 1 , wherein the gesture-based multimedia casting and slinging command device and the targeted device are intermediated by a cast-sling box (CSB), which transcodes or relays the multimedia sling command, the multimedia cast command, or multimedia data between the gesture-based multimedia casting and slinging command device and the targeted device. 
     
     
       8. The gesture-based multimedia casting and slinging command device of  claim 1 , wherein the targeted device is a cast or sling command-recipient device and wherein the targeted device incorporates a user gesture command receiver, a sling gesture command decoder, and a cast gesture command decoder to decipher, comply with, or deny the multimedia sling command or the multimedia cast command from the gesture-based multimedia casting and slinging command device. 
     
     
       9. The gesture-based multimedia casting and slinging command device of  claim 1 , wherein the targeted device and the gesture-based multimedia casting and slinging command device are configured to communicate data via at least one of a wireless local area network, a cellular network, a wide-area network, a satellite network, a wired network, or a peer-to-peer direct connection. 
     
     
       10. The gesture-based multimedia casting and slinging command device of  claim 1 , wherein the targeted device is selected among a plurality of available target devices by a direct line of sight to the targeted device indicated by the user's finger swipe-down gesture for the multimedia sling command or the user's finger swipe-up gesture for the multimedia cast command on the gesture-based multimedia casting and slinging command device. 
     
     
       11. The gesture-based multimedia casting and slinging command device of  claim 1 , wherein the localized playback at the gesture-based multimedia casting and slinging command device, or the remote playback at the targeted device involves a transfer of streaming and playing audio/video (AV), graphical, or photographic multimedia contents from one device location to another device location.