System for transmitting video streams using a plurality of levels of quality over a data network to a remote receiver

Abstract

A method of and apparatus for transmitting video images allows a viewer to receive at a receiving display device, all or a selected portion of a video stream of frames, in a storage-efficient format from a transmitting device and view the received video stream of frames before the transmission is complete. The video system also allows a viewer to receive at the receiving device, all or a selected portion of a video stream of frames, in a high-resolution format, by marking sections of interest within the received stream of frames in the storage-efficient format and requesting enhancement of those marked sections of interest. This apparatus preferably includes a source device, a transmitting device and at least one receiving device. Preferably, the transmitting device and the receiving device communicate over a network such as the Internet Protocol network. Alternatively, the transmitting device and the receiving device communicate over any appropriate data network. The transmitting device transmits the video images to the receiving device for display and storage at the receiving device. The receiving device is also capable of communicating with the transmitting device while simultaneously receiving video images. The source device is preferably a medical test device such as an ultrasound, a sonogram, an echocardiogram, and the like. Alternatively, the source device can be any video capture or storage device capable of sourcing a stream of video frames.

1 . (canceled)  
   
   
       2 . (canceled)  
   
   
       3 . (canceled)  
   
   
       4 . (canceled)  
   
   
       5 . (canceled)  
   
   
       6 . (canceled)  
   
   
       7 . (canceled)  
   
   
       8 . (canceled)  
   
   
       9 . (canceled)  
   
   
       10 . (canceled)  
   
   
       11 . (canceled)  
   
   
       12 . (canceled)  
   
   
       13 . (canceled)  
   
   
       14 . (canceled)  
   
   
       15 . (canceled)  
   
   
       16 . (canceled)  
   
   
       17 . (canceled)  
   
   
       18 . (canceled)  
   
   
       19 . (canceled)  
   
   
       20 . (canceled)  
   
   
       21 . (canceled)  
   
   
       22 . (canceled)  
   
   
       23 . (canceled)  
   
   
       24 . (canceled)  
   
   
       25 . (canceled)  
   
   
       26 . (canceled)  
   
   
       27 . (canceled)  
   
   
       28 . (canceled)  
   
   
       29 . (canceled)  
   
   
       30 . (canceled)  
   
   
       31 . (canceled)  
   
   
       32 . (canceled)  
   
   
       33 . (canceled)  
   
   
       34 . (canceled)  
   
   
       35 . (canceled)  
   
   
       36 . A method of transmitting a video stream over a data network from a first location to a second location in a first digitally compressed format and then retransmitting, based on one or more actions of a user at the second location, at least a section of the video stream in a higher quality second digitally compressed format, 
 wherein the video stream comprises a plurality of sections, including said section, and    wherein a transmitting device at the first location is configured to compress any of said video sections with one or more compression settings resulting in a plurality of levels of quality, including the first digitally compressed format and at least the higher quality digitally compressed format,    the method comprising the steps of:    a) generating the plurality of video sections at a video source device at the first location;    b) transferring the plurality of video sections from the video source device to the transmitting device in an original video format as a video stream;    c) saving the original video stream from the video source device on the transmitting device as a first saved video stream;    d) converting the original video stream from the original video format to the first digitally compressed format as each frame of the original video stream is received from the video source device at the transmitting device, 
 wherein the first digitally compressed format is a storage-efficient and transmission-efficient format having lower quality than the second digitally compressed format,  
 wherein the frames of the video stream in the first digitally compressed format contain significantly less information than the second digitally compressed format;  
   e) transmitting the video stream in the first digitally compressed format over the data network from the transmitting device to a receiving device at the second location;    f) saving the video stream in the first digitally compressed format on the receiving device at the second location as a second saved video stream;    g) decompressing the video stream in the first digitally compressed format at the receiving device;    h) displaying the decompressed video stream on a display device to the user at the second location as the video stream in the first digitally compressed format is being received at the second location;    i) marking a section of the displayed stream at the second location based on one or more actions of the user;    j) returning a request over the data network from the receiving device to the transmitting device for an enhanced version of the marked section of the video stream;    k) processing, at the transmitting device, the request for an enhanced version of the marked section of the video stream to select the requested section from the first saved video stream;    l) converting at least the requested section to the enhanced second digitally compressed format; 
 wherein the second digitally compressed format is a less storage-efficient and less transmission-efficient format having higher quality than the first digitally compressed format,  
 wherein the frames of the video stream in the second digitally compressed format contain significantly more information than the first digitally compressed format, and  
 wherein the frames of the video stream in the second digital compressed format contain substantially the same quality of information contained in the first saved stream of video images;  
   m) transmitting the requested section in the enhanced second digitally compressed format, corresponding to the requested section, over the data network from the transmitting device to the receiving device at the second location;    n) saving the requested section in the second digitally compressed format on the receiving device at the second location;    o) decompressing the requested section in the second digitally compressed format at the receiving device; and    p) displaying the decompressed requested section in a decompressed enhanced quality on the display device to the user at the second location while the video stream in the first digitally compressed format continues to be received at the second location;    wherein the first location is distinct and remote from the second location, whereby the user at the second location views a low quality version of the video stream while the frames of the video stream are being transmitted, the section of the displayed video is marked, the marked section is retransmitted and displayed in higher quality, and the user views the retransmitted section in higher quality while transmission of the low quality video stream continues.    
   
   
       37 . A method of transmitting a video stream over a data network from a first location to a second location in a first digitally compressed format and then retransmitting, based on one or more actions of a user at the second location, at least a section of the video stream in another digitally compressed format having higher quality, 
 wherein the video stream comprises a plurality of sections, including said section, and    wherein a transmitting device at the first location is configured to compress any of said video sections with one or more of compression settings resulting in a plurality of levels of quality, including the first digitally compressed format and at least the higher quality digitally compressed format,    the method comprising the steps of:    a) digitally obtaining the plurality of video sections in an original video format at the first location;    b) saving the digital video on the transmitting device as a first saved video stream;    c) converting the original video stream from the original video format to the first digitally compressed format at the transmitting device, 
 wherein the first digitally compressed format is a storage-efficient and transmission-efficient format having lower quality than the another digitally compressed format,  
 wherein the frames of the video stream in the first digitally compressed format contain significantly less information than the second digitally compressed format;  
   d) transmitting the video stream in the first digitally compressed format over the data network from the transmitting device to a receiving device at the second location;    e) saving the video stream in the first digitally compressed format on the receiving device at the second location as a second saved video stream;    f) decompressing the video stream in the first digitally compressed format at the receiving device;    g) displaying the decompressed video stream on a display device to the user at the second location as the video stream in the first digitally compressed format is being received at the second location;    h) forming a request for the section of the video stream displayed at the second location based on one or more actions of the user;    i) returning the request over the data network from the receiving device to the transmitting device for an enhanced version of the requested section of the video stream;    j) processing, at the transmitting device, the request for the enhanced version of the requested section of the video stream to select the requested section from the first saved video stream;    k) converting at least the requested section to the enhanced digitally compressed format; 
 wherein the enhanced digitally compressed format is a less storage-efficient and less transmission-efficient format having higher quality than the first digitally compressed format, and  
 wherein the frames of the video stream in the enhanced digitally compressed format contain significantly more information than the first digitally compressed format;  
   l) transmitting the requested section in the enhanced digitally compressed format, corresponding to the requested section, over the data network from the transmitting device to the receiving device at the second location;    m) saving the requested section in the enhanced digitally compressed format on the receiving device at the second location;    n) decompressing the requested section in the enhanced digitally compressed format at the receiving device; and    o) displaying the decompressed requested section in a decompressed enhanced quality on the display device to the user at the second location while the video stream in the first digitally compressed format continues to be received at the second location;    wherein the first location is distinct and remote from the second location, whereby the user at the second location views a low quality version of the video stream, namely, the version in the first digitally compressed format, while the frames of the video stream are being transmitted, the section of the displayed video is requested, the requested section is retransmitted and displayed in higher quality, and the user views the retransmitted section in higher quality while transmission of the video stream in the first digitally compressed format continues.    
   
   
       38 . The method of  claim 37  wherein the plurality of levels of quality include a third digitally compressed format having even higher quality than the said enhanced digitally compressed format, the method further comprising the steps of: 
 a) forming a second request for at least a portion of said section of the video stream displayed at the second location in the enhanced digitally compressed format;    b) returning the second request over the data network from the receiving device to the transmitting device for a further enhanced version of the second requested portion of the video stream;    c) processing, at the transmitting device, the second request to select the second requested portion from the first saved video stream;    d) converting at least the second requested portion to the third digitally compressed format; 
 wherein the third digitally compressed format is a less storage-efficient and less transmission-efficient format having higher quality than the enhanced digitally compressed format, and  
 wherein the frames of the video stream in the third digitally compressed format contain significantly more information than the enhanced digitally compressed format;  
   e) transmitting the second requested portion in the third digitally compressed format, corresponding to the second requested portion, over the data network from the transmitting device to the receiving device;    f) saving the second requested portion in the third digitally compressed format on the receiving device at the second location;    g) decompressing the second requested portion in the third digitally compressed format at the receiving device; and    h) displaying the decompressed second requested portion in a decompressed third quality on the display device to the user at the second location; 
 whereby the user at the second location first views a low quality version of the video stream, namely, the version in the first digitally compressed format, then, the user views the first retransmitted section in the enhanced digitally compressed format, and then the user views at least the portion of the enhanced section in the further enhanced third digitally compressed format.  
   
   
   
       39 . A method of transmitting a video stream over a data network from a first location to a second location in a first digitally compressed format and then retransmitting at least a section of the video stream in a higher quality second digitally compressed format, 
 wherein the video stream comprises a plurality of sections, including said section, and    wherein a transmitting device at the first location is configured to compress any of said video sections with compression settings resulting in a plurality of levels of quality, including the first digitally compressed format and at least the higher quality digitally compressed format,    the method comprising the steps of:    a) storing the plurality of video sections of the original video stream as a first saved video stream at the transmitting device at the first location;    b) converting the original video stream from the original video format to the first digitally compressed format, 
 wherein the first digitally compressed format is a storage-efficient and transmission-efficient format having lower quality than the second digitally compressed format,  
 wherein the frames of the video stream in the first digitally compressed format contain significantly less information than the second digitally compressed format;  
   c) transmitting the video stream in the first digitally compressed format over the data network from the transmitting device to a receiving device at the second location;    d) decompressing the video stream in the first digitally compressed format at the receiving device;    e) displaying the decompressed video stream on a display device to the user at the second location;    f) returning a request over the data network from the receiving device to the transmitting device for an enhanced version of the section of the video stream;    g) processing, at the transmitting device, the request for an enhanced version of the section of the video stream to select the requested section from the first saved video stream;    h) converting at least the requested section to the enhanced second digitally compressed format; 
 wherein the second digitally compressed format is a less storage-efficient and less transmission-efficient format having higher quality than the first digitally compressed format, and  
 wherein the frames of the video stream in the second digitally compressed format contain significantly more information than the first digitally compressed format;  
   i) transmitting the requested section in the enhanced second digitally compressed format, corresponding to the requested section, over the data network from the transmitting device to the receiving device at the second location;    j) decompressing the requested section in the second digitally compressed format at the receiving device; and    k) displaying the decompressed requested section in a decompressed enhanced quality on the display device to the user at the second location;    wherein the first location is distinct and remote from the second location, whereby the user at the second location views a low quality version of the video stream, the section is retransmitted and displayed in higher quality, and the user views the retransmitted section in higher quality.    
   
   
       40 . The method of  claim 39  wherein the frames of the video stream in the second digital compressed format contain substantially the same quality of information contained in the first saved stream of video images.  
   
   
       41 . The method of  claim 39  further comprising a step of saving the video stream in the first digitally compressed format on the receiving device at the second location as a second saved video stream.  
   
   
       42 . The method of  claim 39  further comprising a step of saving the requested section in the second digitally compressed format on the receiving device at the second location.  
   
   
       43 . The method of  claim 39  wherein the original video stream is generated by a video source device.  
   
   
       44 . The method of  claim 43  where in the video source device is a medical test device.  
   
   
       45 . A receiving device for receiving a video stream over a data network from a first location at a second location in a first digitally compressed format and then receiving at least a section of the video stream in a higher quality second digitally compressed format, 
 wherein the first location is distinct and remote from the second location,    wherein the receiving device is at the second location,    wherein the video stream comprises a plurality of sections, including said section, and    wherein the receiving device is configured to decompress any of said video sections with any of a plurality of levels of quality, including the first digitally compressed format and at least the higher quality digitally compressed format,    the receiving device comprising:    a) a network interface, connected to the data network, for receiving data from the data network and for sending a request for the section in the higher quality second digitally compressed format,    b) a received storage device, connected to the network interface, for at least temporarily storing the video sections;    c) a decompressor, connected to the received storage device, configured to decompress at least the first digitally compressed format and the higher quality second digitally compressed format, 
 wherein the first digitally compressed format is a storage-efficient and transmission-efficient format having lower quality than the second digitally compressed format,  
 wherein the frames of the video stream in the first digitally compressed format contain significantly less information than the second digitally compressed format,  
 wherein the second digitally compressed format is a less storage-efficient and less transmission-efficient format having higher quality than the first digitally compressed format, and  
 wherein the frames of the video stream in the second digitally compressed format contain significantly more information than the first digitally compressed format;  
   d) a display device, connected to the decompressor, for displaying the decompressed video stream to the user at the second location;    e) a central processing unit, connected to the network interface, the display device, and an input device;    f) the input device, connected to the central processing unit, for receiving input from a user;    wherein the central processing unit monitors inputs from the user and issues the request for the section in the higher quality second digitally compressed format based at least one input from the user, and    whereby the user at the second location views the video stream in the low quality format, the requested section is received, decompressed, and displayed by the receiving device in higher quality, and the user views the requested section in higher quality.    
   
   
       46 . The receiving device of  claim 45 , wherein the video stream received over the data network from a first location in the first digitally compressed format is saved in the received storage device.  
   
   
       47 . The receiving device of  claim 45 , wherein the section in the higher quality second digitally compressed format in saved in the received storage device.  
   
   
       48 . The receiving device of  claim 45 , wherein the video stream received over the data network from a first location in the first digitally compressed format is saved in the received storage device as a local movie, and 
 wherein at least one section in the higher quality second digitally compressed format replaces the corresponding section of the video stream in the first digitally compressed format.    
   
   
       49 . A system, comprising at least one receiving device according to  claim 45 , for transmitting the video stream over the data network from the first location to the second location in the first digitally compressed format and then retransmitting at least the section of the video stream in the higher quality second digitally compressed format, the system comprising: 
 a) the at least one receiving device, communicating over the data network,    b) a transmitting device at the first location, communicating over the data network, said transmitting device comprising: 
 i) a storage device configured for storing the original video stream; and  
 ii) a controller coupled to the storage device and configured for coupling to the receiving device for controlling transmission of the video stream from the storage device to the receiving device, wherein the video stream is transmitted to the receiving device in the first digitally compressed format and then the requested section is transmitted to the receiving device in the second digitally compressed format.  
   
   
   
       50 . A system, comprising at least one receiving device according to  claim 45 , for transmitting the video stream over the data network from the first location to the second location in the first digitally compressed format and then retransmitting at least the section of the video stream in the higher quality second digitally compressed format, the system comprising: 
 a) the at least one receiving device, communicating over the data network,    b) a server at the first location, communicating over the data network, said server comprising: 
 i) a storage device configured for storing the video stream; and  
 ii) a controller coupled to the storage device and configured for coupling to the receiving device for controlling transmission of the video stream from the storage device to the receiving device, wherein the video stream is transmitted to the receiving device in the first digitally compressed format and then the requested section is transmitted to the receiving device in the second digitally compressed format.  
   
   
   
       51 . The system of  claim 49  wherein the transmitting device is configured to compress the original video stream in the first digitally compressed format, and wherein, upon receipt of the request for the section of interest, the transmitting device is configured to compress the requested section in the second digitally compressed format.  
   
   
       52 . The receiving device of  claim 45  further comprising a section determining means for determining the section to be requested.  
   
   
       53 . The receiving device of  claim 52  further comprising a fast-forward and rewind function, 
 wherein the section determining means determines if the user views a particular section within the video stream for a predetermined period of time and automatically requests the particular section in the second format.    
   
   
       54 . The method of  claim 39  wherein the step of returning a request for an enhanced version of the section of the video stream is based on the user actions, 
 wherein the user explicitly requests the section.    
   
   
       55 . The method of  claim 39  wherein the step of returning a request for an enhanced version of the section of the video stream is based on the user actions, 
 wherein the request is implied by the actions of the user,    whereby the user implicitly requests the portion to be retransmitted.