Methods, systems, and media for certifying a playback device

Abstract

Methods, systems, and media for certifying a playback device are provided. In some embodiments, methods for certifying a playback device are provided, the methods comprising: identifying a plurality of playback capabilities associated with the playback device; identifying at least one certification test based on the plurality of playback capabilities; receiving a plurality of media streams corresponding to the certification test from a server; causing a first media stream to be presented by the playback device; changing a streaming condition experienced by the playback device; causing a second media stream to be presented by the playback device based on the streaming condition; capturing, using a camera, a video signal representing video content presented by the playback device; and determining, using a hardware processor, whether the playback device has passed the certification test based at least in part on the video signal.

What is claimed is: 
     
       1. A method for certifying capabilities of a playback device using a certification device, the method comprising:
 displaying a test image on a display coupled to a playback device; 
 capturing the test image displayed on the display coupled to the playback device using a camera coupled to a certification device; 
 processing the test image using the certification device to identify a plurality of capabilities associated with the playback device; 
 identifying a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:
 an interactivitya playback capabilities certification test, 
 a shared secret certification test, 
 a security protocol certification test, and 
 a video and audio synchronization test; 
 
 directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device; 
 capturing information produced by the playback device according to the series of operations using the certification device; and 
 determining, using a hardware processor, whether the playback device has passed the certification tests according to captured information using the certification device. 
 
     
     
       2. The method of  claim 1 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:
 receiving a plurality of media streams corresponding to a certification test from a server; 
 causing a first media stream to be presented by the playback device; 
 changing a streaming condition experienced by the playback device; 
 causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution. 
 
     
     
       3. The method of  claim 2 , wherein the first resolution is greater than the second resolution. 
     
     
       4. The method of  claim 3 , further comprising:
 determining whether a re-buffering event has occurred based at least in part on the video signal; and 
 determining that the playback device has failed the certification test in response to determining that a re-buffering event has occurred. 
 
     
     
       5. The method of  claim 1 , further comprising performing bandwidth throttling. 
     
     
       6. The method of  claim 1 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:
 receiving a first test stream of interactivity content from a server on the playback device; 
 playing back the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application; 
 receiving interactivity input to the first test stream of interactivity content on the playback device; 
 capturing a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and 
 verifying that the screenshot matches expected interactivity playback capabilities according to the interactivity playback capabilities certification test using the certification device. 
 
     
     
       7. The method of  claim 1 , wherein directing the playback device to perform a series of operations according to the video and audio synchronization test comprises directing the playback device to perform the following operations:
 receiving a first test stream of media content corresponding to the particular certification test from a server using the playback device; 
 playing back the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device; 
 capturing, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback; 
 capturing, using a microphone coupled to the certification device, an audio signal from the first test stream during playback; 
 determining a presentation time of a video frame of the video signal using the certification device; 
 determining a presentation time of an audio frame of the audio signal using the certification device; and 
 when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determining that the playback device has failed the video and audio synchronization test using the certification device. 
 
     
     
       8. The method of  claim 1  wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television. 
     
     
       9. The method of  claim 1 , further comprising transmitting a result of a certification test to the server. 
     
     
       10. The method of  claim 1 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:
 directing the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and 
 verifying, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device. 
 
     
     
       11. The method of  claim 1 , wherein directing the playback device to perform a series of operations according to the security protocol certification test further comprises directing the playback device to perform the following operations:
 transmitting an invalid certificate associated with a server to the playback device; and 
 verifying that the playback device successfully rejects the invalid certificate using the certification device. 
 
     
     
       12. A system for certifying capabilities of a playback device, the system comprising:
 a playback device; 
 a certification device; and 
 at least one hardware processor that is configured to:
 display a test image on a display coupled to the playback device; 
 capture the test image displayed on the display coupled to the playback device using a camera coupled to the certification device; 
 processing the test image using the certification device to identify a plurality of capabilities associated with the playback device; 
 identify a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:
 an interactivitya playback capabilities certification test, 
 a shared secret certification test, 
 a security protocol certification test, and 
 a video and audio synchronization test; 
 
 direct the playback device to perform a series of operations according to the interactivity playback capabilities certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device; 
 capture information produced by the playback device according to the series of operations using the certification device; and 
 determine whether the playback device has passed the certification tests according to captured information using the certification device. 
 
 
     
     
       13. The system of  claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:
 receive a plurality of media streams corresponding to a certification test from a server; 
 cause a first media stream to be presented by the playback device; 
 change a streaming condition experienced by the playback device; 
 
       causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution. 
     
     
       14. The system of  claim 13 , wherein the first resolution is greater than the second resolution. 
     
     
       15. The system of  claim 14 , wherein the hardware processor is further configured to:
 determine whether a re-buffering event has occurred based at least in part on the video signal; and 
 determine that the playback device has failed the certification test in response to determining that a re-buffering event has occurred. 
 
     
     
       16. The system of  claim 12 , wherein the hardware processor is further configured to perform bandwidth throttling,. 
     
     
       17. The system of  claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:
 receive a first test stream of interactivity content from a server on the playback device; 
 playback the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application; 
 receive interactivity input to the first test stream of interactivity content on the playback device; 
 capture a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and 
 verify that the screenshot matches expected interactivity capabilities according to the interactivity playback capabilities certification test using the certification device. 
 
     
     
       18. The system of  claim 12 , wherein screenshot matches expected interactivity capabilities according to the interactivity certification test using the certification device directing the playback device to perform a series of operations according to the playback capabilities certification test further comprises directing the playback device to perform the following operations:
 receive a first test stream of media content corresponding to the particular certification test from a server using the playback device; 
 playback the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device; 
 capture, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback; 
 capture, using a microphone coupled to the certification device, an audio signal from the first test stream during playback; 
 determine a presentation time of a video frame of the video signal using the certification device; 
 determine a presentation time of an audio frame of the audio signal using the certification device; and 
 when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determine that the playback device has failed the video and audio synchronization test using the certification device. 
 
     
     
       19. The system of  claim 12 , wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television. 
     
     
       20. The system of  claim 12 , wherein the hardware processor is further configured to transmit a result of a certification test to the server. 
     
     
       21. The system of  claim 12 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:
 direct the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and 
 verify, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device. 
 
     
     
       22. The system of  claim 12 , wherein directing the playback device to perform a series of operations according to the interactivity security protocol certification test further comprises directing the playback device to perform the following operations:
 transmit an invalid certificate associated with a server to the playback device; and  
 verify that the playback device successfully rejects the invalid certificate using the certification device. 
 
     
     
       23. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processing circuitry, cause the processing circuitry to perform a method for certifying capabilities of a playback device, the method comprising:
 displaying a test image on a display coupled to a playback device; 
 capturing the test image displayed on the display coupled to the playback device using a camera coupled to a certification device; 
 processing the test image using the certification device to identify a plurality of capabilities associated with the playback device; 
 identifying a particular set of certification tests based on the plurality of capabilities associated with the playback device using the certification device, wherein the particular set of certification tests comprises:
 an interactivitya playback capabilities certification test, 
 a shared secret certification test, 
 a security protocol certification test, and 
 a video and audio synchronization test; 
 
 directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test, the shared secret certification test, the security protocol certification test, and the video and audio synchronization test using the playback device; 
 capturing information produced by the playback device according to the series of operations using the certification device; and 
 determining whether the playback device has passed the certification tests according to captured information using the certification device. 
 
     
     
       24. The non-transitory computer-readable medium of  claim 23 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:
 receiving a plurality of media streams corresponding to a certification test from a server; 
 causing a first media stream to be presented by the playback device; 
 changing a streaming condition experienced by the playback device; 
 
       causing a second media stream to be presented by the playback device based on the streaming condition, wherein the first media stream comprises a first plurality of video frames encoded at a first resolution and wherein the second media stream comprises a second plurality of video frames encoded at a second resolution. 
     
     
       25. The non-transitory computer-readable medium of  claim 24 , wherein the first resolution is greater than the second resolution. 
     
     
       26. The Eon-transitory computer-readable medium of  claim 25 , wherein the method further comprises:
 determining whether a re-buffering event has occurred based at least in part on the video signal; and 
 determining that the playback device has failed the certification test in response to determining that a re-buffering event has occurred. 
 
     
     
       27. The non-transitory computer-readable medium of  claim 23 , wherein the method further comprises performing bandwidth throttling. 
     
     
       28. The non-transitory computer-readable medium of  claim 23 , wherein directing the playback device to perform a series of operations according to the interactivity playback capabilities certification test further comprises directing the playback device to perform the following operations:
 receiving a first test stream of interactivity content from a server on the playback device; 
 playing back the first test stream of interactivity content using the playback device, wherein a video component of the first test stream is displayed on the display device in an active window application; 
 receiving interactivity input to the first test stream of interactivity content on the playback device; 
 capturing a screenshot of the active window application presented on the display device using a camera coupled to the certification device; and 
 verifying that the screenshot matches expected interactivity capabilities according to the interactivity playback capabilities certification test using the certification device. 
 
     
     
       29. The non-transitory computer-readable medium of  claim 23 , wherein directing the playback device to perform a series of operations according to the video and audio synchronization test comprises directing the playback device to perform the following operations:
 receiving a first test stream of media content corresponding to the particular certification test from a server using the playback device; 
 playing back the first test stream of media content using the playback device, wherein a video component of the first test stream is displayed on the display device; 
 capturing, using a camera coupled to the certification device, a video signal from the display of the first test stream during playback; 
 capturing, using a microphone coupled to the certification device, an audio signal from the first test stream during playback; 
 determining a presentation time of a video frame of the video signal using the certification device; 
 determining a presentation time of an audio frame of the audio signal using the certification device; and 
 when the presentation time of the video frame and the presentation time of the audio frame differ beyond a predetermined threshold, determining that the playback device has failed the video and audio synchronization test using the certification device. 
 
     
     
       30. The non-transitory computer-readable medium of  claim 23 , wherein the test image is a barcode identifying the playback device, the certification device is a mobile device, and the playback device is a television. 
     
     
       31. The non-transitory computer-readable medium of  claim 23 , wherein the method further comprises transmitting a result of a certification test to the server. 
     
     
       32. The non-transitory computer-readable medium of  claim 23 , wherein directing the playback device to perform a series of operations according to the shared secret certification test further comprises directing the playback device to perform the following operations:
 directing the playback device to generate a secure cipher key according to a key-generation protocol using the certification device; and 
 verifying, using the certification device, that the playback device successfully applied the secure cipher key to a test communication between the certification device and the playback device. 
 
     
     
       33. The non-transitory computer-readable medium of  claim 23 , wherein directing the playback device to perform a series of operations according to the security protocol certification test further comprises directing the playback device to perform the following operations:
 transmitting an invalid certificate associated with a server to the playback device; and 
 verifying that the playback device successfully rejects the invalid certificate.