Apparatus and method for packet-based media communications

Abstract

The performance of a voice conference using a packet-based conference bridge can be improved with a number of modifications. In one modification, the conference bridge receives speech indication signals from the individual packet-based terminals within the voice conference, these speech indication signals then being used by the conference bridge to select the talkers within the voice conference. This removes the need for speech detection techniques within the conference bridge, hence decreasing the required processing power and the latency within the conference bridge. In another modification, the conference bridge sends addressing control signals to the individual packet-based terminals selected as talkers, these addressing control signals directing the terminals selected as talkers to directly transmit their voice data packets to the other terminals within the voice conference. This direct transmission of voice data packets can reduce transcoding and latency within the network. These two modifications could further be combined, resulting in a conference bridge that receives speech indication signals, selects the talkers for the voice conference and outputs addressing control signal to the talkers. In this case, the advantages of the two modifications are gained as well as additional capacity advantages resulting from no voice signals actually traversing the conference bridge.

1 . A method of selecting at least one media packet stream for use in a conference, the method comprising:
 receiving packets comprising speech indication data characterizing a plurality of media packet streams at a media packet stream selection entity; and   selecting at least one media packet stream for use in the conference based on the speech indication data.   
     
     
         2 . The method of  claim 1 , wherein selecting at least one media packet stream comprises selecting at least one media packet stream based on speech indication data comprises selecting at least one media packet stream based on speech indication data characterizing the selected media packet stream 
     
     
         3 . The method of  claim 2 , wherein selecting at least one media packet stream comprises selecting at least one media packet stream based on speech indication data indicating that the selected media packet stream comprises speech data. 
     
     
         4 . The method of  claim 1 , wherein selecting at least one media packet stream comprises selecting a plurality of media packet streams based on the speech indication data. 
     
     
         5 . The method of  claim 1 , wherein:
 receiving packets comprising speech indication data comprises receiving packet data streams comprising media data and speech indication data characterizing the media data; and   selecting at least one media packet stream comprises forwarding at least one selected media packet stream based on speech indication data characterizing the selected media packet stream at the media packet stream selection entity.   
     
     
         6 . The method of  claim 5 , wherein selecting at least one media packet stream comprises selecting a plurality of media packet streams based on speech indication data characterizing the selected media packet streams by forwarding the plurality of selected media packet streams at the media packet stream selection entity. 
     
     
         7 . The method of  claim 6 , wherein forwarding the plurality of selected media packet streams comprises:
 mixing the plurality of selected media packet streams to provide a mixed media packet data stream; and   forwarding the mixed packet data stream.   
     
     
         8 . The method of  claim 1 , wherein selecting at least one media packet stream comprises:
 selecting at least one packet-based apparatus based on the speech indication data characterizing a media packet stream available at the packet-based apparatus; and   sending control information to the at least one selected packet-based apparatus   
     
     
         9 . The method of  claim 1 , further comprising:
 receiving the control information at the at least one selected packet-based apparatus; sand   forwarding at least one media packet stream available at the selected packet-based apparatus in response to the received control information.   
     
     
         10 . The method of  claim 4 , wherein selecting a plurality of media packet streams comprises:
 selecting a plurality of packet-based apparatuses based on speech indication data characterizing the media packet streams available at the packet-based apparatuses; and   sending respective control information to each selected packet-based apparatus.   
     
     
         11 . The method of  claim 10 , further comprising:
 receiving the respective control information at each selected packet-based apparatus; and   forwarding at least one respective media packet stream available at each selected packet-based apparatus in response to the received control information.   
     
     
         12 . The method of  claim 1 , wherein selecting at least one media packet stream comprises:
 selecting at least one packet-based apparatus based on speech indication data characterizing a media packet stream available at the packet-based apparatus; and   sending address information to the selected packet-based apparatus.   
     
     
         13 . The method of  claim 12 , further comprising:
 receiving the address information at the at least one selected packet-based apparatus; and   forwarding at least one media packet stream available at the selected packet-based apparatus to at least one packet-based apparatus in response to the received address information, the at least one packet-based apparatus being determined by the address information.   
     
     
         14 . The method of  claim 13 , wherein forwarding the media packet stream comprises forwarding the media packet stream to plural selected packet-based apparatuses in response to the received address information, the plural packet-based apparatuses being determined by the address information. 
     
     
         15 . The method of  claim 4 , wherein selecting a plurality of media packet streams comprises:
 selecting a plurality of packet-based apparatuses based on speech indication data characterizing the media packet streams available at the packet-based apparatuses and   sending respective address information to each selected packet-based apparatus.   
     
     
         16 . The method of  claim 15 , further comprising
 receiving the respective address information at each selected packet-based apparatus; and   forwarding the respective media packet stream available at each selected packet-based apparatus to at least one packet-based apparatus in response to the received address information, the at least one packet-based apparatus being determined by the address information.   
     
     
         17 . The method of  claim 16 , wherein forwarding the media packet stream comprises forwarding the media packet stream to plural selected packet-based apparatuses in response to the received address information, the plural packet-based apparatuses being determined by the address information. 
     
     
         18 . The method of  claim 1 , further comprising sending the packets comprising speech indication data characterizing a plurality of media packet streams from at least one packet-based apparatus to the media packet stream selection entity. 
     
     
         19 . The method of  claim 1 , further comprising sending the packets comprising speech indication data characterizing a plurality of media packet streams from a plurality of packet-based apparatuses to the media packet stream selection entity. 
     
     
         20 . The method of  claim 1 , wherein sending the packets comprising speech indication data comprises sending packet data streams comprising media data and speech indication data from the at least one packet-based apparatus to the media packet stream selection entity. 
     
     
         21 . The method of  claim 1 , wherein sending the packets comprising speech indication data comprises sending packet data streams comprising media data and speech indication data from the plurality of packet-based apparatuses to the media packet stream selection entity. 
     
     
         22 . The method of  claim 21 , wherein selecting at least one media packet stream comprises forwarding at the media packet stream selection entity at least one selected media packet stream based on speech indication data, the forwarding being to packet-based apparatuses other than a packet-based apparatus from which the at least one selected media packet stream was sent to the media packet stream selection entity. 
     
     
         23 . The method of  claim 1 , wherein selecting at least one media packet stream comprises selecting a media packet stream comprising video data packets. 
     
     
         24 . The method of  claim 23 , wherein the video data packets comprise audio information. 
     
     
         25 . A system for selecting at least one media packet stream for use in a conference, the system comprising:
 an speech indication data input operable to receive packets comprising speech indication data characterizing a plurality of media packet streams; and   a media packet stream selector operable to select at least one media packet stream for use in the conference based on the speech indication data.   
     
     
         26 . The system of  claim 25 , wherein the media packet stream selector is operable to select at least one media packet stream by selecting at least one media packet stream based on speech indication data characterizing the selected media packet stream. 
     
     
         27 . The system of  claim 26 , wherein the media stream selector is operable to select at least one packet stream by selecting at least one media packet stream based on speech indication data indicating that the selected media packet stream comprises speech data. 
     
     
         28 . The system of  claim 24 , wherein the media packet stream selector is operable to select at least one media packet stream by selecting a plurality of media packet streams based on speech indication data characterizing the selected media packet streams. 
     
     
         29 . The system of  claim 25 , wherein:
 the speech indication data input is operable to receive packets comprising speech indication data by receiving packet data streams comprising media data and speech indication data; and   the media packet stream selector is operable to select at least one media packet stream by forwarding at least one selected media packet stream based on speech indication data.   
     
     
         30 . The system of  claim 29 , wherein the media packet stream selector is operable to select at least one media packet stream by selecting a plurality of media packet streams based on speech indication data by forwarding the plurality of selected media packet streams at the media packet stream selection entity. 
     
     
         31 . The system of  claim 30 , wherein the media packet stream selector is operable to forward the plurality of selected media packet streams by:
 mixing the plurality of selected media packet streams to provide a mixed media packet data stream; and   forwarding the mixed packet data stream.   
     
     
         32 . The system of  claim 25 , wherein the media packet stream selector is operable to select at least one media packet stream by:
 selecting at least one packet-based apparatus based on speech indication data characterizing a media packet stream available at the packet-based apparatus; and   sending control information to the at least one selected packet-based apparatus.   
     
     
         33 . The system of  claim 32 , further comprising at least one packet-based apparatus, the packet-based apparatus comprising:
 an input operable to receive the control information; and   an output operable to forward at least one media packet stream available at the selected packet-based apparatus in response to the received control information.   
     
     
         34 . The system of  claim 28 , wherein the media packet stream selector is operable to select a plurality of media packet streams by:
 selecting a plurality of packet-based apparatuses based on speech indication data characterizing the media packet streams available at the packet-based apparatuses; and   sending respective control information to each selected packet-based apparatus.   
     
     
         35 . The system of  claim 34 , further comprising a plurality of packet-based apparatuses, each packet based apparatus comprising:
 an input operable to receive the control information; and   an output operable to forward at least one media packet stream available at the packet-based apparatus in response to the received permission indication.   
     
     
         36 . The system of  claim 26 , wherein the media packet stream selector is operable to select at least one media packet stream by:
 selecting at least one packet-based apparatus based on speech indication data characterizing a media packet stream available at the packet-based apparatus; and   sending address information to the selected packet-based apparatus.   
     
     
         37 . The system of  claim 36 , further comprising at least one packet-based apparatus, the packet-based apparatus comprising:
 an input operable to receive the address information at the packet-based apparatus; and   an output operable to forward the media packet stream available at the packet-based apparatus in response to the received address information.   
     
     
         38 . The system of  claim 37 , wherein the output is operable to forward the media packet stream by forwarding at least one media packet stream to plural selected packet-based apparatuses in response to the received address information, the plural packet-based apparatuses being determined by the address information. 
     
     
         39 . The system of  claim 38 , wherein the media packet stream selector is operable to select a plurality of media packet streams by:
 selecting a plurality of packet-based apparatuses based on speech indication data characterizing media packet streams available at the packet-based apparatuses and   sending respective address information to each selected packet-based apparatus.   
     
     
         40 . The system of  claim 39 , further comprising a plurality of packet-based apparatuses, each packet based apparatus comprising:
 an input operable to receive the address information; and   an output operable to forward at least one media packet stream available at the packet-based apparatus in response to the received address information.   
     
     
         41 . The system of  claim 40 , wherein each output is operable to forward the at least one media packet stream by forwarding the at least one media packet stream to plural selected packet-based apparatuses in response to the received address information, the plural packet-based apparatuses being determined by the address information. 
     
     
         42 . The system of  claim 25 , further comprising at least one packet-based apparatus operable to send the packets comprising speech indication data characterizing at least one media packet stream to the media packet stream selection entity. 
     
     
         43 . The system of  claim 25 , further comprising a plurality of packet-based apparatuses, each packet-based apparatus operable to send packets comprising speech indication data characterizing at least one media packet stream to the media packet stream selection entity. 
     
     
         44 . The system of  claim 42 , wherein the at least one packet-based apparatus is operable to send the packets comprising speech indication data by sending at least one packet data streams comprising media data and speech indication data to the media packet stream selection entity. 
     
     
         45 . The system of  claim 43 , wherein the plurality of packet-based apparatuses is operable to send the packets comprising speech indication data by sending packet data streams comprising media data and speech indication data to the media packet stream selection entity. 
     
     
         46 . The system of  claim 45 , wherein the media packet stream selector is operable to select at least one media packet stream by forwarding at least one selected media packet stream based on speech indication data characterizing the selected media packet stream, the forwarding being to packet-based apparatuses other than a packet-based apparatus from which the at least one selected media packet stream was sent to the media packet stream selector. 
     
     
         47 . The system of  claim 25 , wherein the media packet stream selector is operable to select at least one media packet stream by selecting a media packet stream comprising video data packets. 
     
     
         48 . The system of  claim 47 , wherein the video data packets comprise audio information. 
     
     
         49 . A packet-based apparatus arranged to be coupled to a conference bridge via a packet-based network, the packet-based apparatus comprising:
 a media signal input operable to receive at least one media signal from at least one participant in a media conference;   a media packet stream output operable to output at least one media packet stream based on the received media signal to the packet-based network;   at least one media signal processor operable to generate at least one speech indication based on the received media signal; and   an output operable to output the speech indication to the packet-based network.   
     
     
         50 . A packet-based apparatus according to  claim 49 , wherein the media signal processor is operable to generate the speech indication by determining whether the received media signal contains speech. 
     
     
         51 . A packet-based apparatus according to  claim 49 , wherein the media signal processor is operable to determine whether the media signal contains speech by measuring an energy level of the media signal. 
     
     
         52 . A packet-based apparatus according to  claim 51 , wherein the media signal processor is operable to determine whether the media signal contains speech by comparing the measured energy to a predetermined energy threshold. 
     
     
         53 . A packet-based apparatus according to  claim 52 , wherein the media signal processor is operable to determine whether the media signal contains speech by measuring the energy level over a predetermined time interval. 
     
     
         54 . A packet-based apparatus according to  claim 52 , wherein the media signal processor is operable to generate a speech indication comprising a talking indication when the received media signal is determined to contain speech. 
     
     
         55 . A packet-based apparatus according to  claim 50 , wherein the media signal processor is operable to generate a speech indication that characterizes a parameter of the media signal. 
     
     
         56 . A packet-based apparatus according to  claim 51 , wherein the media signal processor is operable to determine whether the received media signal contains speech by comparing the measured energy level to a set of predetermined energy thresholds. 
     
     
         57 . A packet-based apparatus according to  claim 56 , wherein the media signal processor is operable to generate a speech indication which comprises a value representative of a threshold below which the measured energy level lies. 
     
     
         58 . A packet-based apparatus according to  claim 50 , wherein the media signal processor is operable to determine whether the received media signal contains speech by measuring a pitch of the media signal. 
     
     
         59 . A packet-based apparatus according to  claim 58 , wherein the media signal processor is operable to generate a speech indication comprising a value characterizing the measured pitch. 
     
     
         60 . A packet-based apparatus according to  claim 59 , wherein:
 the media signal processor is operable to determine whether the received media signal contains speech by comparing the measured pitch to a predetermined pitch threshold; and   wherein the speech indication comprises a talking indication if the received media signal is determined to contain speech.   
     
     
         61 . A packet-based apparatus according to  claim 50 , wherein the media signal processor is further operable:
 to compress the received media signal into a media packet stream; and   to couple the media packet stream to the output for output on the packet-based network.   
     
     
         62 . A packet-based apparatus according to  claim 61 , wherein the media signal processor is operable to determine if the received media signal contains speech by determining if the number of bytes of the media packet stream indicates that the received media signal contains speech. 
     
     
         63 . A packet-based apparatus according to  claim 61 , wherein the media signal processor is operable to determine if the received media signal contains speech, by evaluating a set of bits of the media packet stream. 
     
     
         64 . A packet-based apparatus according to  claim 61 , wherein the media signal processor is operable to determine if the received media signal contains speech, by evaluating at least one bit of the media packet stream. 
     
     
         65 . A packet-based apparatus according to  claim 64 , wherein the media signal processor is operable to evaluate at least one bit corresponding to pitch information of the media packet stream. 
     
     
         66 . A packet-based apparatus according to  claim 49 , further comprising a microphone operable to receive audio signals from the at least one participant within the media conference to generate the media signal, the microphone being coupled to the media signal input. 
     
     
         67 . A packet-based network interface arranged to be coupled between a packet-based network and a non-packet-based network, the network interface comprising a packet-based apparatus according to  claim 49 , wherein the media signal input is operable to receive the media signal from the at least one participant in the media conference from a non-packet-based terminal via the non-packet-based network. 
     
     
         68 . A packet-based apparatus according to  claim 49 , wherein the media signal processor is operable to couple the media packet stream to a conference bridge via the output. 
     
     
         69 . A packet-based apparatus according to  claim 49 , further comprising an address information input operable to receive address information from the conference bridge, the output being coupled to the address information input and being operable to output a media packet stream, via the packet-based network, to at least one other participant in the media conference based upon the address information. 
     
     
         70 . A packet-based apparatus according to  claim 69 , wherein the output is operable to output a media packet stream based on at least one packet-based network address in the address information. 
     
     
         71 . A method of operating a packet-based apparatus coupled to a conference bridge via a packet-based network, the method comprising:
 receiving at least one media signal from at least one participant in a media conference;   outputting at least one media packet stream based on the received media signal to the packet-based network;   generating at least one speech indication based on the received media signal; and   outputting the speech indication to the packet-based network.   
     
     
         72 . A method according to  claim 71 , wherein generating at least one speech indication comprises generating the speech indication by determining whether the received media signal contains speech. 
     
     
         73 . A method according to  claim 72 , wherein generating at least one speech indication comprises measuring an energy level of the media signal. 
     
     
         74 . A method according to  claim 73 , wherein generating at least one speech indication comprises comparing the measured energy to a predetermined energy threshold. 
     
     
         75 . A method according to  claim 74 , wherein generating at least one speech indication comprises measuring the energy level over a predetermined time interval. 
     
     
         76 . A method according to  claim 75 , wherein generating at least one speech indication comprises generating a speech indication comprising a talking indication when the received media signal is determined to contain speech. 
     
     
         77 . A method according to  claim 72 , wherein generating at least one speech indication comprises generating a speech indication that characterizes a parameter of the media signal. 
     
     
         78 . A method according to  claim 73 , wherein determining whether the received media signal contains speech comprises comparing the measured energy level to a set of predetermined energy thresholds. 
     
     
         79 . A method according to  claim 78 , wherein generating at least one speech indication comprises generating a speech indication which comprises a value representative of a threshold below which the measured energy level lies. 
     
     
         80 . A method according to  claim 72 , wherein generating at least one speech indication comprises determining whether the received media signal contains speech by measuring a pitch of the media signal. 
     
     
         81 . A method according to  claim 78 , wherein generating at least one speech indication comprises generating a speech indication comprising a value characterizing the pitch the measured pitch. 
     
     
         82 . A method according to  claim 80 , wherein:
 determining whether the received media signal contains speech comprises comparing the measured pitch to a predetermined pitch threshold; and   wherein the speech indication comprises a talking indication if the received media signal is determined to contain speech.   
     
     
         83 . A method according to  claim 72 , further comprising:
 compressing the received media signal into a media packet stream; and   coupling the media packet stream to the output for output on the packet-based network.   
     
     
         84 . A method according to  claim 83 , wherein determining if the received media signal contains speech comprises determining if the number of bytes of the media packet stream indicates that the received media signal contains speech. 
     
     
         85 . A method according to  claim 83 , wherein determining if the received media signal contains speech comprises evaluating a set of bits of the media packet stream. 
     
     
         86 . A method according to  claim 83 , wherein determining if the received media signal contains speech comprise evaluating at least one bit of the media packet stream. 
     
     
         87 . A method according to  claim 86 , comprising evaluating at least one bit corresponding to pitch information of the media packet stream. 
     
     
         88 . A method according to  claim 71 , further comprising receiving audio signals from the at least one participant within the media conference via a microphone, the microphone being coupled to the media signal input. 
     
     
         89 . A method according to  claim 71 , wherein:
 the packet-based apparatus comprises a packet-based network interface coupled between a packet-based network and a non-packet-based network; and   receiving at least one media signal by receiving the media signal from the at least one participant in the media conference from a non-packet-based terminal via the non-packet-based network.   
     
     
         90 . A method according to  claim 71 , further comprising coupling the packet media stream to a conference bridge. 
     
     
         91 . A method according to  claim 71 , further comprising:
 receiving address information from the conference bridge; and   outputting a media packet stream, via the packet-based network, to at least one other participant in the media conference based upon the address information.   
     
     
         92 . A method according to  claim 89 , comprising outputting a media packet stream based on at least one packet-based network address in the address information. 
     
     
         93 . In a packet data network having a plurality of media signals entering the packet data network at respective ingress points, a method of selecting at least one media packet stream for use in a conference, the method comprising:
 monitoring a characteristic of the media signals at the ingress points before packetizing the media signals to provide the media packet streams; and   selecting the at least one media packet stream based on the monitoring.   
     
     
         94 . The method of  claim 93 , wherein monitoring a characteristic comprises monitoring speech activity of the media signals at the ingress points. 
     
     
         95 . The method of  claim 93 , further comprising:
 communicating results of the monitoring to a media packet stream selector connected to the packet data network; and   selecting the at least one media packet stream at the media packet stream selector.   
     
     
         96 . The method of  claim 93 , further comprising:
 packetizing the media signals at the ingress points to provide the media packet streams; and   transmitting the media packet streams to the media packet stream selector.   
     
     
         97 . The method of  claim 96 , further comprising:
 forwarding selected media packet streams from the media packet stream selector to egress points of the packet data network.   
     
     
         98 . The method of  claim 93 , further comprising:
 communicating results of the media packet stream selection to the ingress points; and   forwarding selected media packet streams at the ingress points to egress points of the packet data network in accordance with the results of the media packet stream selection.   
     
     
         99 . A packet data network comprising:
 a plurality of ingress points, a respective media signal entering the packet data network at each ingress point and each ingress point being operable to monitor a characteristic of its respective media signal before packetizing the media signal to provide a respective media packet stream;   a plurality of egress points corresponding to the ingress points;   a media packet stream selector operable to select, based on the monitoring, at least one media packet stream for forwarding to the egress points.   
     
     
         100 . The network of  claim 99 , wherein each ingress point is operable to monitor speech activity in its respective media signal before packetizing the media signal. 
     
     
         101 . The network of  claim 99 , wherein:
 the ingress points are operable to communicate the media packet streams and results of the monitoring to the media packet stream selector; and   media packet stream selector is operable to forward the at least one selected media packet stream to the egress points.   
     
     
         102 . The network of  claim 99 , wherein:
 the media packet stream selector is operable to communicate results of the media packet stream selection to the ingress points; and   the ingress points are operable to forward the at least one selected media packet stream to egress points of the packet data network in accordance with the results of the media packet stream selection.   
     
     
         103 . The network of  claim 99 , wherein:
 the media packet stream selector is operable to communicate results of the media packet stream selection by sending address information to the ingress points; and   the ingress points are operable to address respective media packet streams based on the address information to selected egress points of the packet data network.   
     
     
         104 . A conference bridge comprising:
 means for receiving media data packets from at least two sources forming a media conference, each media data packet comprising a media signal and packet overhead, wherein the means for receiving media data packets is adapted to remove the packet overhead;   means for receiving speech indication signals from at least one of the sources within the media conference;   means for processing the speech indication signals including selecting a set of the sources within the media conference as talkers; and   means for outputting the media signals that correspond to the set of sources within the media conference selected as talkers.