Technologies for audiovisual communication using interestingness algorithms
Abstract
Technologies for audiovisual communication include an audiovisual server and a number of audiovisual client devices, including a presenter device and a number of audience devices. Each audience device captures an audiovisual stream and transmits the audiovisual stream to the audiovisual server. Each audience device also captures sensor input data such as eye tracking data or facial expression data and transmits abstracted sensor input data to the audiovisual server. The abstracted sensor input data may be based on the captured audiovisual stream. The audiovisual server determines an interestingness rating associated with each audience device based on the sensor input data, and selects one or more audiovisual streams based on the interestingness ratings. The audiovisual server transmits the selected audiovisual streams to the presenter device. The audiovisual server may update the interestingness rating algorithm based on feedback from the presenter device or the audience devices. Other embodiments are described and claimed.
Claims
exact text as granted — not AI-modifiedThe invention claimed is:
1. At least one memory comprising computer readable instructions to cause one or more processors to at least:
determine a ranking of audiovisual streams associated with a video conference application, the audiovisual streams from respective ones of a plurality of client devices, the ranking based on detected facial expressions associated with the respective ones of the audiovisual streams;
select a first one of the audiovisual streams from a first one of the plurality of client devices based on the ranking;
cause the first one of the audiovisual streams from the first one of the plurality of client devices to be transmitted to a presenter device;
obtain feedback from the presenter device associated with selection of the first one of the audiovisual streams based on the ranking;
update the ranking based on updated facial expressions associated with the respective ones of the audiovisual streams; and
cause a second one of the audiovisual streams to be transmitted to the presenter device after the update of the ranking, the second one of the audiovisual streams different from the first one of the audiovisual streams.
2. The at least one memory of claim 1 , wherein the instructions are to cause the one or more processors to command one or more of the client devices to adjust the respective audiovisual streams from the one or more of the client devices.
3. The at least one memory of claim 1 , wherein the feedback is based on a sensor of the presenter device.
4. The at least one memory of claim 1 , wherein the ranking is based on eye tracking data associated with the respective ones of the client devices.
5. The at least one memory of claim 1 , wherein the ranking is based on audio information from the client devices.
6. The at least one memory of claim 1 , wherein the instructions are to cause the one or more processors to command a first one of the client devices to adjust a sensor of the first one of the client devices.
7. A system comprising:
at least one memory;
machine readable instructions; and
one or more processors to execute the machine readable instructions to at least:
determine a ranking of audiovisual streams associated with a video conference application, the audiovisual streams from respective ones of a plurality of client devices, the ranking based on detected facial expressions associated with the respective ones of the audiovisual streams;
select a first one of the audiovisual streams from a first one of the plurality of client devices based on the ranking;
cause the first one of the audiovisual streams from the first one of the plurality of client devices to be transmitted to a presenter device;
obtain feedback from the presenter device associated with selection of the first one of the audiovisual streams based on the ranking;
update the ranking based on updated facial expressions associated with the respective ones of the audiovisual streams; and
cause a second one of the audiovisual streams to be transmitted to the presenter device after the update of the ranking, the second one of the audiovisual streams different from the first one of the audiovisual streams.
8. The system of claim 7 , wherein the one or more processors are to command one or more of the client devices to adjust the respective audiovisual streams from the one or more of the client devices.
9. The system of claim 7 , wherein the feedback is based on a sensor of the presenter device.
10. The system of claim 7 , wherein the ranking is based on eye tracking data associated with the respective ones of the client devices.
11. The system of claim 7 , wherein the ranking is based on audio information from the client devices.
12. The system of claim 7 , wherein the one or more processors are to command a first one of the client devices to adjust a sensor of the first one of the client devices.
13. A method comprising:
determining, by executing an instruction with at least one processor, a ranking of audiovisual streams associated with a video conference application, the audiovisual streams from respective ones of a plurality of client devices, the ranking based on detected facial expressions associated with the respective ones of the audiovisual streams;
selecting, by executing an instruction with the at least one processor, a first one of the audiovisual streams from a first one of the plurality of client devices based on the ranking;
causing the first one of the audiovisual streams from the first one of the plurality of client devices to be transmitted to a presenter device;
obtaining feedback from the presenter device associated with selection of the first one of the audiovisual streams based on the ranking;
updating, by executing an instruction with the at least one processor, the ranking based on updated facial expressions associated with the respective ones of the audiovisual streams; and
causing a second one of the audiovisual streams to be transmitted to the presenter device after the update of the ranking, the second one of the audiovisual streams different from the first one of the audiovisual streams.
14. The method of claim 13 , further including commanding one or more of the client devices to adjust the respective audiovisual streams from the one or more of the client devices.
15. The method of claim 13 , wherein the feedback is based on a sensor of the presenter device.
16. The method of claim 13 , wherein the ranking is based on eye tracking data associated with the respective ones of the client devices.
17. The method of claim 13 , wherein the ranking is based on audio information from the client devices.
18. The method of claim 13 , further including commanding a first one of the client devices to adjust a sensor of the first one of the client devices.Cited by (0)
No later patents cite this yet.
References (0)
No backward citations on record.