Computationally customizing instructional content
Abstract
A computing system causes instructional media to be played on a device to a user. An instructor in the instructional media provides guidance as to how to perform an activity when the instructional media is played on the device. The computing system obtains user data pertaining to performance of the activity by the user. The computing system generates a user-customized portion of the instructional media based upon the user data and a computer-implemented model. The computing system causes the user-customized portion to be played on the device to the user, where the device emits audible words reproduced in a voice of the instructor, where the audible words are based upon the user data, and further where the device displays generated images of the instructor depicting the instructor speaking the audible words as the device emits the audible words.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1 . A computing system, comprising:
a processor; and memory storing instructions that, when executed by the processor, cause the processor to perform acts comprising:
streaming instructional media to a client device for presentation at the client device, where the instructional media includes video of a human instructor setting forth audible instructions with respect to an activity being performed by a user of the client device;
as the instructional media is being streamed to the client device, obtaining user data that pertains to performance of the activity by the user;
generating user-customized media based upon the user data, where the user-customized media includes at least one of:
computer-generated video data that includes an image of the instructor; or
computer-generated audio data that includes a voice of the instructor; and
streaming the user-customized media as part of the instructional media to the client device for presentation at the client device.
2 . The computing system of claim 1 , where the instructional media includes a first portion and a second portion, where the first portion is streamed to the client device prior to the user-customized media being streamed to the client device, and further where the second portion is streamed to the client device after the user-customized media is streamed to the client device.
3 . The computing system of claim 1 , where the user-customized media includes the computer-generated video data and the computer-generated audio data.
4 . The computing system of claim 1 , where the user-customized media is generated as the instructional media is being streamed to the client device.
5 . The computing system of claim 1 , where the computer-generated video data is generated by a computer-implemented model that is trained based upon video data of the human instructor.
6 . The computing system of claim 1 , where the computer-generated audio data is generated by a computer-implemented model that is trained based upon audio data that captures the voice of the human instructor.
7 . The computing system of claim 1 , where streaming the instructional media to the client device comprises livestreaming the instructional media to the client device.
8 . The computing system of claim 1 , where the client device is a piece of exercise equipment being employed by the user to perform the activity.
9 . The computing system of claim 8 , where the user data comprises data output by a sensor of the exercise equipment.
10 . The computing system of claim 1 , where the user-customized media comprises the computer-generated audio data, and further where the computer-generated audio data comprises a name of the user.
11 . The computing system of claim 1 , where the user data comprises heart rate of the user.
12 . A method performed by a computing system, the method comprising:
streaming instructional media simultaneously to several client devices, where the instructional media includes video of a human instructor setting forth audible instructions with respect to an activity being performed by users of the several client devices; as the instructional media is being streamed to the several client devices, obtaining user data from a client device from amongst the several client devices, where the user data pertains to performance of the activity by a user of the client device; generating customized media for the user based upon the obtained user data, where the customized media for the user comprises computer-generated audiovisual data of the instructor, where the computer-generated audiovisual data pertains to the activity being performed by the user; and streaming the customized media for the user to the client device for presentment to the user as part of the instructional media being streamed to the client device while refraining from streaming the customized media to at least one other client device in the several client devices.
13 . The method of claim 12 , where the audiovisual data of the instruction comprises computer-generated images of the instructor and computer-generated audio in a voice of the instructor.
14 . The method of claim 13 , where the computer-generated images of the instructor are generated by a computer-implemented model that has been trained based upon video of the instructor.
15 . The method of claim 12 , further comprising:
as the instructional media is being streamed to the several client devices, obtaining second user data from a second client device from amongst the several client devices, where the second user data pertains to performance of the activity by a second user of the second client device; generating second customized media for the second user based upon the obtained second user data, where the second customized media for the second user comprises second computer-generated audiovisual data of the instructor, where the second computer-generated audiovisual data pertains to the activity being performed by the second user; and streaming the second customized media for the second user to the second client device for presentment to the second user as part of the instructional media being streamed to the second client device while refraining from streaming the second customized media to the at least one other client device in the several client devices.
16 . The method of claim 15 , where the customized media for the user and the second customized media for the second user are streamed to the first client device and the second client device, respectively, simultaneously.
17 . The method of claim 12 , where the instructional media comprises a first portion and a second portion, where the first portion is streamed to the client device prior to the user-customized media being streamed to the client device, and further where the second portion is streamed to the client device after the user-customized media is streamed to the client device.
18 . The method of claim 12 , where streaming the instructional media to the several client devices comprises livestreaming the instructional media to the several client devices.
19 . The method of claim 12 , where the client devices are pieces of exercise equipment.
20 . A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to perform acts comprising:
streaming instructional media to a client device for presentation at the client device, where the instructional media includes video of a human instructor setting forth audible instructions with respect to an activity being performed by a user of the client device; as the instructional media is being streamed to the client device, obtaining user data that pertains to performance of the activity by the user; generating user-customized media based upon the user data, where the user-customized media includes at least one of:
computer-generated video data that includes an image of the instructor; or
computer-generated audio data that includes a voice of the instructor; and
streaming the user-customized media as part of the instructional media to the client device for presentation at the client device.Cited by (0)
No later patents cite this yet.
References (0)
No backward citations on record.