US2022157347A1PendingUtilityA1
Generation of audio-synchronized visual content
Est. expirySep 3, 2040(~14.1 yrs left)· nominal 20-yr term from priority
H04N 23/55H04N 23/51G11B 27/031H04R 2499/11G11B 27/34G11B 27/3009H04N 9/806H04N 9/87G11B 27/32G11B 27/10H04R 1/02H04R 1/028H04N 5/2252
54
PatentIndex Score
0
Cited by
0
References
0
Claims
Abstract
An image capture device may provide playback of audio content during capture of visual content. Moments within the audio content may be associated with cue markers. The visual content may be synchronized with the audio content provided during capture, and a video edit may be automatically generated based on the moments associated with the cue markers.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1 . An image capture device for generating audio-synchronized visual content, the image capture device comprising:
a housing; an image sensor carried by the housing and configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content; an optical element carried by the housing and configured to guide light within a field of view to the image sensor; a speaker carried by the housing and configured to provide playback of audio content for capture of the visual content, the audio content having an audio progress length, the audio content including music; one or more physical processors configured by machine-readable instructions to:
determine speed of audio content playback through the speaker during a capture duration based on speed of visual content capture by the image capture device for the capture duration;
effectuate the playback of at least a portion of the audio progress length of the audio content at the determined speed of the audio content playback through the speaker during the capture duration, wherein at least a first duration of the music is played through the speaker during the capture duration;
capture the visual content during the capture duration at the speed of the visual content capture with the playback of the at least the portion of the audio progress length of audio content through the speaker, the visual content having a visual progress length based on the capture duration, wherein the image capture device internally tracks timing of the audio content playback during the capture duration, wherein the internally tracked timing of the audio content playback is matched to timing of when the visual content is captured by the image capture device;
synchronize the visual content captured during the capture duration with the at least the portion of the progress length of the audio content based on the matching of the internally tracked timing of the audio content playback to the timing of when the visual content is captured by the image capture device; and
generate a video file including the visual content, wherein the first duration of the music that is played through the speaker during the capture duration is copied from an original music file for the music to the video file.
2 . The image capture device of claim 1 , wherein the audio content further includes verbal direction to direct one or more users of the image capture device to perform an action during the capture duration.
3 . The image capture device of claim 1 , wherein the speed of the audio content playback through the speaker during the capture duration is determined to be inverse of the speed of the visual content capture by the image capture device for the capture duration.
4 . The image capture device of claim 3 , wherein the speed of the audio content playback through the speaker during the capture duration being determined to be inverse of the speed of the visual content capture by the image capture device for the capture duration includes:
the speed of the audio content playback through the speaker during the capture duration being decreased based on time-lapse capture of the visual content; and the speed of the audio content playback through the speaker during the capture duration being increased based on slow-motion capture of the visual content.
5 . The image capture device of claim 1 , wherein:
moments within the audio progress length are associated with cue markers; one or more moments within the visual progress length of the visual content are associated with one or more of the cue markers of the audio content; and a video edit is generated based on the cue markers, at least a portion of the visual content captured during the capture duration included within the video edit based on the association of the one or more moments within the visual progress length of the visual content with the one or more of the cue markers of the audio content.
6 . The image capture device of claim 5 , wherein the moments within the audio progress length associated with the cue markers include bars or beats of the music.
7 . The image capture device of claim 6 , wherein the video edit is generated to include one or more bar-synced effects or one or more beat-synced effects based on the association of the moments within the audio progress lengths with the bars or the beats of the music.
8 . The image capture device of claim 5 , wherein:
the video edit is generated to include portions from multiple visual content captured during separate capture durations, individual ones of the multiple visual content synchronized with a corresponding portion of the audio content; and transitions within the video edit between different ones of the portions from the multiple visual content are determined based on the association of the moments within corresponding visual progress length of the multiple visual content with the cue markers of the audio content.
9 . The image capture device of claim 1 , wherein:
the playback of the audio content pauses at an end of the capture duration; and the playback of the audio content continues at a beginning of another capture duration.
10 . A method for generating audio-synchronized visual content, the method performed by an image capture device including one or more processors, an image sensor, an optical element, and a speaker, the image sensor configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content, the optical element configured to guide light within a field of view to the image sensor, the speaker configured to provide playback of audio content for capture of the visual content, the audio content having an audio progress length, the audio content including music, the method comprising:
determining speed of audio content playback through the speaker during a capture duration based on speed of visual content capture by the image capture device for the capture duration; effectuating the playback of at least a portion of the audio progress length of the audio content at the determined speed of the audio content playback through the speaker during the capture duration, wherein at least a first duration of the music is played through the speaker during the capture duration; capturing the visual content during the capture duration at the speed of the visual content capture with the playback of the at least the portion of the audio progress length of audio content through the speaker, the visual content having a visual progress length based on the capture duration, wherein the image capture device internally tracks timing of the audio content playback during the capture duration, wherein the internally tracked timing of the audio content playback is matched to timing of when the visual content is captured by the image capture device; synchronizing the visual content captured during the capture duration with the at least the portion of the progress length of the audio content based on the matching of the internally tracked timing of the audio content playback to the timing of when the visual content is captured by the image capture device; and generating a video file including the visual content, wherein the first duration of the music that is played through the speaker during the capture duration is copied from an original music file for the music to the video file.
11 . The method of claim 10 , wherein the audio content further includes verbal direction to direct one or more users of the image capture device to perform an action during the capture duration.
12 . The method of claim 10 , wherein the speed of the audio content playback through the speaker during the capture duration is determined to be inverse of the speed of the visual content capture by the image capture device for the capture duration.
13 . The method of claim 12 , wherein the speed of the audio content playback through the speaker during the capture duration being determined to be inverse of the speed of the visual content capture by the image capture device for the capture duration includes:
the speed of the audio content playback through the speaker during the capture duration being decreased based on time-lapse capture of the visual content; and the speed of the audio content playback through the speaker during the capture duration being increased based on slow-motion capture of the visual content.
14 . The method of claim 10 , wherein:
moments within the audio progress length are associated with cue markers; one or more moments within the visual progress length of the visual content are associated with one or more of the cue markers of the audio content; and a video edit is generated based on the cue markers, at least a portion of the visual content captured during the capture duration included within the video edit based on the association of the one or more moments within the visual progress length of the visual content with the one or more of the cue markers of the audio content.
15 . The method of claim 14 , wherein the moments within the audio progress length associated with the cue markers include bars or beats of the music.
16 . The method of claim 15 , wherein the video edit is generated to include one or more bar-synced effects or one or more beat-synced effects based on the association of the moments within the audio progress lengths with the bars or the beats of the music.
17 . The method of claim 14 , wherein:
the video edit is generated to include portions from multiple visual content captured during separate capture durations, individual ones of the multiple visual content synchronized with a corresponding portion of the audio content; and transitions within the video edit between different ones of the portions from the multiple visual content are determined based on the association of the moments within corresponding visual progress length of the multiple visual content with the cue markers of the audio content.
18 . The method of claim 10 , wherein:
the playback of the audio content pauses at an end of the capture duration; and the playback of the audio content continues at a beginning of another capture duration.
19 . An image capture device for generating audio-synchronized visual content, the image capture device comprising:
a housing; an image sensor carried by the housing and configured to generate a visual output signal conveying visual information based on light that becomes incident thereon, the visual information defining visual content; an optical element carried by the housing and configured to guide light within a field of view to the image sensor; a speaker carried by the housing and configured to provide playback of audio content for capture of the visual content, the audio content having an audio progress length, the audio content including music; one or more physical processors configured by machine-readable instructions to:
determine speed of audio content playback through the speaker during a capture duration to be inverse of speed of visual content capture by the image capture device for the capture duration, wherein the speed of the audio content playback through the speaker during the capture duration is decreased based on time-lapse capture of the visual content and the speed of the audio content playback through the speaker during the capture duration is increased based on slow-motion capture of the visual content;
effectuate the playback of at least a portion of the audio progress length of the audio content at the determined speed of the audio content playback through the speaker during the capture duration, wherein at least a first duration of the music is played through the speaker during the capture duration;
capture the visual content during the capture duration at the speed of the visual content capture with the playback of the at least the portion of the audio progress length of audio content through the speaker, the visual content having a visual progress length based on the capture duration, wherein the image capture device internally tracks timing of the audio content playback during the capture duration, wherein the internally tracked timing of the audio content playback is matched to timing of when the visual content is captured by the image capture device;
synchronize the visual content captured during the capture duration with the at least the portion of the progress length of the audio content based on the matching of the internally tracked timing of the audio content playback to the timing of when the visual content is captured by the image capture device; and
generate a video file including the visual content, wherein the first duration of the music that is played through the speaker during the capture duration is copied from an original music file for the music to the video file.
20 . The image capture device of claim 19 , wherein:
moments within the audio progress length are associated with cue markers; one or more moments within the visual progress length of the visual content are associated with one or more of the cue markers of the audio content; a video edit is generated based on the cue markers, at least a portion of the visual content captured during the capture duration included within the video edit based on the association of the one or more moments within the visual progress length of the visual content with the one or more of the cue markers of the audio content; the video edit is generated to include portions from multiple visual content captured during separate capture durations, individual ones of the multiple visual content synchronized with a corresponding portion of the audio content; and transitions within the video edit between different ones of the portions from the multiple visual content are determined based on the association of the moments within corresponding visual progress length of the multiple visual content with the cue markers of the audio content.Join the waitlist — get patent alerts
Track US2022157347A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.