US11635938B2ActiveUtilityA1
Spatial management of audio
Est. expirySep 26, 2038(~12.2 yrs left)· nominal 20-yr term from priority
G06F 3/041G06F 3/167G06F 3/165H04S 7/302G06F 3/04883G06F 3/0481G06F 3/0486H04S 1/007G06F 3/162H04S 2420/01
76
PatentIndex Score
0
Cited by
113
References
27
Claims
Abstract
The present disclosure generally relates to user interfaces for managing spatial audio. Some exemplary techniques include user interfaces for transitioning between visual elements. Some exemplary techniques include user interfaces for previewing audio. Some exemplary techniques include user interfaces for discovering music. Some exemplary techniques include user interfaces for managing headphone transparency. Some exemplary techniques include user interfaces for manipulating multiple audio streams of an audio source.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1. An electronic device, comprising:
a display;
a touch-sensitive surface;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, wherein the electronic device is operably connected with two or more speakers, the one or more programs including instructions for:
displaying, on the display, a list of a plurality of media elements, wherein each media element of the plurality of media elements corresponds to a respective media file;
detecting, using the touch-sensitive surface, a user contact at a location corresponding to a first media element;
in response to detecting the user contact at the location corresponding to the first media element and in accordance with the user contact including a touch-and-hold input:
producing, using the two or more speakers, audio using a first audio file that corresponds to the first media element without exceeding a predetermined audio playback duration;
while the user contact remains at the location corresponding to the first media element:
in accordance with the predetermined audio playback duration period not being exceeded, continuing to produce, using the two or more speakers, audio using the first audio file; and
in accordance with the predetermined audio playback duration period being exceeded, ceasing to produce, using the two or more speakers, audio using the first audio file;
detecting, using the touch-sensitive surface, movement of the user contact from the location that corresponds to the first media element to a location that corresponds to a second media element;
in response to detecting the user contact at the location corresponding to the second media element and in accordance with the user contact including a touch-and-hold input:
producing, using the two or more speakers, audio using a second audio file that corresponds to the second media element without exceeding the predetermined audio playback duration;
while the user contact remains at the location corresponding to the second media element:
in accordance with the predetermined audio playback duration period not being exceeded, continuing to produce, using the two or more speakers, audio using the second audio file; and
in accordance with the predetermined audio playback duration period being exceeded, ceasing to produce, using the two or more speakers, audio using the second audio file;
detecting, using the touch-sensitive surface, a lift-off of the user contact; and in response to detecting the lift-off of the user contact:
ceasing to produce, using the two or more speakers, audio using the first audio file or the second audio file.
2. The electronic device of claim 1 , wherein the one or more programs further include instructions for:
further in accordance with the user contact including a touch-and-hold input:
producing audio using the first audio file without exceeding a predetermined audio playback duration includes transitioning the audio among a plurality of modes, including:
a first mode, wherein the first mode is configured such that audio produced using the first mode is perceived by the user as being produced from a first direction;
a second mode that is different from the first mode; and
a third mode that is different from the first mode and the second mode, wherein the third mode is configured such that audio produced using the third mode is perceived by the user as being produced from a third direction different from the first direction.
3. The electronic device of claim 2 , wherein the first mode includes a first modification of an interaural time difference of audio and the third mode includes a second modification of an interaural time difference of audio, different from the first modification.
4. The electronic device of claim 3 , wherein modification of the interaural time difference of audio includes:
combining a first channel audio of the audio and a second channel audio of the audio to form a combined channel audio;
updating the second channel audio to include the combined channel audio at a first delay; and
updating the first channel audio to include the combined channel audio at a second delay different from the first delay.
5. The electronic device of claim 1 , wherein the second mode does not include a modification of an interaural time difference of audio.
6. The electronic device of claim 1 , wherein the one or more programs further include instructions for:
in response to detecting the user contact at the location corresponding to the first media element:
changing a first visual characteristic of the displayed media elements in the plurality of media elements other than the first media element; and
in response to detecting the user contact at the location corresponding to the second media element:
reverting the change of the first visual characteristic of the second media element; and
changing the first visual characteristic of the first media element.
7. The electronic device of claim 1 , wherein the one or more programs further include instructions for:
in response to detecting the user contact at the location corresponding to the first media element:
changing a second visual characteristic of the first media element without changing the second visual characteristic of the displayed media elements in the plurality of media elements other than the first media element; and
in response to detecting the user contact at the location corresponding to the second media element:
reverting the change of the second visual characteristic of the first media element; and
changing the second visual characteristic of the second media element.
8. The electronic device of claim 1 , wherein the one or more programs further include instructions for:
in response to detecting the user contact at the location corresponding to the first media element and in accordance with the user contact including a tap input:
producing audio using the first audio file that corresponds to the first media element without automatically ceasing to produce audio using the first audio after the predetermined audio playback duration and without automatically ceasing to produce audio using the first audio file upon detecting lift-off of the user contact.
9. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display and a touch-sensitive surface, wherein the electronic device is operably connected with two or more speakers, the one or more programs including instructions for:
displaying, on the display, a list of a plurality of media elements, wherein each media element of the plurality of media elements corresponds to a respective media file;
detecting, using the touch-sensitive surface, a user contact at a location corresponding to a first media element;
in response to detecting the user contact at the location corresponding to the first media element and in accordance with the user contact including a touch-and-hold input:
producing, using the two or more speakers, audio using a first audio file that corresponds to the first media element without exceeding a predetermined audio playback duration;
while the user contact remains at the location corresponding to the first media element:
in accordance with the predetermined audio playback duration period not being exceeded, continuing to produce, using the two or more speakers, audio using the first audio file; and
in accordance with the predetermined audio playback duration period being exceeded, ceasing to produce, using the two or more speakers, audio using the first audio file;
detecting, using the touch-sensitive surface, movement of the user contact from the location that corresponds to the first media element to a location that corresponds to a second media element;
in response to detecting the user contact at the location corresponding to the second media element and in accordance with the user contact including a touch-and-hold input:
producing, using the two or more speakers, audio using a second audio file that corresponds to the second media element without exceeding the predetermined audio playback duration;
while the user contact remains at the location corresponding to the second media element:
in accordance with the predetermined audio playback duration period not being exceeded, continuing to produce, using the two or more speakers, audio using the second audio file; and
in accordance with the predetermined audio playback duration period being exceeded, ceasing to produce, using the two or more speakers, audio using the second audio file;
detecting, using the touch-sensitive surface, a lift-off of the user contact; and
in response to detecting the lift-off of the user contact:
ceasing to produce, using the two or more speakers, audio using the first audio file or the second audio file.
10. The non-transitory computer-readable storage medium of claim 9 , wherein the one or more programs further include instructions for:
further in accordance with the user contact including a touch-and-hold input:
producing audio using the first audio file without exceeding a predetermined audio playback duration includes transitioning the audio among a plurality of modes, including:
a first mode, wherein the first mode is configured such that audio produced using the first mode is perceived by the user as being produced from a first direction;
a second mode that is different from the first mode; and
a third mode that is different from the first mode and the second mode, wherein the third mode is configured such that audio produced using the third mode is perceived by the user as being produced from a third direction different from the first direction.
11. The non-transitory computer-readable storage medium of claim 10 , wherein the first mode includes a first modification of an interaural time difference of audio and the third mode includes a second modification of an interaural time difference of audio, different from the first modification.
12. The non-transitory computer-readable storage medium of claim 11 , wherein modification of the interaural time difference of audio includes:
combining a first channel audio of the audio and a second channel audio of the audio to form a combined channel audio;
updating the second channel audio to include the combined channel audio at a first delay; and
updating the first channel audio to include the combined channel audio at a second delay different from the first delay.
13. The non-transitory computer-readable storage medium of claim 9 , wherein the second mode does not include a modification of an interaural time difference of audio.
14. The non-transitory computer-readable storage medium of claim 9 , wherein the one or more programs further include instructions for:
in response to detecting the user contact at the location corresponding to the first media element:
changing a first visual characteristic of the displayed media elements in the plurality of media elements other than the first media element; and
in response to detecting the user contact at the location corresponding to the second media element:
reverting the change of the first visual characteristic of the second media element; and
changing the first visual characteristic of the first media element.
15. The non-transitory computer-readable storage medium of claim 9 , wherein the one or more programs further include instructions for:
in response to detecting the user contact at the location corresponding to the first media element:
changing a second visual characteristic of the first media element without changing the second visual characteristic of the displayed media elements in the plurality of media elements other than the first media element; and
in response to detecting the user contact at the location corresponding to the second media element:
reverting the change of the second visual characteristic of the first media element; and
changing the second visual characteristic of the second media element.
16. The non-transitory computer-readable storage medium of claim 9 , wherein the one or more programs further include instructions for:
in response to detecting the user contact at the location corresponding to the first media element and in accordance with the user contact including a tap input:
producing audio using the first audio file that corresponds to the first media element without automatically ceasing to produce audio using the first audio after the predetermined audio playback duration and without automatically ceasing to produce audio using the first audio file upon detecting lift-off of the user contact.
17. A method, comprising:
at an electronic device with a display and a touch-sensitive surface, wherein the electronic device is operably connected with two or more speakers:
displaying, on the display, a list of a plurality of media elements, wherein each media element of the plurality of media elements corresponds to a respective media file;
detecting, using the touch-sensitive surface, a user contact at a location corresponding to a first media element;
in response to detecting the user contact at the location corresponding to the first media element and in accordance with the user contact including a touch-and-hold input:
producing, using the two or more speakers, audio using a first audio file that corresponds to the first media element without exceeding a predetermined audio playback duration;
while the user contact remains at the location corresponding to the first media element:
in accordance with the predetermined audio playback duration period not being exceeded, continuing to produce, using the two or more speakers, audio using the first audio file; and
in accordance with the predetermined audio playback duration period being exceeded, ceasing to produce, using the two or more speakers, audio using the first audio file;
detecting, using the touch-sensitive surface, movement of the user contact from the location that corresponds to the first media element to a location that corresponds to a second media element;
in response to detecting the user contact at the location corresponding to the second media element and in accordance with the user contact including a touch-and-hold input:
producing, using the two or more speakers, audio using a second audio file that corresponds to the second media element without exceeding the predetermined audio playback duration;
while the user contact remains at the location corresponding to the second media element:
in accordance with the predetermined audio playback duration period not being exceeded, continuing to produce, using the two or more speakers, audio using the second audio file; and
in accordance with the predetermined audio playback duration period being exceeded, ceasing to produce, using the two or more speakers, audio using the second audio file;
detecting, using the touch-sensitive surface, a lift-off of the user contact; and
in response to detecting the lift-off of the user contact:
ceasing to produce, using the two or more speakers, audio using the first audio file or the second audio file.
18. The method of claim 17 , further comprising:
further in accordance with the user contact including a touch-and-hold input:
producing audio using the first audio file without exceeding a predetermined audio playback duration includes transitioning the audio among a plurality of modes, including:
a first mode, wherein the first mode is configured such that audio produced using the first mode is perceived by the user as being produced from a first direction;
a second mode that is different from the first mode; and
a third mode that is different from the first mode and the second mode, wherein the third mode is configured such that audio produced using the third mode is perceived by the user as being produced from a third direction different from the first direction.
19. The method of claim 18 , wherein the first mode includes a first modification of an interaural time difference of audio and the third mode includes a second modification of an interaural time difference of audio, different from the first modification.
20. The method of claim 19 , wherein modification of the interaural time difference of audio includes:
combining a first channel audio of the audio and a second channel audio of the audio to form a combined channel audio;
updating the second channel audio to include the combined channel audio at a first delay; and
updating the first channel audio to include the combined channel audio at a second delay different from the first delay.
21. The method of claim 17 , wherein the second mode does not include a modification of an interaural time difference of audio.
22. The method of claim 17 , further comprising:
in response to detecting the user contact at the location corresponding to the first media element:
changing a first visual characteristic of the displayed media elements in the plurality of media elements other than the first media element; and
in response to detecting the user contact at the location corresponding to the second media element:
reverting the change of the first visual characteristic of the second media element; and
changing the first visual characteristic of the first media element.
23. The method of claim 17 , further comprising:
in response to detecting the user contact at the location corresponding to the first media element:
changing a second visual characteristic of the first media element without changing the second visual characteristic of the displayed media elements in the plurality of media elements other than the first media element; and
in response to detecting the user contact at the location corresponding to the second media element:
reverting the change of the second visual characteristic of the first media element; and
changing the second visual characteristic of the second media element.
24. The method of claim 17 , further comprising:
in response to detecting the user contact at the location corresponding to the first media element and in accordance with the user contact including a tap input:
producing audio using the first audio file that corresponds to the first media element without automatically ceasing to produce audio using the first audio after the predetermined audio playback duration and without automatically ceasing to produce audio using the first audio file upon detecting lift-off of the user contact.
25. The electronic device of claim 2 , wherein the one or more programs further include instructions for:
in accordance with the user contact including a tap input:
producing audio using the first audio file includes producing audio usin the first audio file in the second mode withiout transitioning the audio among the first mode and the third mode of the plurality of modes.
26. The non-transitory computer-readable storage medium of claim 10 , wherein the one or more programs further include instructions for:
in accordance with the user contact including a tap input:
Producing audio using the first audio file includes producing audio using the first audio file in the second mode without transitioning the audio among the first mode and the third mode of the plurality of modes.
27. The electronic device of claim 18 , further comprising:
in accordance with the user contact including a tap input:
producing audio using the first audio file includes producing audio using the first audio file in the second mode without transitioning the audio among the first mode and the third mode of the plurality of modes.Cited by (0)
No later patents cite this yet.
References (0)
No backward citations on record.