System and method for providing content to a user based on a predicted route identified from audio or images
Abstract
Embodiments are directed towards providing a system that presents content to a user of a vehicle based on where the vehicle is going. A microphone captures audio signals within the vehicle, which are analyzed for route information. These audible commands may be said by a person in the vehicle, such as a passenger telling the driver where to turn, or they may be received from a mobile computing device, such as a smartphone executing a map application that is providing audible directions. An anticipated route of the vehicle is determined based on the audible route information. Content is selected and presented to the user of the vehicle based on the anticipated route. Images of a display screen of the mobile computing device may also be analyzed to identify the route information.
Claims
exact text as granted — not AI-modified1 . A method, comprising:
receiving, by a head unit of a vehicle, audible route information captured via a microphone coupled to the vehicle, wherein the audible route information includes at least one direction instructing a driver of the vehicle to turn the vehicle onto a named road, and wherein the audible route information is emanating from a source positioned within the vehicle; determining, by the head unit, an estimated route of the vehicle based on the audible route information; selecting, by the head unit, visual content to display to a user of the vehicle based on the estimated route of the vehicle; and displaying, by the head unit, the visual content to the user.
2 . The method of claim 1 , wherein receiving audible route information includes:
capturing, via the microphone, the audible route information from a voice of a person within the vehicle.
3 . The method of claim 1 , wherein receiving the audible route information includes:
receiving audio signals from an electronic speaker of an electronic device providing audible driving directions to the driver of the vehicle.
4 . The method of claim 1 , wherein receiving audible route information includes:
capturing, via the microphone, the audible route information being output from an electronic speaker coupled to the vehicle.
5 . The method of claim 1 , wherein receiving the audible route information includes;
capturing, via the microphone, spoken words that include a direction of travel and street information.
6 . The method of claim 1 , wherein receiving the audible route information includes;
capturing, via the microphone, spoken words that include an instruction to change direction of travel of the vehicle.
7 . The method of claim 1 , wherein receiving the audible route information includes;
capturing, via a microphone within the vehicle, spoken words that include an instruction for the vehicle to leave a current roadway.
8 . The method of claim 1 , further comprising:
receiving, by the head unit, audio data via the microphone; analyzing, by the head unit, the received audio data to identify one or more spoken words; comparing, by the head unit, the one or more identified spoken words with a plurality of known commands; and in response to a match between the one or more identified spoken words and a known command, identifying, by the head unit, the audible route information as the known command.
9 . The method of claim 1 , wherein determining the estimated route of the vehicle further comprises:
receiving, by the head unit, an image of a display screen of a mobile computing device of a person in the vehicle; analyzing, by the head unit, the received image to identify route information on the display screen of the mobile computing device; determining, by the head unit, visual route information commands from the route information; and updating, by the head unit, the estimated route based on the visual route information.
10 . The method of claim 1 , wherein determining the estimated route of the vehicle further comprises:
determining, via a GPS unit, a current location of the vehicle; and determining, by the head unit, the estimated route of the vehicle based on the current location of the vehicle and the audible route information.
11 . The method of claim 1 , wherein selecting the visual content further comprises:
identifying, by the head unit, a current route of the vehicle; selecting, by the head unit, a previous route from a plurality of previous routes that includes a first segment that matches the current route and a second segment that matches the estimated route; and selecting, by the head unit, the content based on the selected previous route without input or interaction from the user.
12 . A system, comprising:
a memory configured to store data and computer instructions; a display interface coupled to the memory, the display interface configured to present visual content to a user of a vehicle; a microphone configured to capture audio from within the vehicle; and a processor configured to execute the computer instructions to:
receive, via the microphone, audible route information that is emanating from a source within the vehicle;
determine an anticipated route of the vehicle based on the audible route information;
select visual content based on the anticipated route of the vehicle; and
displaying, via the display interface, the selected visual content to the user.
13 . The system of claim 12 , further comprising:
a camera configured to capture images of a display screen of a mobile computing device of the user; and wherein the processor determines the anticipated route of the vehicle by being configured to execute the computer instructions further to:
analyze the captured images to identify visual route information; and
determine the anticipated route of the vehicle based on a combination of the audible route information and the visual route information.
14 . The system of claim 12 , wherein the processor receives the audible route information emanating from within the vehicle by being configured to execute the computer instructions further to:
capture, from a person within the vehicle via the microphone, spoken words that include a direction of travel and street information.
15 . The system of claim 12 , wherein the processor receives the audible route information emanating from within the vehicle by being configured to execute the computer instructions further to:
capture, from a person within the vehicle via the microphone, spoken words that include an instruction to change direction of travel of the vehicle.
16 . The system of claim 12 , wherein the processor receives the audible route information emanating from within the vehicle by being configured to execute the computer instructions further to:
capture, from a person within the vehicle via the microphone, spoken words that include an instruction for the vehicle to leave a current roadway.
17 . The system of claim 12 , wherein the processor receives the audible route information emanating from within the vehicle by being configured to execute the computer instructions further to:
capture, via the microphone, audio signals emanating from an electronic speaker within the vehicle that include spoken words of a direction of travel and street information.
18 . The system of claim 12 , wherein the processor receives the audible route information emanating from within the vehicle by being configured to execute the computer instructions further to:
capture, via the microphone, audio signals emanating from an electronic speaker within the vehicle that include spoken words of an instruction to change direction of travel of the vehicle.
19 . The system of claim 12 , wherein the processor receives the audible route information emanating from within the vehicle by being configured to execute the computer instructions further to:
capture, via the microphone, audio signals emanating from an electronic speaker within the vehicle that include spoken words of an instruction for the vehicle to leave a current roadway.
20 . A computing device, comprising:
a memory configured to store computer instructions; a output interface configured to present content to a user of the vehicle; a microphone configured to capture audio emanating from within the vehicle; and a processor configured to execute the computer instructions and:
capture, via the microphone, audible signals emanating from within the vehicle;
analyze the captured audible signals to identify audible route information;
determine a next course of travel of the vehicle based on the audible route information;
select content to present to the user of the vehicle based on the next course of travel of the vehicle; and
present, via the output interface, the selected content to the user.Join the waitlist — get patent alerts
Track US2021166275A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.