US2024034327A1PendingUtilityA1

Road abnormality detection apparatus, road abnormality detection method and road abnormality detection program

Assignee: TOYOTA MOTOR CO LTDPriority: Apr 2, 2019Filed: Oct 10, 2023Published: Feb 1, 2024
Est. expiryApr 2, 2039(~12.7 yrs left)· nominal 20-yr term from priority
B60W 40/06B60R 11/04G06V 20/588B60R 2300/80B60W 2552/53B60W 2556/10
79
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

A road abnormality detection apparatus includes: a memory; and a processor having hardware, wherein the processor is configured to: receive, from a traveling vehicle, a road image indicating an image of a surface of a road or a periphery of the road and image capturing position information indicating a position where the road image is captured; recognize a road facility included in the road image and a position of the road facility based on the road image and the image capturing position information; determine whether or not abnormality exists in the road facility by comparing the road facility included in the road image and correctness information that is prepared in advance; and accumulate, in the memory, facility position information indicating the position of the road facility that the abnormality exists in when it is determined that the abnormality exists in the road facility.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A road abnormality detection apparatus comprising:
 a memory; and   a hardware processor programmed to:
 receive, from a traveling vehicle, (i) a road image indicating an image of at least a surface of a road, the road image being captured by a camera attached to the vehicle and (ii) image capturing position information indicating a position where the road image is captured, the position being detected by a positioning unit of the vehicle using GPS data or laser imaging data; 
 recognize a road indication presented on the surface of the road included in the road image and a position of the road indication based on the road image and the image capturing position information; 
 determine that an abnormality exists in the road indication by using the road image, the abnormality in the road indication including spots due to dirt, deposits of withered leaves, and litter, wherein 
   the road indication includes at least one of a center line on the surface of the road, an outer line on the surface of the road, a stop line on the surface of the road, a pedestrian crossing indication on the surface of the road, a pedestrian crossing advance notice on the surface of the road, a speed limit indication on the surface of the road, an arrow line on the surface of the road, Bott's dots, and a road division line on the surface of the road; and   in response to determining that the abnormality exists in the same road indication a plurality of times based on a plurality of the road images captured by a plurality of the vehicles, transmit indication position information for repair of the road indication.   
     
     
         2 . The road abnormality detection apparatus according to  claim 1 , wherein the processor recognizes the road indication included in the road image by comparing pixel values of adjacent pixels in the road image with each other. 
     
     
         3 . The road abnormality detection apparatus according to  claim 1 , wherein the processor accumulates, in the memory, the indication position information in response to determining that the abnormality exists in the road indication. 
     
     
         4 . The road abnormality detection apparatus according to  claim 3 , wherein the processor accumulates, in the memory, the road image including the road indication in which the abnormality exists in addition to the indication position information of the road indication in which the abnormality exists, in response to determining that the abnormality exists in the road indication. 
     
     
         5 . The road abnormality detection apparatus according to  claim 1 , wherein
 the processor determines that the abnormality exists in the road indication by comparing the road indication included in the road image with correctness information that is prepared in advance.   
     
     
         6 . The road abnormality detection apparatus according to  claim 5 , wherein
 the correctness information includes map information having road indication information prepared in advance.   
     
     
         7 . A road abnormality detection method performed by a road abnormality detection apparatus including a memory and a hardware processor, the road abnormality detection method comprising:
 receiving, by the processor, from a traveling vehicle, (i) a road image indicating an image of at least a surface of a road, the road image being captured by a camera attached to the vehicle and (ii) image capturing position information indicating a position where the road image is captured, the position being detected by a positioning unit of the vehicle using GPS data or laser imaging data;   recognizing, by the processor, a road indication presented on the surface of the road included in the road image and a position of the road indication based on the road image and the image capturing position information;   determining, by the processor, that an abnormality exists in the road indication by using the road image, the abnormality in the road indication including spots due to dirt, deposits of withered leaves, and litter, wherein   the road indication includes at least one of a center line on the surface of the road, an outer line on the surface of the road, a stop line on the surface of the road, a pedestrian crossing indication on the surface of the road, a pedestrian crossing advance notice on the surface of the road, a speed limit indication on the surface of the road, an arrow line on the surface of the road, Bott's dots, and a road division line on the surface of the road; and   in response to determining that the abnormality exists in the same road indication a plurality of times based on a plurality of the road images captured by a plurality of the vehicles, transmitting, by the processor, indication position information for repair of the road indication.   
     
     
         8 . The road abnormality detection method according to  claim 7 , wherein the processor recognizes the road indication included in the road image by comparing pixel values of adjacent pixels in the road image with each other. 
     
     
         9 . The road abnormality detection method according to  claim 7 , wherein the processor accumulates, in the memory, the indication position information in response to determining that the abnormality exists in the road indication. 
     
     
         10 . The road abnormality detection method according to  claim 9 , wherein the processor accumulates, in the memory, the road image including the road indication in which the abnormality exists in addition to the indication position information of the road indication in which the abnormality exists, in response to determining that the abnormality exists in the road indication. 
     
     
         11 . The road abnormality detection method according to  claim 7 , wherein
 the processor determines that the abnormality exists in the road indication by comparing the road indication included in the road image with correctness information that is prepared in advance.   
     
     
         12 . The road abnormality detection method according to  claim 11 , wherein
 the correctness information includes map information having road indication information prepared in advance.   
     
     
         13 . A non-transitory computer-readable medium storing thereon a road abnormality detection program executed by a road abnormality detection apparatus including a memory and a hardware processor, the program causing the processor to execute:
 receiving, from a traveling vehicle, (i) a road image indicating an image of at least a surface of a road, the road image being captured by a camera attached to the vehicle and (ii) image capturing position information indicating a position where the road image is captured, the position being detected by a positioning unit of the vehicle using GPS data or laser imaging data;   recognizing a road indication presented on the surface of the road included in the road image and a position of the road indication based on the road image and the image capturing position information;   determining that an abnormality exists in the road indication by using the road image, the abnormality in the road indication including spots due to dirt, deposits of withered leaves, and litter, wherein   the road indication includes at least one of a center line on the surface of the road, an outer line on the surface of the road, a stop line on the surface of the road, a pedestrian crossing indication on the surface of the road, a pedestrian crossing advance notice on the surface of the road, a speed limit indication on the surface of the road, an arrow line on the surface of the road, Bott's dots, and a road division line on the surface of the road; and   in response to determining that the abnormality exists in the same road indication a plurality of times based on a plurality of the road images captured by a plurality of the vehicles, transmitting indication position information for repair of the road indication.   
     
     
         14 . The non-transitory computer-readable medium according to  claim 13 , wherein the program causes the processor to recognize the road indication included in the road image by comparing pixel values of adjacent pixels in the road image with each other. 
     
     
         15 . The non-transitory computer-readable medium according to  claim 13 , wherein the program causes the processor to accumulate, in the memory, the indication position information in response to determining that the abnormality exists in the road indication. 
     
     
         16 . The non-transitory computer-readable medium according to  claim 15 , wherein the program causes the processor to accumulate, in the memory, the road image including the road indication in which the abnormality exists in addition to the indication position information of the road indication in which the abnormality exists, in response to determining that the abnormality exists in the road indication. 
     
     
         17 . The non-transitory computer-readable medium according to  claim 13 , wherein the program causes the processor to determine that the abnormality exists in the road indication by comparing the road indication included in the road image with correctness information that is prepared in advance. 
     
     
         18 . The non-transitory computer-readable medium according to  claim 17 , wherein
 the correctness information includes map information having road indication information prepared in advance.   
     
     
         19 . The road abnormality detection apparatus according to  claim 1 , wherein in response to determining that the abnormality exists in the road indication, the processor is programmed to identify a cause of the abnormality and transmit the cause of the abnormality. 
     
     
         20 . The road abnormality detection method according to  claim 7 , wherein in response to determining that the abnormality exists in the road indication, identifying, by the processor, a cause of the abnormality and transmitting, by the processor, the cause of the abnormality.

Join the waitlist — get patent alerts

Track US2024034327A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.