Redundant ethernet network and sensor processing system for vehicles and related methods

Abstract

Reliability and responsiveness in vehicles are becoming more important as semi-automation and automation are becoming more prevalent. A redundant data network system is provided within a vehicle and includes a first node connected to a first sensor and a second node connected to a second sensor. A first data cable is connected between the first node and the second node, a second data cable is connected between the first node and an electronic control unit (ECU), and a third data cable connected between the second node and the ECU. Data from the first sensor and the second sensor is transmitted across the Ethernet network to reach the ECU. Data from these sensors is also compared and processed locally to improve reliability and to reduce processing load on the ECU.

1 . A redundant data network within a mobile platform, comprising:
 a first node connected to a first sensor that monitors a first area in or around the mobile platform;   a second node connected to a second sensor that monitors a second area in or around the mobile platform;   the first node, the second node and an ECU node connected to each other via data cables;   the first node configured to transmit data [A] obtained by the first sensor to the second node and the ECU node, and the second node configured to transmit data [B] obtained by the second sensor to the first node and the ECU node;   after the first node receives the data [B], the first node further configured to execute an analysis to determine if the data [B] and the data [A] validate each other, and to transmit an analysis result to the ECU node; and   wherein the analysis further comprises identifying an object in the data [A] and the same object in the data [B], and then identifying one or more attributes of the object, which is transmitted to the ECU node as part of the analysis result.   
     
     
         2 . The redundant data network of  claim 1  wherein the first area and the second area together define an overlapping area, and analysis further comprises identifying the object in the data [A] and the same object in the data [B] is in the overlapping area. 
     
     
         3 . The redundant data network of  claim 1  wherein the first node comprises a first data port and a second data port connected to the redundant data network, and the first node duplicates the data [A] and transmits at a same time a first instance of the data [A] and a second instance of the data [A] respectively via the first data port and the second data port. 
     
     
         4 . The redundant data network of  claim 1  wherein the second node comprises a first data port and a second data port connected to the redundant data network, and the second node duplicates the data [B] and transmits at a same time a first instance of the data [B] and a second instance of the data [B] respectively via the first data port and the second data port. 
     
     
         5 . The redundant data network of  claim 1  wherein each of the first node, the second node and the ECU node comprise two data ports, and the first node, the second node and the ECU node are arranged in a ring network configuration. 
     
     
         6 . The redundant data network of  claim 1  wherein, after the first node determines the data [A] and the data [B] validate each other, transmitting only one of the data [A] and the data [B], along with the first analysis result, to the ECU node. 
     
     
         7 . The redundant data network of  claim 1  wherein the one or more attributes comprises at least one of: a boundary box around the object, an outline of the object, a size of the object, a distance between the object and the mobile platform, a color of the object, and a name of the object. 
     
     
         8 . The redundant data network of  claim 1  wherein, after a threshold number of times that the first node determines instances of data [A] and instances of data [B] invalidate each other, the first node configured to transmit an alert regarding a potential error in at least one of the first sensor and the second sensor. 
     
     
         9 . The redundant data network of  claim 1  wherein, after a threshold number of times that the first node determines instances of data [A] and instances of data [B] invalidate each other, the first node configured to transmit an alert regarding a potential error in at least one of processing at the first node and processing at the second node. 
     
     
         10 . The redundant data network of  claim 1  wherein, after a threshold number of times that the ECU node determines instances of data [A] and instances of data [B] invalidate each other, the ECU node configured to transmit an alert regarding a potential error in at least one of processing at the first node and processing at the second node. 
     
     
         11 . The redundant data network of  claim 1  wherein the data cables comprise Ethernet cables, and a first Ethernet cable is connected between the first node and the second node, a second Ethernet cable is connected between the first node and the ECU node, and a third Ethernet cable connected between the second node and the ECU node. 
     
     
         12 . The redundant data network of  claim 1  is an Ethernet network, and wherein the first node comprises a sensor interface to interact with the first sensor, a processor module comprising a processor and memory, and a redundancy module comprising two external interfacing Ethernet ports and a host Ethernet port that is connected to the processor module. 
     
     
         13 . The redundant data network of  claim 1  is an Ethernet network, and wherein the first node comprises: a sensor interface to interact with the first sensor; a processor module comprising an image processing module, a comparator module and memory; and a redundancy module comprising two external interfacing Ethernet ports and a host Ethernet port that is connected to the processor module; wherein the image processing module and the comparator module process the data [A] and the data [B] to identify an object in each of the data [A] and the data [B]. 
     
     
         14 . The redundant data network of  claim 1  wherein the first node is connected to a first set of sensors, the first set of sensors comprising the first sensor; and wherein the second node is connected to a second set of sensors, the second set of sensors comprising the second sensor. 
     
     
         15 . The redundant data network of  claim 14  wherein the first set of sensors comprises a first camera and a first RADAR, and the second set of sensors comprise a second camera and a second RADAR. 
     
     
         16 . The redundant data network of  claim 1  wherein the first area and the second area together define an overlapping area, and wherein the analysis further comprises identifying multiple objects in the data [A] and the same multiple objects in the data [B] in the overlapping area, and then identifying attributes of the multiple objects that are transmitted in the analysis result to the ECU node. 
     
     
         17 . The redundant data network of  claim 1  wherein the first area and the second area together define an overlapping area, and wherein the analysis further comprises identifying multiple objects in the data [A] and the same multiple objects in the data [B] in the overlapping area, and wherein if all of the same multiple objects are not identified in the data [B], then the first node invalidates the data [A] and the data [B]. 
     
     
         18 . The redundant data network of  claim 1  wherein the ECU node is configured to obtain the first analysis result, and the ECU node is further configured to process the first analysis result to output an action command that controls one or more subsystems of the mobile platform. 
     
     
         19 . The redundant data network of  claim 18  wherein the one or more subsystems of the mobile platform comprise a steering subsystem, a braking subsystem, a motor subsystem, and an alert subsystem. 
     
     
         20 . A mobile platform comprising:
 a first sensor system connected to a first node and a second sensor system connected to a second node;   a data network connecting an electronic control unit (ECU) node, the first node and the second node in a ring network configuration;   the first node configured to transmit data [A] obtained by the first sensor system to the second node and the ECU, and the second node configured to transmit data [B] obtained by the second sensor system to the first node and the ECU;   after the first node receives the data [B], the first node configured to execute an analysis of the data [B] and the data [A], and transmitting an analysis result to the ECU; and   wherein the analysis comprises identifying an object in the data [A] and the same object in the data [B], and then identifying one or more attributes of the object, which is transmitted to the ECU node as part of the first analysis result.   
     
     
         21 . The mobile platform of  claim 20  wherein the one or more attributes comprise one or more of: a boundary box around the object, an outline of the object, a size of the object, a distance between the object and the mobile platform, a color of the object, and a name of the object. 
     
     
         22 . The mobile platform of  claim 20  wherein the first sensor system senses a first area around the mobile platform and the second sensor system senses a second area around the mobile platform, and the first area and the second area at least partially overlap and define an overlapping area, and the analysis further comprises identifying the object in the data [A] and the same object in the data [B] are in the overlapping area. 
     
     
         23 . A redundant data network within a mobile platform, comprising:
 a first node connected to a first sensor that monitors a first area in or around the mobile platform;   a second node connected to a second sensor that monitors a second area in or around the mobile platform;   the first node, the second node and an ECU node connected to each other via data cables;   the first node configured to transmit data [A] obtained by the first sensor to the second node and the ECU node, and the second node configured to transmit data [B] obtained by the second sensor to the first node and the ECU node;   after the first node receives the data [B], the first node configured to execute an analysis to determine if the data [B] and the data [A] validate each other, and to transmit an analysis result to the ECU node; and   wherein, after the first node determines the data [A] and the data [B] validate each other, the first node is further configured to transmit one of the data [A] and the data [B] to the ECU node.   
     
     
         24 . The redundant data network of  claim 23  wherein the analysis comprises identifying an object in the data [A] and the same object in the data [B]. 
     
     
         25 . The redundant data network of  claim 24  wherein the analysis further comprises identifying one or more attributes of the object, and the one or more attributes comprise one or more of: a boundary box around the object, an outline of the object, a size of the object, a distance between the object and the mobile platform, a color of the object, and a name of the object. 
     
     
         26 . The redundant data network of  claim 24  wherein the first area and the second area at least partially overlap and define an overlapping area, and the analysis further comprises identifying the object in the data [A] and the same object in the data [B] are in the overlapping area. 
     
     
         27 . The redundant data network of  claim 23  wherein the first area and the second area together define an overlapping area, and wherein the analysis further comprises identifying multiple objects in the data [A] and the same multiple objects in the data [B] in the overlapping area, and then identifying attributes of the multiple objects that are transmitted in the analysis result to the ECU node. 
     
     
         28 . The redundant data network of  claim 23  wherein the first area and the second area together define an overlapping area, and wherein the analysis further comprises identifying multiple objects in the data [A] and the same multiple objects in the data [B] in the overlapping area, and wherein if all of the same multiple objects are not identified in the data [B], then the first node invalidates the data [A] and the data [B]. 
     
     
         29 . A redundant data network within a mobile platform, comprising:
 a first node connected to a first sensor that monitors a first area in or around the mobile platform;   a second node connected to a second sensor that monitors a second area in or around the mobile platform;   the first node, the second node and an ECU node connected to each other via data cables;   the first node configured to transmit data [A] obtained by the first sensor to the second node and the ECU node, and the second node configured to transmit data [B] obtained by the second sensor to the first node and the ECU node;   after the first node receives the data [B], the first node further configured to execute an analysis to determine if the data [B] and the data [A] validate each other, and to transmit an analysis result to the ECU node; and   wherein the first area and the second area together define an overlapping area, and wherein the analysis comprises identifying multiple objects in the data [A] and the same multiple objects in the data [B] in the overlapping area to determine if the data [B] and the data [A] validate each other.   
     
     
         30 . The redundant data network of  claim 29 , wherein if all of the same multiple objects are not identified in the data [B] in the analysis, then the first node invalidates the data [A] and the data [B]. 
     
     
         31 . The redundant data network of  claim 29  wherein, after identifying the multiple objects in the data [A] and the same multiple objects in the data [B] in the overlapping area, the analysis further comprises identifying attributes of the multiple objects, which are transmitted in the analysis result to the ECU node.