Automotive Collision Avoidance System Field Operational Test Program
FIRST ANNUAL REPORT

1 EXECUTIVE SUMMARY


1.1 Summary of Program Accomplishments and Conclusions

General Motors Corporation and Delphi-Delco Electronics Systems have established a Program Team to advance the science of Collision Warning (CW) systems. This Team will conduct an extensive Field Operational Test (FOT) to assess the impact of an integrated Forward Collision Warning (FCW) and Adaptive Cruise Control (ACC) system. The FCW function assesses conditions ahead of the vehicle and alerts the driver of rear-ends crash hazards. The Adaptive Cruise Control (ACC) function activates the brake and throttle to maintain a specified headway when following a slower vehicle. To support the FOT, the Program Team is designing and building ten cars equipped with FCW and ACC as well as an unobtrusive data acquisition system. During the field operational test, volunteers from the general driving public will each be given these cars for unsupervised, unrestricted use for two to four weeks.

The performance of the collision warning system will be sufficiently reliable and robust to support a meaningful field operational test. It will provide warnings to the driver, rather than taking active control of the vehicle. The FCW and ACC functions will be implemented using a combination of (a) a long-range forward radar-based sensor that is capable of detecting and tracking traffic, (b) a forward vision-based sensor that detects and tracks lanes and (c) GPS and a map database to help ascertain road geometry.

The technical activities of the program are grouped into two phases. Phase I started in June 1999, and will last approximately 27 months. Phase II will start immediately after Phase I and last approximately 32 months.

Phase I
1. Development – The program will initially improve technologies/components necessary for the FCW system, some of which were developed during the previous ACAS Program.
2. Integration – The refined FCW technologies/components will be designed into the vehicle to form an integrated rear-end collision warning system.
Phase II
3. Deployment Fleet – The validated design will be used to build a deployment fleet of ten vehicles equipped with the system.
4. Field Operational Test – The field operational test plan will be implemented. The deployed vehicles will be used to collect valuable research data to assess/validate the technology, product maturity, and the response of the public to the technology.

Table 1.1 shows how the tasks of the program are organized.

Table 1.1 Organization of Program Tasks

Task Description
A System Integration
  • Determination and allocation of system functions to subsystems
  • Interface management
  • System validation
B Subsystem Development
B1 Forward Radar Sensor
B2 Forward Vision Sensor
B3 Brake Control System
B4 Throttle Control System
B5 Driver-Vehicle Interface
  • Subsystem hardware definition
  • Subsystem hardware refinement
  • Subsystem validation
 
C Subsystem Processing Development
C1 Data Fusion
C2 Tracking and Identification
C3 Collision Warning Function
C4 Adaptive Cruise Control Function
  • Subsystem software definition
  • Subsystem software development
  • Subsystem software validation
D Vehicle Build
  • Engineering Development Vehicles
  • Prototype Vehicle
  • Pilot Vehicles
  • Deployment Vehicles
E Field Operational Test
  • FOT preparation
  • FOT conduct
  • FOT report

System Integration

During the first year of the program system functional requirements were documented and allocated to subsystems and components. Development began to define the complete set of signals and messages between the subsystems. This work will be documented in an Interface Control Document that will be delivered to NHTSA in March 2001.

Briefings were prepared and presented on the Prototype Vehicle Validation Plan and discussions were held with NHTSA, Volpe, and other government representatives, on system level testing scenarios. A Test Scenarios Report was delivered to NHTSA in April 2000. A System Verification Plan will be delivered to NHTSA in December 2000.

Each subsystem was reviewed to develop a preliminary hazard analysis and create a hazard mitigation plan. The plan is being developed using guidelines from Mil Standard 882C and SAE J1789. Safety plan presentations were made at meetings in November 1999 and June 2000. The Risk Management Plan will be delivered to NHTSA in January 2001.

Forward Radar Sensor

The Forward Radar Sensor Task includes transceiver/antenna integration, and development of algorithms for auto-alignment, antenna radome blockage detection, and bridge rejection. To facilitate transceiver/antenna integration, millimeter-wave monolithic integrated circuits (MMIC) were designed into the transceiver. Initial tests of the MMIC components and of the entire radar on an engineering development vehicle found some performance issues that are being addressed. The unit for the Prototype Vehicle is expected to perform as specified.

The auto-alignment algorithm is to electronically adjust the sensor mechanisms for misalignment due to vehicle wear and tire alignment. The basic algorithm has been found effective over "long" periods of time but is susceptible to peak errors of short duration when the vehicle is driven on curves. Engineering testing is continuing to isolate the cause of these errors and to develop a remedy.

The radome blockage detection algorithm is to detect when dirt, slush, or other material blocks the sensor. Development of this algorithm is behind schedule but a recovery plan is being executed. Some conceptual concerns have been identified regarding detection reliability in partial blockage situations, heavy snowfall, or when the vehicle is parked. These will be investigated and appropriate validation tests will be defined and executed.

The bridge rejection algorithm is to recognize and classify bridges as safe overhead objects so they do not cause the ACC function to slow the vehicle. Several approaches have been tested. An amplitude-slope method was found to be reliable but it requires multiple scans with range closure that can lead to delayed recognition of valid in-path stopped vehicles.

Forward Vision Sensor

The forward vision sensor is to provide lane tracking to help distinguish in-path from out-of-path targets, which is particularly difficult as the vehicle approaches a curve and during lane changes. It will use a video camera mounted behind the windshield of the vehicle to estimate road shape, lane width, vehicle heading and lateral position in the lane. Teams from the University of Pennsylvania, Ohio State University, and the University of Michigan – Dearborn were contracted to enhance their existing technology to meet the needs of the FOT. The primary challenge is to provide adequate road shape estimates at least 75 meters (preferably 100 meters) ahead of the vehicle. The work of the three universities will be evaluated to select one approach for further development and final integration into the FOT vehicles.

During the first year, Delphi-Delco Electronics defined requirements, implemented a video data acquisition system, and worked with the universities to define appropriate confidence measures. The universities have demonstrated systems that can track highway roads at 10 Hz frame rates out to 75 meters. They can handle lane changes and partial occlusion of the lane markings. Work is still required to improve tradeoffs associated with sampling schemes and to improve performance of the lane marker extraction methods with low levels of illumination and on concrete road surfaces.

Brake Control System

A new Delphi Brake Control System will replace the OEM brake components on the Prototype and FOT deployment vehicles. The brake control system includes an anti-lock brake system (ABS), vehicle stability enhancement, and traction control features. For this program, the brake system will be enhanced to respond to ACC braking commands while maintaining the braking features and functions that were in the original brake system. Delphi’s common best engineering practices will be used to perform safety analysis and vehicle level verification of the brake system to ensure production-level confidence in the brake system.

Over the past two years, the DBC 7.2 brake control system has undergone significant testing for production programs. During the first year of the ACAS/FOT program, the brake system was integrated on a chassis mule and one of the Engineering Development Vehicles. Calibration and tuning of the brake system has started.

Throttle Control System

The throttle control system maintains the vehicle speed in response to the speed set by the driver or in response to the speed requested by the ACC function. The Delphi stepper motor cruise control (SMCC), standard in the Buick LeSabre, will be modified to perform the required functions. The required modifications have been used successfully in other projects. During the first year, interface requirements were defined and throttle control system modifications were designed for the prototype vehicle.

Driver Vehicle Interface

The driver vehicle interface senses the settings from the driver via buttons on the steering wheel. It also conveys information from the ACC and FCW functions to the driver. The FCW warnings must immediately direct the driver to evaluate and react to threats with sufficient time to perform some action to avoid or mitigate a potential crash. To achieve this, audible, visible, and possibly haptic cues will be employed. The ACC information must be presented so that the driver can easily determine the cruise control set speed, selected inter-vehicle separation, and whether or not a preceding vehicle has been detected by the system. For both functions, this information must be understandable at a glance by the driver and without adding extra workload to the driving task

The primary visual interface for the FOT system will be a reconfigurable, high-resolution, full-color head-up display. During the first year of the program development of hardware began, including an agreement with a manufacturer for the visual display cells. To support development, a Buick LeSabre was procured as a test bench.

Candidate display formats were developed for three warning philosophies: a single-stage imminent alert, a two-stage warning, and a graded display with an imminent alert. The alternatives differ in the amount of information provided to the driver at times other than when immediate action is required. The differences may impact whether drivers are startled or annoyed by the warnings, and their vehicle following behavior. The graded display philosophy is the preferred alternative for the ACAS/FOT program, though interfaces for the other two approaches will be designed and evaluated in driving simulator and test track scenarios.

The warning philosophy alternatives will be refined by testing them using subjects in driving simulators, on test-tracks and public roads. A driving simulator at Delco was upgraded to support refinement of the visual aspects of the displays. Driving simulator tests conducted at the University of Iowa and on-road experiments at GM’s Milford Proving Ground will also be used to provide empirical data to help refine warning timing and to select the final warning philosophy. Development of the test protocols has begun in collaboration with NHTSA. A DVI Warning Cue Implementation Summary Report will be submitted to NHTSA in February 2001.

Data Fusion

Data fusion algorithms will be used to provide estimates for road geometry using several sources of information. These sources of information include the vision sensor, scene tracking, yaw rate and speed sensors, and map-based road geometry estimation. Scene tracking is a technique to estimate road geometry by tracking the path of vehicles detected by the forward-radar sensor. Map-based road geometry estimates will be derived from data extracted from digital maps using GPS and dead reckoning to derive the vehicle’s geographic location. Data fusion techniques will also be used to evaluate sensor information to modify the expected driver reaction time and braking intensity based upon the environmental conditions (rain, snow, day, night, etc.) and/or driver activity such as adjusting the climate control system.

During the first year of the program, requirements were developed and appropriate data fusion algorithmic approaches were selected. A new road model parameterization technique using multiple clothoids was developed and found to provide smaller errors than single-clothoid road models, particularly near transition between straight and curved road segments. Better road geometry estimates should translate into lower errors in distinguishing in-path targets from out-of-path targets.

Tracking and Identification

Target identification and selection uses the road geometry estimate to determine which radar returns are from objects that are (or will soon be) in the path of the vehicle. The selected targets are evaluated by the FCW function to decide whether to issue an alert. The Tracking and Identification Task includes development of the algorithms for scene tracking, map-based road geometry estimation, path estimation, target identification and selection.

In the first year of the program, the target identification algorithms were enhanced with improvements to the path prediction algorithm, lane change detection, and roadside distributed stopped object detection. These were tested with an improved tool for simulation of road scenarios. Scene tracking algorithm work included enhancement of the algorithms that handle vehicles that are not following the lanes, real-time implementation, and tuning with real-world radar target data. Map-based road geometry estimation work included completion of the sensor driver software and map data retrieval software. Limited testing of this software was completed with promising results. Assistware delivered a map enhancement approach in February 2000. This technology tracks the vehicle’s route using a GPS receiver to augment the road geometry information in the map database.

To support development of the hardware and software Delphi Delco Electronics created three engineering development vehicles (EDV), by modifying them to provide the functionality of a rudimentary integrated ACC and FCW system.

CW Function

The CW Function Task includes In-Vehicle Threat Assessment Algorithm Development and Threat Assessment Simulation. The threat assessment algorithm assigns a threat level to the current situation based upon the motion of the project vehicle and each selected in-path target vehicle. Six threat assessment algorithms, including one developed by NHTSA, will be implemented and tested in simulations, on test tracks, and in real traffic. Work in the first year of the program included development and analytical evaluation of the algorithms.

The Threat Assessment Simulation is for refinement and evaluation of threat assessment algorithms. The University of California-PATH, using mathematical models of each function provided by GM, is developing it. Initial coding of the simulation was completed in August 2000.

Adaptive Cruise Control Function

The Adaptive Cruise Control Subsystem is a module from a future GM production program that includes the radar and ACC Controller. The Adaptive Cruise Control Function Task will provide the module as is for the 2002 Buick LeSabre and provide support for its integration with the rest of the ACC and FCW functions. The work is focussed on the interfaces between the module and other vehicle subsystems.

Fleet Vehicle Build

During Phase I of the program the Fleet Vehicle Build Task includes building and testing a GM Engineering Development Vehicle (GM EDV) and a Prototype Vehicle. The GM EDV is a 2000 Buick LeSabre with modifications to accommodate all the required instrumentation to investigate threat assessment, map-based path prediction, map database enhancement, and human factors. During the first year of the program the GM EDV vehicle was modified to incorporate required changes to the electrical and mechanical infrastructure, and software was developed for the interfaces. The system hardware was debugged and installed in the vehicle after which operation of the sensors was verified.

The Prototype Vehicle will integrate all the technologies developed by the partners in the program as a precursor to the Pilot Vehicles and finally the Deployment Vehicles. The Prototype will have the functionality, but not necessarily the form factor, of the deployment vehicles. It will be used to verify the functionality of the ACC and FCW features during Phase I of the program. The Pilot Vehicles will have the functionality and form factor of the deployment vehicles and will be built during Phase II of the program. All materials to be installed in the Prototype Vehicle have been ordered and an early version of the ACC brake system has been installed. Installation of the remaining equipment will begin shortly and will require significant collaboration among the partners to complete.

Field Operational Test

The Field Operational Test (FOT) task includes preparation and execution of the test itself. In Phase I of the program this task includes planning and performing two stages of pilot tests, development of a Data Acquisition System (DAS) and developing the procedures, software, and a plan for execution of the FOT. Much of this work is being performed by University of Michigan Transportation Research Institute (UMTRI) staff, who will apply prior methodology and learning from the Intelligent Cruise Control (ICC) FOT, adapting the field-testing techniques to the ACAS platform.

In June of 2000, eight UMTRI staff with prior experience testing ACC systems evaluated one of the Delco EDVs over a 94-mile route. The ACC system was found to be highly operable and was successfully driven with the ACC engaged for approximately 90% of the mixed-route miles and for over 80% of the miles on surface streets. The intent was to explore and identify challenging conflict types that occur in the roadway environment.

Also during the first year of the program a Data Acquisition System that includes many, but not all, of the features and software of the eventual FOT package was successfully constructed and operated on the Delco EDV. The system collected many of the variables required for the FOT including the multi-target radar data. This operation confirmed the readiness of the DAS for handling the tasks of data collection in the FOT.

1.2 Major Milestones and Deliverables

Table 1.2 shows the major milestones that were accomplished during the first year of the program. Table 1.3 shows the milestones for the remainder of the year.

Table 1.2 Summary of Program Milestones Completed

Milestone Task Phase I Milestone Description Completion
Date
1 A CW Architecture Definition Dec 99
4 B2 Lane Tracking "Kick-Off" Meeting Aug 99
7 B3 Brake System Design Apr 00
9 B5 DVI Technology Exchange "Kick-Off" Meeting Aug 99
12 C1 Data Fusion Architecture and Performance Requirements Definition Sep 99
15 C3 Threat Assessment Technology Exchange "Kick-Off" Meeting Aug 99
19 E Submission Of FOT Pilot Test Plan Jan 00
23 F ACAS/FOT "Kick-Off" Program Team Meeting Jul 99
24 F

ACAS/FOT "Kick-Off" Meeting

Aug 99
25 F ACAS/FOT Program Review Briefing 1 Jan 00
26 F ACAS/FOT Program Review Briefing 2 Jul 00

Table 1.3 Summary of Program Milestones Due Through 2000

Milestone Task Phase I Milestone Description Completion
Date
2 A CW Verification Plan Sep 00
5 B2 Lane Tracking Technology Down-Select Meeting Sep 00
10 B5 DVI Warning Cue Set Selection Nov 00
13 C1 DVI Technology Exchange "Kick-Off" Meeting Nov 00
20 F Completion Of FOT Professional Pilot, Testing & Data Processing Nov 00

Table 1.4 below shows the deliverables that were submitted to NHTSA during the first year of the program. Table 1.5 shows the remaining deliverable to be submitted this year.

Table 1.4. Summary of Program Deliverables Completed

Deliverable Task Phase I Deliverable Description Completion
Date
1 A Functional Description Document Nov 99
2 1 System Architecture/Mechanization Report Jan 00
7 B2 Lane Tracking System Requirements Summary Report Jan 00
9 B3 Brake Actuator System Design Summary Report Jun 00
17 E FOT Pilot Test Plan Jan 00
20 F ACAS/FOT Program Schedule Aug 99

Table 1.5 Summary of Program Deliverables Due Through 2000

Deliverable Task Phase I Deliverable Description Completion
Date
3 A System Verification Plan Oct 00
14 A Risk Management Plan Nov 00
18 E FOT First HURP Request Nov 00
21 F ACAS/FOT "Kick-Off" Meeting Briefing Package Sep 99
22 F ACAS/FOT Program Review 1 Briefing & Program Plan Package Feb 00
23 F ACAS/FOT Program Review 2 Briefing & Program Plan Package Aug 00
24 F ACAS/FOT First Annual Report Sep 00

1.3 Master Program Schedule

Figures 1.1 through 1.5 show a top-level program schedule. The schedules show work completed through the end of June 2000. A more detailed schedule is provided in each Task Section.


Figure 1.1 Master Program Schedule, Page 1

Figure 1.1 Master Program Schedule, Page 1


Figure 1.2 Master Program Schedule, Page 2

Figure 1.2 Master Program Schedule, Page 2


Figure 1.3 Master Program Schedule, Page 3

Figure 1.3 Master Program Schedule, Page 3


Figure 1.4 Master Program Schedule, Page 4

Figure 1.4 Master Program Schedule, Page 4

[TITLE PAGE]      [TABLE OF CONTENTS]
[1 Executive Summary]     [2 Introduction]     [3 System Integration]     [4 Forward Radar Sensor]
[5 Forward Vision Sensor]     [6 Brake Control System]     [7 Throttle Control System]
[8 Driver-Vehicle Interface]      [9 Data Fusion]     [10 Tracking & Identification]     [11 CW Function]   
 [12 ACC Function]     [13 Fleet Vehicle Build]      [14 Field Operational Test]
[Appendix A]     [Acronyms]