Dear Mr. Lindenmayer,
I don't know where the LAB, LMB, or the US Senate now stand regarding this letter and S.1885, but I think the request of the cyclists and pedestrians should be different, something more technically feasible. We ask for an "eye test" to be required. I believe, based on my deep experience in the relevant automotive fields this touches, that this is a requirement that cannot be fulfilled. It will require measuring information that is not publicly accessible in production vehicles, and will most likely be regarded as proprietary by the car companies and AV companies.
if AV (level 2 or higher) or more primitive autonomous systems (Levels 0 and 1) are tested, the results will not be meaningful if not as samplings of production cars, and for developmental vehicles to be tested as if they are production vehicles. The established car companies (the OEMs) all understand this theoretically and practically. The emerging car companies (Waymo, Uber, and others) which have chosen staff from the OEMs also understand this, because they brought in the correct expertise.
To make the necessary performance tests on production vehicles, test data must be read from a common, open data network that all OEMs use and for which the testers can buy equipment - not a proprietary data network! CAN is the most common example at this time in the industry. Test technicians trained to follow NHTSA test requirements must be able to simply bring equipment and plug it in to the car. Data that indicates response to a target by the vehicle system, such as triggering of a mild deceleration (adaptive cruise control), a driver warning (forward vehicle collision warning), or applying aggressive emergency braking (forward vehicle collision mitigation) is already standardized to be present on the CAN bus, but information that would characterize detection and its quality would usually not be present. If the test scenario has only one object and it is a pedestrian or cyclist, then an effective test of detection AND RESPONSE to ped/cycle road users will have been accomplished. We could, even as laypeople, conclude that it works and it's adequate. System response cannot be correct if object detection is not correct.
As an alternative, a "naturalistic driving test" may be performed. This method requires the vehicle to carry an independent system to observe all of the objects on the road, locate them, categorize them, and then try to verify which object the car was actually responding to. More challenging, but possible. In development manufacturers must do something like this.
While OEMs can indeed measure actual sensor performance such as target detection, ranging, tracking, categorization, and identification (what an "Eye Test" should show), they and their suppliers would regard those data as proprietary and not for public release. At least this is my opinion based on nearly 25 years in the automotive industry and a total of 40 years in American industry.
I have deep background in automated automotive features for adaptive cruise control, forward vehicle collision warning systems, and forward vehicle collision mitigation systems among others. My work on these convenience and safety systems spans from writing product requirements, testing and selecting actual sensors for development and for production, writing international standards (ISO standards) to set minimum limits for their performance, and supporting the developmental testing and refinement of a product line of such systems. I was an appointed member of the team of US Experts selected to represent the United States in these proceedings, and for 8 years the lead author of the Forward Vehicle Collision Mitigation Systems standard, ISO 22839:2013. These concepts for what can and cannot be tested publicly on production and production-like vehicles were developed and accepted by the International committee (ISO TC204, on which I served), as far back as 1998.
I feel our request to the Senate would be much better received in the automotive community if we changed it to request a guarantee that appropriate performance requirements for the protection of pedestrians and pedalcyclists shall be written, implemented, tested, and verified for all production vehicles and all road-besed development vehicles.
I have not completed my review of S.1885, but my reading so far suggests that the needs I am trying to articulate are already provided for by the structure of the S.1885 draft you shared with me. I hope to confirm my interpretation this week.
There should be a Docket open for this bill, in which the public could submit comments and see the response to them. Are LMB or LAB using this avenue to provide responses to lawmakers?
Best regards,
Ken Freeman
Member of WBWC
Ann Arbor, MI