tomorrow wrote on Mon, 04 Mar 2013 05:17:52 -0800:
tomorrow wrote on Mon, 04 Mar 2013 05:17:52 -0800:
>
http://www.nmcti.org/docs/articles/outside/Billheimer_2001.pdf
Thanks for that report.
Like any statistical report, it was both a wealth of knowledge,
and, a confusing array of conflicting datapoints.
There was one dead wrong fact which showed their bias (or ignorance?)
but otherwise, it was a decent, if dated, analysis. I would LOVE to
see the analysis for recent years!
Here are my notes, jotted down as I encountered what they said.
Note: All the lines below are paraphrased accurately from the report itself,
both in tone and in content.
- CMSP was implemented in July 1987.
- CMSP trained 100K bikers by July 1997.
- 840 fatalities in 1986
- 263 fatalities in 1995 (same number roughly as in 2010 & 2011)
- Matched pair studies were performed (which is a good test)
- For novices, the safety effect dropped off after the 1st six months
- For experienced riders, there was no safety effect at all
- The CMSP was formed by Assembly Bill (AB) 412
- AB 55 raised the mandatory training age to include all riders under 21
- AB 229 (Jan 1, 1994) allowed the DL 389 to replace the DMV riding test
- The CHP develops and implements the Program
- CMSP is funded through a $2 per vehicle fee on motorcycle registration
- That fee collected 1.6 million dollars in 2012
- Out of 9 studies, only 2 concluded training reduces accidents
- The differences were not large even for those two studies
- Earlier studies showed that untrained riders had lower accident rates
- But those studies weren't normalized
- When normalized, the earlier studies could not conclude either way
- Some studies found fewer violations, others more, among the trained riders
- Trained riders use helmets and reflectorized jackets more often
- None of the studies is reliable because all suffer from 8 serious problems
- They are: (1) inconsistency (2) bias (3) lack of normalizing
(4) experienced riders are over represented
(5) sample sizes are not statistically valid
(6) no difference after the 1st year of riding
(7) trained novices ride more than untrained novices so they get hurt more
(8) weather, mountains, unlicensed riders, etc. screw up the data
- Accidents were compared from 1977-1986 and 1987-1995
- Up until 1969 fatalities were much greater when normalized against registration
- From 1970 to 1994, fatalities basically track registrations
- There was a dip with CMSP in 1987 and the helmet law in 1991
- Both these dips were statistically significant
- Motorcycle accident rates were dropping in the US before the CMSP started
- Also there was a 'precipitous decline' in motorcycle registrations
- Also 'baby boomers' were aging
- So it's hard to say really what is going on with accident rates
- If you compare California with the rest of the USA, the Californians
consistently have more accidents per 1000 registrations from 1978 to 1993.
- In 1994 Californians start to have the same number of accidents per
1000 registrations as everyone in the rest of the USA has
- Since California started higher and ended at the same point in 1993
(and even lower in 1994) than the rest of the USA, the accident rates
have actually declined faster than the rest of the USA
- California's overall motorcycle accident rate dropped 22% while the rest
of the U.S. dropped 17% (which made California about equal in 1993, and
slightly lower in 1994)
- The annual "safety" savings of $113 million is 80 times the cost of the
program (which is dead wrong because they didn't factor in the price of the
class which is over one hundred times the cost of the DMV registration fee).
- Riders were matched by age, sex, experience, miles, and purpose
- Those matched pairs were tested for 5 things
- Trained riders ride 5,500 miles in the 1st year
- Untrained riders ride 4,300 miles during the 1st year
- So accidents per year are skewed higher than accidents per mile
- Accidents were reduced for 6 months after the CMSP class
- This difference was marked for novices who rode less than 500 miles
- Accidents were actually higher for the experienced riders after the CMSP class
- This difference was for those who rode more than 500 miles in those 6 months
- But this wasn't statistically significant, so, those who rode more than
500 miles in the 1st six months after the class had essentially the same
number of accidents as people who never took the class
- The same trend reveals itself at the 1st year after the class
- Novices (<1,000 miles/year) have lower accident rates while experienced
(>1,000 miles/year) actually show higher accident rates than untrained people
- Again, it's not statistically significant, so the conclusion is that, after
1 year, the novice riders (<1,000miles/year) show lower rates while
experienced riders (>1,000 miles/year) show the same rate as untrained people
- Two years after training, there is no difference in any rider's accident rate
- All groups (trained or untrained) show high rates of accidents in the
first 500 miles.
- At the same time as the study, California instituted these safety programs
(1) Motorist awareness (2) Unlicensed riders (3) DUI riding
- After all the inconsistent measurements, the final sentence concludes (verbatim):
"By any measure, the CMSP is a cost-effective Program that pays for itself
many times over in saved lives and reduced accident rates."
I think this was a great study, and I learned a lot.
My key worries are:
a) It's old (it would be nice to have a newer report)
b) Typical of government, they understate the costs ($2) they receive
by over 100 times, because they ignore the true cost ($250) the user pays
c) They basically concluded both that the CMSP is effective and ineffective
in the same breath in that the accident rates are basically identical for
trained riders as for untrained riders, IF ... and this is important ...
IF the rider rides at the rate of more than 1,000 miles per year.
However, they did unambiguously conclude that a novice rider (defined as
one who rides less than 1,000 miles per year), had a lower accident rate
for the first year, and then everyone (trained or untrained) had the same
accident rate for the rest of their lives.
In summary, thank you for the wonderful report.
It's rare to see only one egregious error in any government report, so
I'd say this was a good one, as these reports go.
I just wish it wasn't a decade old so we could see the latest trends.