APPENDIX F: Brainstorming Rating Scale Results
Methods of Measuring Driving Performance

A. Closed Course    E.  Simulation: Level 1
B. On-the Road (in Traffic) F. Instrumented Vehicle (Driver’s own car)
C.  Simulation: Level 3 G. Functional Measures Validated as Crash Predictors
D.  Simulation: Level 2  
   

Practicality

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

64.6

16.6

35-90

5

60.0

17.7

35-80

3

70.0

26.5

40-90

2

67.5

10.6

60-75

3

65.0

13.2

55-80

B

13

62.7

19.5

25-100

5

63.0

22.0

25-80

3

71.7

30.1

40-100

2

47.5

3.5

45-50

3

63.3

7.6

55-70

C

13

39.0

26.6

5-77

5

49.4

34.2

5-77

3

28.3

17.6

10-45

2

20.0

21.2

5-35

3

45.0

22.9

20-65

D

13

54.3

23.1

15-75

5

60.2

26.3

15-80

3

33.3

16.1

15-45

2

72.5

10.6

65-80

3

53.3

20.8

30-70

E

13

58.0

23.0

25-80

5

68.8

19.7

35-85

3

38.3

15.3

25-55

2

55.0

42.4

25-85

3

61.7

18.9

40-75

F

12

55.8

23.5

10-85

4

55.0

23.8

30-80

3

65.0

15.0

50-80

2

25.0

21.2

10-40

3

68.3

20.8

45-85

G

13

74.8

15.4

45-95

5

75.4

17.5

45-90

3

71.7

2.9

70-75

2

77.5

24.8

60-95

3

75.0

21.8

50-90

Reliability

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

14

67.9

20.8

15-95

5

66.0

18.2

40-90

3

46.7

28.4

15-70

3

80.0

0

80-80

3

80.0

15.0

65-95

B

14

71.4

20.5

25-95

5

74.0

14.3

55-95

3

63.3

25.7

35-85

3

61.7

32.2

25-85

3

85.0

10.0

75-95

C

14

67.4

13.9

45-90

5

69.8

9.5

60-85

3

61.7

17.6

45-80

3

61.7

15.3

45-75

3

75.0

18.0

55-90

D

14

57.9

17.6

15-85

5

66.0

8.2

60-80

3

55.0

15.0

40-70

3

40.0

22.9

15-60

3

65.0

20.0

45-85

E

14

51.1

19.3

10-75

5

63.0

7.0

57-75

3

48.3

12.6

35-60

3

28.3

23.6

10-55

3

56.7

20.2

35-75

F

13

72.3

13.8

45-87

4

75.8

3.0

73-80

3

63.3

17.6

45-80

3

67.3

21.1

45-87

3

81.7

7.6

75-90

G

14

70.1

10.9

45-85

5

76.4

7.7

65-85

3

70.0

8.7

60-75

3

65.0

8.7

55-70

3

65.0

18.0

45-80

A + G

1

75

--

--

--

--

--

--

1

75

--

--

--

--

--

--

--

--

--

--

B + G

1

90

--

--

--

--

--

--

1

90

--

--

--

--

--

--

--

--

--

--

 Cost-Effectiveness

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

60.8

15.1

30-80

5

64.0

20.7

30-80

3

58.3

18.9

45-80

2

60.0

14.1

50-70

3

58.3

2.9

55-60

B

13

58.6

14.4

25-85

5

60.4

6.4

52-65

3

63.3

22.6

40-85

2

42.5

24.8

25-60

3

61.7

5.8

55-65

C

14

30.1

23.7

1-60

5

33.0

29.3

5-75

3

17.0

20.4

1-40

3

25.3

22.4

1-45

3

43.3

20.8

20-60

D

14

40.7

23.9

15-85

5

49.0

30.9

20-85

3

25.0

17.3

15-45

3

33.3

20.2

15-55

3

50.0

18.0

30-65

E

14

51.1

27.6

10-95

5

58.2

27.7

31-90

3

31.7

16.1

20-50

3

38.3

27.5

10-65

3

71.7

28.4

40-95

F

13

63.0

19.2

35-95

4

71.8

14.2

55-85

3

65.0

17.3

45-75

3

44.0

10.2

35-55

3

68.3

27.5

40-95

G

13

76.5

11.0

55-95

4

79.3

10.6

72-95

3

73.3

10.4

65-85

3

79.3

9.3

73-90

3

73.3

17.6

55-90

Overall

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

58.7

17.5

20-75

5

54.0

17.5

30-75

2

47.5

38.9

20-75

3

65.0

10.0

55-75

3

67.7

2.1

66-70

B

13

67.5

18.8

17-85

5

68.0

14.4

45-80

2

85.0

0

85-85

3

52.3

32.2

17-80

3

70.3

0.6

70-71

C

14

43.1

17.2

10-75

5

38.0

17.5

10-55

3

41.7

20.2

30-65

3

40.7

10.1

30-50

3

55.7

21.8

32-75

D

14

44.6

18.3

15-77

5

44.4

9.5

35-60

3

36.7

20.2

25-60

3

40.0

27.8

15-70

3

57.3

21.1

35-77

E

14

40.1

21.2

10-80

5

44.0

16.7

25-70

3

23.3

5.8

20-30

3

28.3

20.2

10-50

3

62.3

22.5

37-80

F

13

68.0

16.9

25-90

4

70.0

10.8

55-80

3

71.7

12.6

60-85

3

56.0

27.6

25-78

3

73.7

18.2

54-90

G

12

64.0

18.8

30-85

5

72.0

12.2

58-85

2

45.0

7.1

40-50

3

61.7

28.4

30-85

2

66.5

23.3

50-83

A + B + G

1

100

--

--

--

--

--

--

1

100

--

--

--

--

--

--

--

--

--

--

B + F + G

1

95

--

--

1

95

--

--

--

--

--

--

--

--

--

--

--

--

--

--