APPENDIX C:  Brainstorming Rating Scale Results
Methods for Identifying Medication Use

A. Physician’s Reports (mail requests) E. In-Home Medicine Review 
B. Patient Self-Report (face-to-face)   F. Mailed Survey to Patient
C.  Brown Bag Review   G. Proxy Report
D.  Pharmacy Records (administrative database)   

Practicality

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

Sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

51.5

28.2

10-95

4

51.3

32.8

10-90

3

76.7

17.6

60-95

3

23.33

12.6

10-35

3

55.0

22.9

35-80

B

12

75.8

14.8

50-95

4

76.3

13.8

60-90

2

65.0

21.2

50-80

3

90.0

5

85-95

3

68.3

12.6

55-80

C

12

64.8

18.0

35-90

3

66.7

23.6

40-85

3

66.7

15.3

50-80

3

68.3

29.3

35-90

3

57.3

4.6

52-60

D

13

77.7

18.6

30-95

4

67.5

26.3

30-90

3

76.7

16.1

65-95

3

81.7

15.3

65-95

3

88.3

11.6

75-95

E

13

35.7

22.8

5-79

4

33.8

29.6

5-70

3

31.7

17.6

15-50

3

26.7

16.1

15-45

3

51.3

27.0

25-79

F

13

70.4

21.2

20-95

4

76.3

14.4

55-85

3

71.7

20.8

55-95

3

63.3

37.9

20-90

3

68.3

18.9

55-90

G

10

59.1

18.4

35-90

3

58.3

28.4

35-90

2

67.5

17.7

55-80

2

47.5

10.6

40-55

3

62.0

16.6

50-81

B + G

1

80

--

--

0

--

--

--

1

80

--

--

 

--

--

--

--

--

--

--

B + C + G

1

70

--

--

1

70

--

--

0

--

--

--

 

--

--

--

--

--

--

--

Reliability

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

Sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

61.7

18.3

30-85

4

73.8

9.5

60-80

3

65.0

18.0

50-85

3

65.7

16.8

55-85

3

38.3

10.4

30-50

B

13

63.9

17.0

30-95

4

65.0

12.3

50-75

3

60.0

17.3

50-80

3

56.7

23.6

30-75

3

73.3

20.2

55-95

C

13

81.5

6.9

70-90

4

83.8

9.5

70-90

3

75.0

5.0

70-80

3

83.3

2.9

80-85

3

83.3

5.8

80-90

D

13

69.2

12.6

50-90

4

71.3

15.5

50-85

3

65.0

5

60-70

3

66.3

16.0

50-82

3

73.3

15.3

60-90

E

12

90.0

5.6

75-95

4

92.5

2.9

90-95

2

90.0

0

90-90

3

91.7

2.89

90-95

3

85.0

10.0

75-95

F

12

55.1

15.3

20-75

3

65.0

13.2

50-75

3

51.3

15.2

35-65

3

47.3

23.7

20-62

3

56.7

7.6

50-65

G

11

61.3

26.9

15-95

4

60.0

30.8

15-80

2

74.5

29.0

54-95

2

35.0

14.1

25-45

3

71.7

25.2

45-95

B + G

1

80

--

--

--

--

--

--

1

80

--

--

--

--

--

--

--

--

--

--

A +E

1

95

--

--

--

--

--

--

1

95

--

--

--

--

--

--

--

--

--

--

E + G

1

90

--

--

--

--

--

--

1

90

--

--

--

--

--

--

--

--

--

--

A + B + D

1

100

--

--

--

--

--

--

1

100

--

--

--

--

--

--

--

--

--

--

Cost-Effectiveness

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

64.5

26.8

5-95

4

53.7

33.5

5-80

3

91.0

5.3

85-95

3

56.7

10.4

45-65

3

60.0

32.8

30-95

B

12

66.3

24.1

25-90

3

68.3

37.5

25-90

3

48.3

22.6

25-70

3

85.0

5.0

80-90

3

63.3

15.3

50-80

C

12

59.6

18.9

35-90

3

70.0

18.0

50-85

3

51.7

7.64

45-60

3

60.0

21.8

35-75

3

56.7

28.9

40-90

D

13

78.7

18.4

35-95

4

81.3

4.8

75-85

3

74.3

34.1

35-95

3

68.3

20.2

50-90

3

90.0

5.0

85-95

E

13

40.0

22.4

10-90

4

38.8

19.3

10-50

3

46.7

20.2

35-70

3

25.0

13.2

15-40

3

50.0

36.1

20-90

F

13

78.5

19.7

30-95

4

73.8

30.7

30-95

3

76.7

23.6

50-95

3

81.7

12.6

70-95

3

83.3

10.4

75-95

G

12

62.5

17.5

40-90

4

68.8

21.0

40-90

3

60.0

17.3

50-80

2

57.5

24.8

40-75

3

60.0

17.3

50-80

Overall

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

54.5

19.0

10-75

4

53.8

29.3

10-70

3

56.7

16.1

45-75

3

56.7

23.6

30-75

3

51.3

6.4

44-55

B

12

65.3

17.1

35-80

4

65.0

20.4

35-80

2

67.5

17.7

55-80

3

63.3

24.7

35-80

3

66.3

14.0

52-80

C

13

75.3

13.3

45-85

4

81.3

7.5

70-85

3

82.3

4.6

77-85

3

70.0

21.8

45-85

3

65.7

12.5

57-80

D

11

73.1

12.8

45-85

4

72.5

8.7

60-80

1

45.0

--

--

3

74.7

12.9

60-84

3

81.7

5.8

75-85

E

13

66.4

23.2

30-97

4

57.5

22.2

30-80

3

80.7

16.0

65-97

3

78.3

24.7

50-95

3

52.0

25.0

32-80

F

13

55.9

15.3

25-81

4

60.0

7.1

50-65

3

51.7

12.6

40-65

3

41.7

20.1

25-65

3

68.7

11.0

60-81

G

10

51.2

20.7

20-80

4

53.8

26.9

20-80

1

35.0

--

--

2

37.5

10.6

30-45

3

62.3

16.6

47-80

B + G

1

75

--

--

--

--

--

--

1

75

--

--

--

--

--

--

--

--

--

--

C + D

1

95

--

--

1

95

--

--

--

--

--

--

--

--

--

--

--

--

--

--

A + B + D

1

95

--

--

--

--

--

--

1

95

--

--

--

--

--

--

--

--

--

--

A+ D + E

1

100

--

--

--

--

--

--

1

100

--

--

--

--

--

--

--

--

--

--

B + D + G

1

100

--

--

--

--

--

--

1

100

--

--

--

--

--

--

--

--

--

--

A + B + D + G

1

80

--

--

--

--

--

--

1

80

--

--

--

--

--

--

--

--

--

--

A + B + E + G

1

90

--

--

--

--

--

--

1

90

--

--

--

--

--

--

--

--

--

--