APPENDIX D: Brainstorming Rating Scale Results
Methods of Measuring Compliance to the Medication Regime

A. Physicians’ Clinical Judgment    E. Pill Counts 
B. Self-Report (Questionnaire)   F. Pharmacy Records (admin. databases)
C.  Patient’s Clinical Response  G. Electronic Medication Monitoring
D.  Biomechanical Measures H. Proxy Report

Practicality

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

Range

n

mean

sd

range

n

mean

sd

range

A

13

46.4

30.2

1-85

5

63.2

36.6

1-90

2

8.0

9.9

1-15

3

38.7

19.5

25-61

3

51.7

7.6

45-60

B

13

73.5

15.0

50-97

5

75.0

13.2

55-90

2

60.0

14.1

50-70

3

78.0

17.5

60-95

3

75.7

19.1

60-97

C

13

44.2

27.1

5-97

5

44.6

30.2

5-70

2

17.5

3.5

15-20

3

41.7

20.2

30-65

3

64.0

29.6

40-97

D

14

27.4

21.1

5-75

5

25.6

20.8

5-58

3

35.0

35.0

10-75

3

18.7

7.6

12-27

3

31.7

22.6

10-55

E

14

49.7

21.0

20-90

5

51.0

25.8

30-90

3

45.0

20.0

25-65

3

33.7

11.9

20-41

3

68.3

5.8

65-75

F

14

71.0

18.4

25-100

5

74.0

8.9

65-85

3

49.0

25.1

25-75

3

72.3

11.7

62-85

3

86.7

12.6

75-100

G

14

45.0

23.4

15-97

5

50.4

18.8

25-70

3

40.0

18.0

20-55

3

20.3

5.0

15-25

3

65.7

28.9

40-97

H

9

64.9

17.9

22-80

3

72.3

6.8

67-80

1

75.0

--

--

3

52.3

29.1

22-80

2

67.5

3.5

65-70

A + C

1

80

--

--

--

--

--

--

1

80.0

--

--

 

--

--

--

--

--

--

--

B + F

1

80

--

--

--

--

--

--

1

80.0

--

--

 

--

--

--

--

--

--

--

B + H

1

90

--

--

--

--

--

--

1

90.0

--

--

 

--

--

--

--

--

--

--

Reliability

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

34.8

29.4

1-85

4

31.5

33.5

1-75

3

35.0

43.6

5-85

3

38.7

36.7

10-80

3

35.0

15.0

20-50

B

13

61.0

18.2

21-95

4

63.8

9.5

50-70

3

65.0

13.2

50-75

3

46.0

25.5

21-72

3

68.3

23.6

50-95

C

13

60.2

30.4

5-95

4

32.5

32.0

5-65

3

60.0

30.0

30-90

3

72.3

15.8

55-86

3

85.0

13.2

70-95

D

13

76.5

12.3

55-95

4

82.5

8.7

75-95

3

73.3

18.9

60-95

3

68.3

12.6

55-80

3

80.0

8.7

70-85

E

13

69.2

17.1

25-90

4

71.3

11.1

55-80

3

53.3

25.7

25-75

3

78.3

7.6

70-85

3

73.3

17.6

55-90

F

13

63.1

16.4

25-90

4

57.5

23.3

25-80

3

56.7

7.64

50-65

3

65.0

8.7

60-75

3

75.0

18.0

55-90

G

13

71.6

19.9

25-90

4

76.3

18.0

50-90

3

50.0

25.0

25-75

3

87.0

3.0

84-90

3

71.7

12.6

60-85

H

8

63.6

20.7

27-80

2

72.5

3.5

70-75

2

77.5

3.5

75-80

2

38.5

16.3

27-50

2

66.0

20.7

45-87

B + F

1

85.0

--

--

--

--

--

--

1

85.0

--

--

--

--

--

--

--

--

--

--

B + G + H

1

85.0

--

--

--

--

--

--

1

85.0

--

--

 

--

--

--

--

--

--

--

Cost-Effectiveness

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

44.5

29.9

1-80

4

57.8

38.1

1-80

3

43.3

34.0

5-70

3

20.7

9.8

15-32

3

51.7

25.7

30-80

B

12

79.0

12.8

50-90

4

86.3

4.8

80-90

2

62.5

17.7

50-75

3

81.0

8.5

73-90

3

78.3

16.1

60-90

C

13

40.9

24.1

1-90

4

36.5

30.5

1-75

3

30

20

10-50

3

43.3

15.3

30-60

3

55.0

30.4

35-90

D

13

26.2

13.9

5-45

4

28.8

19.3

10-55

3

28.3

17.6

10-45

3

20.0

13.2

5-30

3

26.7

5.8

20-30

E

13

59.6

16.9

20-80

4

63.8

13.2

45-75

3

53.3

11.6

40-60

3

51.7

27.5

20-70

3

68.3

16.1

50-80

F

13

76.2

16.0

50-95

4

76.3

19.3

50-95

3

75.0

0

75-75

3

20.7

9.3

10-27

3

90.0

8.7

80-95

G

13

47.1

21.5

10-95

4

46.3

14.9

25-60

3

53.3

2.9

50-55

2

80.0

7.1

75-85

3

68.3

23.6

50-95

H

6

75.8

8.6

60-85

1

80

--

--

1

75

--

--

--

--

--

--

2

70.0

14.1

60-80

B + F

1

95

--

--

--

--

--

--

1

95

--

--

--

--

--

--

--

--

--

--

B + H

1

85

--

--

--

--

--

--

1

85

--

--

--

--

--

--

--

--

--

--

Overall

Method

All Experts

Physicians & Pharmacologists

Driving Evaluators

Behavioral Researchers

Database Experts

 

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

n

mean

sd

range

A

13

39.5

28.5

5-85

4

38.8

37.1

5-80

3

43.3

36.9

15-85

3

36.7

37.5

15-80

3

39.7

4.5

35-44

B

12

68.2

17.4

25-92

4

73.8

7.5

70-85

2

62.5

17.7

50-75

3

59.0

29.7

25-80

3

73.7

16.5

60-92

C

12

52.4

28.5

5-92

4

31.3

32.0

5-75

2

37.5

10.6

30-45

3

75.7

11.0

65-79

3

67.3

21.9

50-92

D

13

38.2

18.2

10-75

4

28.8

17.5

10-50

3

50.0

22.9

30-75

3

31.7

18.9

10-45

3

45.3

10.5

25-56

E

13

64.2

17.1

30-92

4

65.0

12.3

50-75

3

46.7

20.8

30-70

3

71.7

12.6

60-85

3

73.0

16.5

62-92

F

12

65.9

19.2

30-92

4

68.8

14.4

50-80

2

47.5

17.7

35-60

3

60.0

26.0

30-75

3

80.3

12.6

67-92

G

13

57.8

21.1

25-92

4

57.5

16.6

40-80

3

50.0

17.3

30-60

3

51.7

34.0

25-90

3

72.0

18.7

55-92

H

6

60.8

16.7

33-75

1

75

--

--

1

65

--

--

2

41.5

12.0

33-50

2

71.0

8.5

65-77

B + F

2

92.5

3.5

90-95

1

95

--

--

1

90

--

--

--

--

--

--

--

--

--

--

C + H

1

90

--

--

--

--

--

--

1

90

--

--

--

--

--

--

--

--

--

--

B + G + H

1

100

--

--

--

--

--

--

1

100

--

--

--

--

--

--

--

--

--

--