|
Content
Sample Design
Sample
Construction
Screening
to Determine Household Eligibility
Selection of Respondent Within Household
Young
Adult Oversample
Initial
Contact
Spanish
Language Interviews
Refusal
Conversion
Field
Outcomes
Sample
Weighting
Precision
of Sample Estimates
Estimating
Statistical Significance
Statistical
Comparisons Between Samples
References
Technical
Report Documentation
APPENDIX
A1: English Language Questionnaire Version 1
APPENDIX A2: English
Language Questionnaire Version 2
APPENDIX B1: Spanish Language
Questionnaire Version 1
APPENDIX
B2: SPANISH Language
Questionnaire Version 2
|
Field
Outcomes
Survey data collection
by the Federal government requires prior approval by the Office of Management
and Budget (OMB). Before submitting the formal request for data collection
to OMB, NHTSA published a Notice in the Federal Register soliciting comments
on the information collection. The Notice appeared in the Federal Register,
63:50, pages 12858-12859, March 16, 1998. The closing date for comments
was May 15, 1998. No comments were received in response to the Notice.
NHTSA then submitted the request for data collection to OMB June 29, 1998.
OMB approved the information collection September 9, 1998, assigning it
the OMB number 2127-0596 with and expiration date of December 31, 1999.
The field interviewing
for the study commenced on November 5, 1998, following training of the
field interviewers, and was completed on January 12, 1999. This is approximately
the same time period in which the 1996 Occupant Protection Survey (November
4, 1996 to January 5, 1997) and the 1994 Occupant Protection Survey (October
5, 1994-December 11, 1994) were conducted. Status of cases as of the end
of the field period are reported using the categories defined below.
FIGURE 4
Sample Disposition Categories
|
|
NIS/DIS/change#
|
The number was not in service,
had been disconnected, or yielded a recording indicating that
it was no longer an active number
|
|
Non-residential
|
The number yielded a contact
with a business, government agency, pay telephone, or other
non-residential unit
|
|
Computer/fax
|
The number yielded an electronic
tone indicating a fax machine or data line
|
|
Pre-screened NIS/DIS
|
Automated dialer used to
pre-screen numbers that are no longer in service or disconnected
prior to that number being included in the sample
|
|
SSI Business Numbers
|
Pre-screened phone numbers
through Survey Sampling Inc. that pre-identifies a place of
business before actual dialing begins.
|
|
No answer
|
The number rang, but no one
answered. The protocol required five calls to non-answering
numbers.
|
|
Busy
|
A busy signal was encountered
|
|
Answering machine
|
An answering machine was
reached at the telephone number
|
|
Language
|
The interview could not be
completed because of language barriers
|
|
Not Available
Health/Deaf/Deceased
|
Those unable to participate
due to death, self-defined health reasons, or deafness
|
|
Away for duration
|
The designated respondent
was out of the area for the entire field period
|
|
Callback
|
Contact was made with the
household, but not necessarily the designated respondent.
By the end of the field period, the case had neither yielded
a refusal or completed interview
|
|
Callback to complete
|
The interview was interrupted,
but not terminated. The field period ended before the full
interview could be completed
|
|
Refusal -- Initial
|
Someone in the household
refused to participate in the study
|
|
Refusal -- Second
|
During a refusal conversion
attempt, a second refusal to participate in the study was
encountered
|
|
Screen Outs
|
Households whose eligible
participants had met the gender and/or age quotas by Region
|
|
Terminate
|
A respondent began the interview
but refused to finish
|
|
Complete
|
An interview was completed
with the designated respondent
|
|
For survey Version
1 - Seat Belt Usage Issues, a total of 30,620 randomly selected telephone
numbers were sampled within a geographically stratified national sampling
frame for both sample components (the cross-section of youth and adults
age 16 and older and the oversample of persons age 16-39):
-
59% of the numbers
were not active residential phone numbers, including 32% Pre-screened
NIS/DIS; 10% NIS/DIS/Change#/Wrong# after the number was dialed; 7%
SSI Pre-screened Business Numbers; and 3% computer or fax tones;
-
7% of the numbers
were no answers (despite repeated attempts) and 2% were answering
machines; and
-
2% were households
in which the designated respondent was not interviewable (not available;
away for an extended period, incapacitated, or deaf) and an additional
1% were non-interviewable due to language barriers (non-Spanish).
At the close of the
field period, only 521 cases (2%) were in callback status.
The participation
rate represents one of the most critical measures of potential sample
bias because it indicates the degree of self-selection by potential respondents
into or out of the survey. The participation rate is calculated as the
number of completed interviews (including respondents who screen out as
ineligible) divided by the combined total number of completed interviews,
terminated interviews, and refusals to interview. (The inclusion of screen
outs in the numerator and denominator is mathematically equivalent to
discounting the refusals by the estimated rate of non-eligibility among
refusals.) The participation rate for Version 1 is based on the following
elements:
-
4,094 completed
interviews;
-
2,436 cases in
which someone in the household completed the household screen, but
no one in the household was found to be eligible for the full interview
(2362 were age-related screen-outs among the age 16-39 oversample);
and
-
1,627 refusals
to be interviewed (including 1220 second refusals) and 43 terminated
interviews.
Based on the standard
calculations of participation rate, as defined by the Council of Applied
Statistical Research Organizations (CASRO), the participation rate for
Version 1 was 79.6%. This formula treats the numerator as all respondents
who participate by completing required survey questions, while the denominator
includes those who complete required questions, those who begin but terminate
before completing all required questions, and those who refuse entirely.
The Final Summary
Disposition of the Version 1 sample is given in Table 3. The table includes
breakouts for each survey component (national youth and adult cross-section
and the age 16-39 oversample). The average interview length for Version
1 was 22.7 minutes.
TABLE 3
Sample Disposition:
Version 1, Seat Belt Usage Issues
|
| |
CROSS-
SECTION |
OVER-
SAMPLE |
TOTAL |
| TOTAL NUMBERS
DIALED |
16891 |
13729 |
30620 |
| NIS/Dis/Change#/Wrong# |
1794 |
1331 |
3125 |
| Non-residential |
1137 |
924 |
2061 |
| Computer/fax |
525 |
420 |
945 |
| Prescreened
NIS-DIS |
5440 |
4364 |
9804 |
| SSI Business
Numbers |
1228 |
1012 |
2240 |
| Other
Reason Terminating |
11 |
4 |
15 |
| No Answer |
1164 |
968 |
2132 |
| Answering
Machine |
342 |
310 |
652 |
| Busy |
106 |
49 |
155 |
| Callback |
315 |
206 |
521 |
| Not Available |
30 |
114 |
144 |
| Language |
146 |
77 |
223 |
| Health/Deaf/Deceased |
236 |
61 |
297 |
| Away for
Duration |
72 |
31 |
103 |
| Refusals
-- Initial |
228 |
179 |
407 |
| Refusals
-- Second |
935 |
285 |
1220 |
| Total
Contacts |
3180 |
3393 |
6573 |
| Screen
out |
74 |
2362 |
2436 |
| Total
Qualified |
3106 |
1031 |
4137 |
| Callback
to Complete |
0 |
0 |
0 |
| Terminates |
35 |
8 |
43 |
| Completes |
3071 |
1023 |
4094 |
| Participation
Rate |
72.4% |
87.8% |
79.6% |
For survey Version
2 - Child Safety Seat Issues, a total of 29,592 randomly selected
telephone numbers were sampled within a geographically stratified national
sampling frame for both sample components (the cross-section of youth
and adults age 16 and older and the oversample of persons age 16-39):
-
59% of the numbers
were not active residential phone numbers, including 31% Pre-screened
NIS/DIS; 10% NIS/DIS/Change#/Wrong# after the number was dialed; 8%
SSI Pre-screened Business Numbers; and 3% computer or fax tones;
-
6% of the numbers
were no answers (despite repeated attempts) and 2% were answering
machines; and
-
3% were households
in which the designated respondent was not interviewable (not available;
away for an extended period, incapacitated, or deaf) and an additional
1% were non-interviewable due to language barriers (non-Spanish).
At the close of the
field period, there were 235 cases (1%) in callback status.
The participation
rate for Version 2 is based on the following elements:
-
4,121 completed
interviews;
-
2,693 cases in
which someone in the household completed the household screen, but
no one in the household was found to be eligible for the full interview
(2,614 were age-related screen-outs among the age 16-39 oversample);
and
-
1,538 refusals
to be interviewed (including 1024 second refusals) and 40 terminated
interviews.
Based on the standard
calculations of participation rate, the participation rate for Version
2 was 81.2 percent.
The Final Summary
Disposition of the Version 2 sample is given in Table 4, on the next page.
The table includes breakouts for each survey component (national youth
and adult cross-section and the age 16-39 oversample). The average interview
length for Version 2 was 16.3 minutes.
TABLE 4
Sample Disposition:
Version 2, Child Safety Seat Issues
|
| |
CROSS-
SECTION |
OVER-
SAMPLE |
TOTAL |
| TOTAL NUMBERS
DIALED |
15711 |
13881 |
29592 |
| NIS/Dis/Change#/Wrong# |
1478 |
1494 |
2972 |
| Business# |
1061 |
909 |
1970 |
| Computer/Fax
Tone |
488 |
421 |
909 |
| Prescreened
NIS-DIS |
4930 |
4372 |
9302 |
| SSI Business
Numbers |
1254 |
986 |
2240 |
| Other
Reason Terminating |
16 |
15 |
31 |
| No Answer |
1056 |
836 |
1892 |
| Answering
Machine |
275 |
211 |
486 |
| Busy |
70 |
38 |
108 |
| Callback |
164 |
71 |
235 |
| Not Available |
306 |
210 |
516 |
| Language |
109 |
74 |
183 |
| Health/Deaf/Deceased |
208 |
62 |
270 |
| Resp.
Away for Duration |
54 |
25 |
79 |
| Refusals |
361 |
153 |
514 |
| Second
Refusals |
687 |
337 |
1024 |
| Total
Contacts |
3190 |
3664 |
6854 |
| Screen
out |
79 |
2614 |
2693 |
| Total
Qualified |
3111 |
1050 |
4161 |
| Callback
to Complete |
0 |
0 |
0 |
| Terminates |
28 |
12 |
40 |
| Completes |
3083 |
1038 |
4121 |
| Participation
Rate |
74.6% |
87.9% |
81.2% |
|