5. PROGRAM EVALUATION (continued)

5.2.2 Survey Response Characteristics

Overall, 60.9 percent of the mailed surveys that were delivered as addressed were completed and returned. A slightly higher percentage of follow-on surveys (62.7%) were returned than of pre-program surveys (59.1%). Approximately the same proportion of returns was received from Phoenix (61.9%) as from Peoria (60.1%). Table 24 shows the number of returns for both waves and both cities as well as the percentage of delivered survey forms that were completed and returned.

Table 24. Survey Returns as a Percentage of Surveys Delivered (All Neighborhoods)

Survey wave

Sent/Received

Phoenix

Peoria

Total

Pre-Program

Surveys Sent

686

783

1469

Surveys Received

413

455

868

Percent Received

60.2%

58.1%

59.1%

Follow-On

Surveys Sent

733

779

1512

Surveys Received

465

483

948

Percent Received

63.4%

62%

62.7%

Total

Surveys Sent

1419

1562

2981

Surveys Received

878

938

1816

Percent Received

61.9%

60.1%

60.9%


Of the first wave of survey returns, 96 (50 from Phoenix and 46 from Peoria ) were received after the publicity and enforcement programs had started in the two cities. They were separated from the pre-program returns and identified in the database as “late returns” in order to be able to examine this small group of returns for possible changes in exposure to program activities.

The resultant study samples by survey wave are shown in Table 25. This table shows a remarkable consistency in returns for each wave for each city, that is, pre-program returns were 41.3 percent of returns in Phoenix and 43.6 percent in Peoria, late returns were 5.7 percent of the returns in Phoenix and 4.9 percent in Peoria, and follow-on returns were 53 percent of returns in Phoenix and 51.5 percent of returns in Peoria.

The survey form used in both cities is shown in Appendix D. It consisted of eight questions that asked the following of neighborhood residents:

  1. Are you aware of any recent activities to control speeds in your neighborhood?

  2. Did any of these activities include any publicity? If yes, what publicity?

  3. Were the police involved in any of these activities? If yes, what activities?

  4. Did any of these activities include any physical changes to the road or the physical environment? If yes, what changes?

  5. Compared to 6 months ago, how would you rate the speeds in your neighborhood – much slower, a bit slower, the same, a bit faster, much faster?

  6. How long have you lived in your current neighborhood – less than 1 year, 1 to 5 years, more than 5 years?

  7. What is your age?

  8. What is your gender?


Table 25. Survey Returns From Each City by Wave (All Neighborhoods Combined)

Survey Wave
City
Phoenix

Peoria

Total

Pre-Program

Count

363

409

772

Row %

47%

53%

100%

Column %

41.3%

43.6%

42.5%

Late Return

Count

50

46

96

Row %

52.1%

47.9%

100%

Column %

5.7%

4.9%

5.3%

Follow-On

Count

465

483

948

Row %

49.1%

50.9%

100%

Column %

53%

51.5%

52.2%

Total

Count

878

938

1816

Row %

48.3%

51.7%

100%

Column %

100%

100%

100%


Thus, the survey provided information on the following:

  • Awareness of activities to control speeds in the six neighborhoods
  • Specific awareness of:
    • Publicity activities
    • Police activities
    • Roadway treatments
  • Perceived changes in vehicle speeds in the neighborhoods

  • Description of the responders
    • Time lived in the neighborhood
    • Age
    • Gender

A database was created that documented the answers of each survey respondent. Each publicity/police/roadway event or activity that was specified by the respondent was post-coded to indicate whether the activity was perceived to be “definitely program-related,” “probably program-related,” or “not program-related (or program relation was unknown).” Assignment of these codes and the resulting analysis were therefore conservative because they were based on unaided recall of the Heed the Speed program and a high threshold for assuming a program relationship when post coding. As an example, comments that the respondent had seen police ticketing or general mentions of hearing messages were coded as “probably program-related,” although it is likely that most of the police enforcement and media efforts during the program period were program-related. Likewise, a mention of 3-D paint on the road or yellow signs was judged to be “definitely program related.”

Two additional subjective post codes were entered in the database. One provided an indication of whether or not the respondent had referred to the Heed the Speed program by name. For the second, each respondent was assigned one of three codes depending on whether the survey form as a whole indicated that the respondent had definitely been exposed to the program, had probably been exposed to the program or had not been exposed to the program.

An initial examination was made of the returns to determine if the late returns should be maintained as a separate file, combined with the pre-program or follow-on returns, or eliminated from the analysis. For this examination, responses to two survey questions were explored – respondent awareness of speed control activities and exposure to the Heed the Speed program.

The first survey question asked respondents if they were aware of any recent activities to control speeds in their neighborhoods. The responses for both cities are given in Table 26, which shows significant differences between survey waves for both cities.

In both Phoenix and Peoria , the table shows a significant increase in awareness of activities from pre-program data to late returns to follow-on data. It is interesting to note that approximately two-fifths of the respondents in both cities reported being aware of activities to control speeds in their neighborhoods before the program started. In Phoenix , 44.1 percent of the pre-program returns indicated awareness of activities, 74 percent of late returns, and 84.5 percent of follow-on returns. In Peoria , these data were 41.6 percent, 58.7 percent, and 82 percent, respectively. The data for late returns likely indicate a building exposure to program activities in the two cities.

Table 26. Awareness of Activities to Control Speeds in Neighborhoods
by Study Wave and City ( Phoenix and Peoria )

Awareness of Activities to Control Speeds

Phoenix *

Peoria **

Pre-Program

Late Return

Follow-On

Pre-Program

Late Return

Follow-On

 

Yes

Count

160

37

393

170

27

395

Row %

27.1%

6.3%

66.6%

28.7%

4.6%

66.7%

Column %

44.1%

74%

84.5%

41.6%

58.7%

82%

 

No

Count

203

13

72

239

19

87

Row %

70.5%

4.5%

25%

69.3%

5.5%

25.2%

Column %

55.9%

26%

15.5%

58.4%

41.3%

18%

 

Total

Count

363

50

465

409

46

482

Row %

41.3%

5.7%

53%

43.6%

4.9%

51.4%

Column %

100%

100%

100%

100%

100%

100%

* Phoenix chi square significance = .000
** Peoria chi square significance = .000


Table 27 shows whether or not the respondent was judged to have been exposed to the Heed the Speed program. The table shows that only one of the pre-program respondents had probably been exposed to the program. However, 22 percent of the respondents who sent in late returns from Phoenix had probably or definitely been exposed to the program as had 19.6 percent of the late returns from Peoria . These data, though small in number, appear to indicate that awareness of the program was already present in the late return data. By the time of the follow-on survey, 69.5 percent of the Phoenix residents had probably or definitely been exposed to the program as had 70.8 percent of the Peoria respondents.

Table 27. Respondent Exposure to the Heed the Speed Program ( Phoenix and Peoria )

Was Respondent Exposed to the Heed the Speed Program?

Phoenix *

Peoria **

Pre-program

Late return

Follow-on

Pre-program

Late return

Follow-on

Yes, Definitely

Count

0

5

261

0

4

210

Row %

0%

1.9%

98.1%

0%

1.9%

98.1%

Column %

0%

10%

57.2%

0%

8.7%

43.5%

Yes, Probably

Count

1

6

56

0

5

132

Row %

1.6%

9.5%

88.9%

0%

3.6%

96.4%

Column %

.3%

12%

12.3%

0%

10.9%

27.3%

No

Count

362

39

139

409

37

141

Row %

66.9%

7.2%

25.7%

69.7%

6.3%

24%

Column %

99.7%

78%

30.5%

100%

80.4%

29.2%

Total

Count

363

50

456***

409

46

483

Row %

41.8%

5.8%

52.5%

43.6%

4.9%

51.5%

Column %

100%

100%

100%

100%

100%

100%

* Phoenix chi square significance = .000
** Peoria chi square significance = .000
***Nine follow-on period surveys in Phoenix had insufficient information to determine program exposure and were therefore deleted from the original sample of 465.

As indicated previously, the number of late returns was quite small. The foregoing tables, however, suggest that the late returns were somewhat different from both the pre-program and program samples. Since there was an insufficient number of late program returns to support analyses of meaningful subsets (e.g., gender, neighborhood) and it was inappropriate to combine them with either the pre-program or program data, they were omitted from further analyses. Subsequent tables therefore include only pre-program and follow-on data.

The information obtained from the surveys is presented in the following paragraphs. Unless otherwise noted, when no data were provided for a given item, the record for that item has been excluded from the summary tables. Significant associations were tested for selected survey results by means of the chi-square test. Differences reaching the 0.05 level of significance or less are noted.