I don’t need to tell you that the two-year anniversary of the quake is coming up. As I wrote about previously, Gerry is well aware of it, and is fast trying to turn what many people from Christchurch would describe as an example of torpid mismanagement into a PR win. His latest attempt is an optimistically titled press release, “Wellbeing survey reveals positive outlook“. Gerry has hand picked some stats that suggest that every thing down here is going just swimmingly. For those of us that don’t just read headlines, you can actually dive in and read the full survey. It’s not exactly as Gerry says.
The key to this survey is in the methodology. It was undertaken between August 29 and October 15 last year. 2381 people responded to the survey. 1156 of them were from Christchurch City, 618 from Selwyn District and 607 from Waimakariri District. So that means that of the people who did respond, more than half (1225) aren’t actually from Christchurch. I mean no disrespect to the people of Rolleston, Lincoln, Rangiora, Kaiapoi etc. I am sure they have had a hard time. But they don’t have the same issues that people who actually live in the city do. They haven’t had to deal with a lack of services, portaloos, red zoning, TC3 land, roadworks to the same extent that people who live in the city do.
The response rate to this survey was barely half – 52%. I would hazard a guess that if you were in the battered East of Christchurch, struggling through two snow falls in an broken shell of a house, answering some questions from CERA were lower on your list of things to do than they might have been for someone living on a lifestyle block in West Melton.
The survey does actually acknowledge this discrepancy, as early as Page 3:
As an overall observation:
Residents of Christchurch City rate their quality of life less positively than residents of Selwyn District and Waimakariri District
Higher proportions of Christchurch City residents have experienced issues as a result of the earthquakes that have had a strong negative impact on their everyday lives.
Yet the survey then merges these three population groups, and continues to extrapolate from the combined population for another 100 pages. If you get to the end of the report, you’ll find the populations of Christchurch, Selwyn and Waimakariri. They are 289,000, 30,000 and 36,000 respectively. More than 80% of the adult population lives in Christchurch, and yet more than 50% of respondents come from less than 20% of the population, a section of the population that the survey shows have a more positive response in this survey. In the appendix to the report, it says that the survey has been “weighted” to factor in this bias. As it does not explain how, I remain dubious.*
Lies, damn lies, and statistics.
The Herald pretty much ran the press release from CERA without digging down into the numbers. There is this sentence, for example:
When asked about their confidence in Cera’s decision-making, 68 per cent of respondents were very confident, confident or neutral.
Why is “neutral” included with “confident” and “very confident”? The percentage for neutral – 28% – certainly makes for a better headline for the Government. I would argue that if you wanted to, you could just as easily add the “neutral” numbers to the “not very confident” and “not at all confident” numbers, which would then give you 57% of people not confident in CERA. Or you could take out the neutral people all together, and you have 39% confident, and 29% not confident, which would be far more balanced.
This is a flawed survey, which almost half of participants failed to respond to. The government and their cheerleaders will try and spin it as best they can, but most people living in Christchurch want more than just PR. We want solutions to real figures such as 70% of quake claims not yet dealt with 2 years after quake.
* Here is the explanation of the weighting:
Weighting increases the influence of some observations and reduces the influence of others. So, for example, while 618 or 26% of completed interviews came from Selwyn District, the population of Selwyn actually represents about 8% of greater Christchurch. Thus, the data was adjusted so that 8% of any ‘greater Christchurch’ result reported is based on the responses of Selwyn residents.
UPDATE: If I was to go and hand-pick some numbers from this survey (just look at Christchurch City, not “Greater Christchurch”) here are some I could highlight:
48% of people have experienced additional financial burdens due to the quakes
54% live day-to-day in an earthquake damaged home (22% of which describe this as a moderate or major negative impact)
39% of people have had moderate or major negative impacts on their day-to-day lives due to dealing with EQC / Insurance issues
43% of people have had moderate or major negative impacts on their day-to-day lives due to distress or anxiety caused by ongoing aftershocks
97% of people have experienced stress in the last 12 months that has had a negative effect on them
57% of people have experienced a decrease in their quality of life since the earthquakes
38% of people are not confident that decisions made have been in the best interests of Christchurch