This Web page has been archived on the Web.

2005 November Report of the Auditor General of Canada

November 2005 Report—Chapter 2

Exhibit 2.1—Reporting of key survey information in departmental performance reports

Key information

Why it is important

Percentage of 209 references reported

Name of survey

The name of the survey identifies it and distinguishes it from similar or previous surveys.

23%

Response rate

The response rate is an important indicator of data quality. Low response rates raise the risk of biased results.

12%

Sample size

The sample size influences the possible range of sampling error due to chance. Small sample sizes are more likely to produce estimate errors due to chance.

13%

Confidence interval (also known as "precision")

The confidence interval relates directly to the sample size. Although it shows how precise the observations are, it does not indicate the amount or direction of bias due to sources of non-sampling error, such as low response rate.

1%

Description of target population

The target population is the group of people that the sample is intended to describe.

91%

Description of the sampling frame

The sampling frame is any list, material, or device that identifies and allows access to elements of the survey population. Understanding the sampling frame provides important information about potential gaps in the coverage of a survey.

12%

Reference to a final report

A reference to a complete final report containing a detailed description of methodology is important so that users can fully understand how the survey was done and can replicate the survey to see if they get similar results.

12%

When the survey was conducted

The timing of a survey can be important when interpreting results. Data can be out of date or may have been collected immediately following a significant event that temporarily affected the findings.

78%