Methodological Summary
Submitted to: Immigration, Refugees, and Citizenship Canada (IRCC)
October 18, 2016
PWGSC Contract #: B8815-170150/001/CY
POR Registration #: POR – 025-16
Contract Award Date: 20/07/2016
Supplier: EKOS Research Associates
For more information: por-rop@cic.gc.ca
Ce rapport est aussi disponible en français.
Immigration, Refugees and Citizenship Canada’s (IRCC’s) mission is to work with its partners to build a stronger Canada by developing and implementing policies, programs and services that facilitate the arrival of persons and their integration to Canada in a way that maximizes their contribution to the country while protecting the health, safety and security of Canadians; and enhance the values and promote the rights and responsibilities of Canadian citizenship. Building a stronger Canada also involves advancing global migration policies in a way that supports Canada’s immigration and humanitarian objectives.
IRCC takes an approach to immigration that responds to the needs of communities in all parts of the country by creating opportunities for individuals to come to Canada to make an economic, social, cultural, and civic contribution while also realizing their full potential, with a view to becoming citizens. The Department also supports global humanitarian efforts to assist those in need of protection. IRCC, along with its partners, realizes this vision through appropriate policies, programs, and services.
IRCC conducts an ongoing research program to help the Department develop a better understanding of Canadian attitudes toward the issues surrounding citizenship and immigration.
The research objectives of this study included the following:
The information gained through this public opinion research can be extrapolated to the wider population of Canadians and will be shared throughout the Department to assist it when establishing priorities, developing policies and communications products and strategies, and planning programs and services.
A bilingual, national telephone survey was conducted of 1,598 Canadians 18 years of age or older. A sample of this size yields a margin of error of +/-2.45%, 19 times out of 20. The survey was conducted between August 11 and 31, 2016 and averaged 13 minutes in length. The sample included randomly selected respondents from all provinces and territories and included both landline and cell phone numbers. The survey sample, drawn from ASDE’s Canada Survey Sampler, relied on a Random Digit Dial method of sampling households from a wider sample frame of listed and unlisted landlines in Canada and is therefore considered to be a probability sample that is representative of the wider universe.
Total expenditure on this project was $62,903.15 (including HST)
I hereby certify as Senior Officer of EKOS Research Associates Inc. that the deliverables fully comply with the Government of Canada political neutrality requirements outlined in the Communications Policy of the Government of Canada and Procedures for Planning and Contracting Public Opinion Research. Specifically, the deliverables do not include information on electoral voting intentions, political party preferences, standings with the electorate or ratings of the performance of a political party or its leaders.
Derek Jansen
Vice President
EKOS Research
The methodology for this study involved a probability-based sampling methodology: a national Random Digit Dial (RDD) telephone survey of Canadians. The survey was 13 minutes in length and was conducted with 1,598 members of the general population. The fieldwork was conducted from August 11 to 31, 2016.
Within the research, the target audience consisted of individuals aged 18 years and over selected randomly from the Canadian general population. As well, there was an oversample of members of the Canada’s Indigenous peoples.
The sample source for this study was primarily Canada Survey Sampler, produced by ASDE. The software uses the most up to date directories as they become available and is updated quarterly. It samples by Random Digit Dial (RDD) methodology and checks its samples against published phone lists to divide the RDD into "Directory Listed" (DL) and "Directory Not Listed" (DNL) RDD components. The flexibility of this software allows one to sample within specific regions or cities. You can sample according to population representativeness or stipulate stratification parameters, as required. Once the sample is determined for a specific survey, the numbers are imported into our Computer Assisted Telephone Interviewing (CATI) system and quotas are set for individual characteristics.
Ekos’ Probit panel was used to oversample members of Canada’s Indigenous peoples community. Probit is a research panel that has been designed by EKOS to provide statistically representative data. The online panel offers complete coverage of the Canadian population (i.e., Internet, phone, cell phone), random recruitment (in other words, participants are recruited randomly, they do not opt themselves into our panel), and equal probability sampling. All respondents to our panel are recruited by telephone using random digit dialling and are confirmed by live interviewers. The panel is considered to be probability based as it is recruited from random digit dial (RDD) sample, both landline and cell phone. The overall panel size is roughly 90,000 Canadian households. A random stratified sample was drawn from the panel database for this research assignment.
A dual 80/20 landline and cell phone probability sampling approach was undertaken. We included cell phone only sample to ensure that we covered the growing proportion of Canadians with no landline telephone service (i.e., cell phone only).Footnote 1
The sample was stratified by region as well as overall quotas set for gender, age and membership in the Indigenous peoples community, to allow for meaningful sub-group analysis and to ensure that weighting factors are within acceptable research standards.
The final data was weighted according to region, age, gender (using Statistics Canada 2011 Census data) and membership in the Indigenous peoples community (using the 2011 National Household Survey), in order to reflect the actual proportions of these variables in the Canadian adult population.
The following table summarizes the targeted, actual and weighted sample frame and how it compares to the Canadian adult population:
Targeted Completes (n) | Actual Unweighted Completes (n) | Actual Weighted Completes (n) | Actual Weighted Completes (%) | Canadian Population (%) | |
---|---|---|---|---|---|
Region | |||||
Atlantic Canada | 150 | 151 | 114 | 7% | 7% |
Newfoundland and Labrador | 30 | 30 | 25 | 2% | 2% |
Nova Scotia | 60 | 61 | 45 | 3% | 3% |
New Brunswick | 50 | 50 | 38 | 2% | 2% |
PEI | 10 | 10 | 7 | <1% | <1% |
Quebec | 325 | 332 | 383 | 24% | 24% |
Ontario | 550 | 552 | 610 | 38% | 38% |
Prairies (MB/SK) | 150 | 151 | 104 | 6% | 6% |
Manitoba | 80 | 80 | 56 | 4% | 3% |
Saskatchewan | 70 | 71 | 47 | 3% | 3% |
Alberta | 200 | 200 | 168 | 11% | 11% |
British Columbia/Territories | 200 | 197 | 219 | 14% | 14% |
Gender | |||||
Male | 785 | 797 | 777 | 49% | 48% |
Female | 790 | 801 | 821 | 51% | 52% |
Age | |||||
18-34 | 265 | 321 | 446 | 28% | 28% |
35-54 | 580 | 559 | 592 | 37% | 37% |
55 and over | 730 | 718 | 561 | 36% | 35% |
Immigration Status | |||||
Born in Canada | 1,275 | 1,285 | 1,238 | 77% | 79% |
Immigrant to Canada | 300 | 311 | 358 | 22% | 21% |
Membership in the Indigenous peoples community | |||||
Non-indigenous person | 1,425 | 1,409 | 1,520 | 95% | 96% |
Indigenous person | 150 | 179 | 68 | 4% | 4% |
Total | 1,575 | 1,598 | 1,598 | 100% | 100% |
The questionnaire was pre-tested over the telephone in English and in French on August 11, 2016. The objective of the pre-test was to ascertain the clarity of the questions, the flow of the sequencing, the overall length of the interviews and any factors that may affect the response rate. No problems were revealed through the pre-test and full fieldwork commenced.
Throughout the data collection, survey supervisors continuously monitored interviewing to ensure consistency of questionnaire administration and interviewing techniques.
Up to eight call-backs were made to each member of the sample for which initial attempts at contact were unsuccessful. Follow-up calls were made on subsequent days, at varying time periods to maximize the potential for reaching a given respondent. Appointments were made for respondents wishing to reschedule a survey. Daily records were kept of all calls made, whether successful or not.
The table below provide a comparison of the (unweighted) survey sample with population parameters across region, gender and age to help determine the potential for non-response bias in the sample. The population parameters were obtained through Statistics Canada data.
Statistics Canada | Survey Sample | |
---|---|---|
Male | 48.46% | 49.87% |
Female | 51.54% | 50.13% |
Statistics Canada | Survey Sample | |
---|---|---|
18-34 | 27.87% | 20.09% |
35-54 | 37.00% | 34.98% |
55+ | 35.13% | 44.93% |
Statistics Canada | Survey Sample | |
---|---|---|
NB, NS, PEI, NL | 7.12% | 9.45% |
Quebec | 23.91% | 20.78% |
Ontario | 38.22% | 34.54% |
Manitoba, Saskatchewan | 6.46% | 9.44% |
Alberta | 10.61% | 12.52% |
BC and Territories | 13.68% | 13.27% |
As can be seen, the survey sample generally reflects the population in terms of gender and region, although the survey sample contains somewhat fewer Ontario residents, and somewhat more Prairie respondents. The survey sample contains somewhat fewer of those aged less than 35, and somewhat more of those aged 55 and over than is found in the population.
We also examined (weighted) differences between the survey sample and population parameters across other demographics (income, language) to help determine other potential non-response bias in the sample. The population parameters were obtained through Statistics Canada data.
Statistics Canada | Survey Sample | |
---|---|---|
English | 56.94% | 58.14% |
French | 21.30% | 21.68% |
Other | 21.76% | 20.18% |
Statistics Canada | Survey Sample | |
---|---|---|
Under $20,000 | 13.28% | 8.10% |
$20,000 - $40,000 | 18.51% | 17.45% |
$40,000 - $60,000 | 17.34% | 16.73% |
$60,000 - $100,000 | 24.95% | 28.55% |
$100,000 - $150,000 | 15.49% | 14.97% |
$150,000 + | 10.43% | 14.20% |
As can be seen, the survey sample generally reflects the population in terms of language and income, although the survey sample contains somewhat fewer low (under $20,000) income earners, and somewhat more high ($150,000+) income earners.
Results were weighted according to age, region, gender and membership in the Indigenous peoples community to ensure the sample was representative of the general public aged 18 years and older. Weighting for age, region and gender was based on Statistics Canada data and weighting for Indigenous peoples was based on National Household Survey (NHS) proportions. The weighting proportions are included in the table in section 1.2.
The tables below provide the call disposition and the response rate for the survey using MRIA calculations.
The empirical response rate for the completed interviews was 13% for the landline telephone sample and 5% for the cell sample (10% overall). The response rate is calculated by dividing the in-scope responding eligible by the total (functional) sample – see tables below.
Invalid numbers | |
---|---|
Blocked | 97 |
Business | 485 |
Duplicate | 13 |
Invalid | 7,388 |
Total invalid numbers | 7,983 |
Unresolved (U) | |
Callback | 3,146 |
No answer / Answering machine | 11,494 |
Total unresolved | 14,640 |
In-scope – Not responding (IS) | |
Household refusal | 0 |
Respondent refusal | 2,756 |
Illness, incapable | 0 |
Selected respondent not available | 18 |
Qualified respondent break-off | 126 |
Total in-scope – not responding (IS) | 2,900 |
In-scope – Responding (R) | |
Language disqualify | 294 |
Quota filled | 12 |
Other disqualify | 58 |
Completed interviews | 1,598 |
Total in-scope – responding (R) | 1,962 |
Total (U + IS + R) | 19,502 |
RESPONSE RATE (R divided by Total) | 10.1% |
Total Numbers Attempted | 27,485 |
Invalid numbers | |
---|---|
Blocked | 70 |
Business | 376 |
Duplicate | 10 |
Invalid | 2,836 |
Total invalid numbers | 3,292 |
Unresolved (U) | |
Callback | 2,713 |
No answer / Answering machine | 5,528 |
Total unresolved | 8,241 |
In-scope – Not responding (IS) | |
Household refusal | 0 |
Respondent refusal | 2,202 |
Illness, incapable | 0 |
Selected respondent not available | 13 |
Qualified respondent break-off | 92 |
Total in-scope – not responding | 2,307 |
In-scope – Responding (R) | |
Language disqualify | 218 |
Quota filled | 12 |
Other disqualify | 45 |
Completed interviews | 1,283 |
Total in-scope – responding | 1,558 |
Total (U + IS + R) | 12,106 |
RESPONSE RATE (R divided by Total) | 12.8% |
Total Numbers Attempted | 15,391 |
Invalid numbers | |
---|---|
Blocked | 27 |
Business | 109 |
Duplicate | 3 |
Invalid | 4,552 |
Total invalid numbers | 4,691 |
Unresolved (U) | |
Callback | 433 |
No answer / Answering machine | 5,966 |
Total unresolved | 6,399 |
In-scope – Not responding (IS) | |
Household refusal | 0 |
Respondent refusal | 554 |
Illness, incapable | 0 |
Selected respondent not available | 5 |
Qualified respondent break-off | 34 |
Total in-scope – not responding | 593 |
In-scope – Responding (R) | |
Language disqualify | 76 |
Quota filled | 0 |
Other disqualify | 13 |
Completed interviews | 315 |
Total in-scope – responding | 404 |
Total (U + IS + R) | 7,396 |
RESPONSE RATE (R divided by Total) | 5.4% |
Total Numbers Attempted | 12,094 |
Hello/Bonjour,
My name is [name] from EKOS Research Associates, the Government of Canada is conducting a research survey on issues of interest to Canadians. The survey takes about 12 minutes to complete. Your participation is voluntary and completely confidential. May I continue?
INTERVIRWER ASK: Would you prefer that I continue in English or French? Préférez-vous continuer en français ou en anglais?
INTERVIEWER NOTE: if at this point the respondent prefers to respond in French then the interviewer must be able to either proceed with the interview in French or read the following statement: "Je vous remercie. Quelqu'un vous rappellera bientôt pour mener le sondage en français."
IF ASKED: The survey is registered with the Marketing Research and Intelligence Association.
This call may be recorded for quality control or training purposes.
In what year were you born?
If… QAGE = Don’t know / No Response
Would you be willing to tell me in which of the following age categories you belong?
In which province or territory do you live?
(Do not ask: record based on interviewer observation)
I'd like to start with a few questions about immigration issues.
In your opinion do you feel that there are too many, too few or about the right number of immigrants coming to Canada?
In total, approximately how many new immigrants do you think Canada allows into the country each year?
(GET BEST ESTIMATE, NEED ONE NUMBER, NOT A RANGE)
In fact, in the last few years approximately 260,000 new immigrants came to Canada each year. Knowing this, do you feel there are too many, too few, or about the right number of immigrants coming to Canada?
Currently, there are different categories of immigrants entering Canada. In your view, which of the following categories should be the most important priority?
(READ LIST. REPEAT OPTIONS AS NECESSARY. AFTER FIRST PRIORITY IS GIVEN, ASK SECOND PRIORITY. THE THIRD PRIORITY WILL BE THE REMAINING OPTION.)
The family members of people already in Canada
Economic immigrants, for example, skilled workers, caregivers and entrepreneurs
Refugees
The Canadian population is approximately 36 million. This year, the Government of Canada may bring in up to 160,000 economic immigrants such as skilled workers, caregivers and entrepreneurs.
Thinking ahead over the next five years, the government may wish to increase the number of immigrants coming to Canada with that increase coming MAINLY from economic immigrants. To what extent would you support or oppose this? Please use a scale of 1 to 10, where 1 means "Strongly oppose" and 10 means "Strongly support".
If… Q5 not = Don’t know
And what is the main reason why you say that?
(ACCEPT ONE RESPONSE. DO NOT PROBE MORE THAN ONCE. EMPHASIZE "MAIN REASON".)
Half sample between Q7A and Q7B
Over the next five years, to what extent would you support or oppose increasing the number of economic immigrants by 100,000? Please use a scale of 1 to 10, where 1 means "Strongly oppose" and 10 means "Strongly support".
Half sample between Q7A and Q7B
Over the next five years, to what extent would you support or oppose increasing the number of economic immigrants by 200,000? Please use a scale of 1 to 10, where 1 means "Strongly oppose" and 10 means "Strongly support".
Please tell me to what extent you either agree or disagree with each of the following statements. Please use a scale from 1 to 10, where 1 means "strongly disagree" and 10 means "strongly agree".
Half sample between Q8A and Q8B
Immigration is necessary if Canada is to sustain its economic growth.
Half sample between Q8A and Q8B
Immigration is necessary if Canada is to sustain its economic growth in the face of an aging population.
The Government of Canada has an important part to play in helping immigrants to integrate into Canadian society.
The Government of Canada has an important part to play in helping Canadians to accept and welcome immigrants into their communities.
Canada has the capacity to welcome more immigrants than it is currently accepting.
Immigrants to Canada support our country by fostering innovation and new ideas.
Canada has a history of welcoming immigrants.
Immigrants contribute to our economy by working, starting businesses or creating jobs.
In general, what effect does immigration to this country have on…? Is the effect very positive, somewhat positive, neither positive nor negative, somewhat negative or very negative?
(INTERVIEWER NOTE: REPEAT SCALE AS NECESSARY)
Your city
Half sample between Q9B and Q9C
Your province
Half sample between Q9B and Q9C
Your province's economy
Your community
Your neighbourhood
You personally
Half sample between Q9G and Q9H
Canada
Half sample between Q9G and Q9H
Canada's economy
Refugees can come to Canada in different ways. Some of them come from overseas and are selected by the Canadian government to come to Canada. Other people come to Canada as visitors and, after arriving, claim that they are refugees, saying that they cannot go home because they face danger or persecution.
In your opinion, do you feel that there are too many, too few or about the right number of refugees coming to Canada?
Please tell me to what extent you either agree or disagree with each of the following statements. Please use a scale from 1 to 10, where 1 means "strongly disagree" and 10 means "strongly agree".
Accepting refugees is part of Canada's humanitarian tradition.
Half sample between Q11B and Q11C
Canada has a responsibility to do its part in accepting refugees
Half sample between Q11B and Q11C
Canada has a responsibility to do its part in accepting refugees from refugee camps
Canada has a responsibility to help asylum seekers, that is, those who come to Canada as visitors and, after arriving, claim that they are refugees who cannot go home because they face danger or persecution.
Half sample between Q11E and Q11F
Refugees have a positive impact on Canada's economy
Half sample between Q11E and Q11F
Refugees have a positive impact on Canada's economy in the long run
Now I would like to ask you a few last questions for statistical purposes only.
Were you born in Canada?
If… Q12 = No
In what year did you come to Canada?
Did your parents immigrate to Canada from another country?
READ LIST
Are you an Indigenous person, that is, First Nations (North American Indian), Métis or Inuk (Inuit)?
What is the highest level of formal education that you have completed to date?
READ LIST; ACCEPT ONE RESPONSE.
What is your current employment status?
DO NOT READ LIST. ACCEPT ONE RESPONSE. STICK STRICTLY TO THE CODES IDENTIFIED BELOW. PROBE IF NECESSARY
Which of the following best describes your total household income? That is, the total income of all persons in your household combined, before taxes. Is it…?
READ LIST, ACCEPT ONE RESPONSE ONLY
What were the ethnic or cultural origins of your ancestors?
DO NOT READ LIST. ACCEPT MULTIPLE RESPONSES
What is the language that you first learned at home in childhood and still understand?
READ LIST. MULTIPLE RESPONSES ACCEPTED ONLY IF LANGUAGES LEARNED AT THE SAME TIME.
That concludes the survey. Thank you very much for your thoughtful feedback. It is much appreciated.
Screened-out
We regret but your responses have shown that you are ineligible to participate in this survey. Thank you for your time!