2016 Public Views on Immigration Survey

Methodological Summary
Submitted to: Immigration, Refugees, and Citizenship Canada (IRCC)
October 18, 2016
PWGSC Contract #: B8815-170150/001/CY
POR Registration #: POR – 025-16
Contract Award Date: 20/07/2016
Supplier: EKOS Research Associates
For more information: por-rop@cic.gc.ca
Ce rapport est aussi disponible en français.

Table of Contents

Executive Summary

Background

Immigration, Refugees and Citizenship Canada’s (IRCC’s) mission is to work with its partners to build a stronger Canada by developing and implementing policies, programs and services that facilitate the arrival of persons and their integration to Canada in a way that maximizes their contribution to the country while protecting the health, safety and security of Canadians; and enhance the values and promote the rights and responsibilities of Canadian citizenship. Building a stronger Canada also involves advancing global migration policies in a way that supports Canada’s immigration and humanitarian objectives.

IRCC takes an approach to immigration that responds to the needs of communities in all parts of the country by creating opportunities for individuals to come to Canada to make an economic, social, cultural, and civic contribution while also realizing their full potential, with a view to becoming citizens. The Department also supports global humanitarian efforts to assist those in need of protection. IRCC, along with its partners, realizes this vision through appropriate policies, programs, and services.

Research Purpose and Objectives

IRCC conducts an ongoing research program to help the Department develop a better understanding of Canadian attitudes toward the issues surrounding citizenship and immigration.

The research objectives of this study included the following:

The information gained through this public opinion research can be extrapolated to the wider population of Canadians and will be shared throughout the Department to assist it when establishing priorities, developing policies and communications products and strategies, and planning programs and services.

Methodology

A bilingual, national telephone survey was conducted of 1,598 Canadians 18 years of age or older. A sample of this size yields a margin of error of +/-2.45%, 19 times out of 20. The survey was conducted between August 11 and 31, 2016 and averaged 13 minutes in length. The sample included randomly selected respondents from all provinces and territories and included both landline and cell phone numbers. The survey sample, drawn from ASDE’s Canada Survey Sampler, relied on a Random Digit Dial method of sampling households from a wider sample frame of listed and unlisted landlines in Canada and is therefore considered to be a probability sample that is representative of the wider universe.

Expenditure

Total expenditure on this project was $62,903.15 (including HST)

I hereby certify as Senior Officer of EKOS Research Associates Inc. that the deliverables fully comply with the Government of Canada political neutrality requirements outlined in the Communications Policy of the Government of Canada and Procedures for Planning and Contracting Public Opinion Research. Specifically, the deliverables do not include information on electoral voting intentions, political party preferences, standings with the electorate or ratings of the performance of a political party or its leaders.

Signature of Derek Jansen, Vice President, EKOS Research

Derek Jansen
Vice President
EKOS Research

Appendix A: Methodology

1.1 Overview of Methodology

The methodology for this study involved a probability-based sampling methodology: a national Random Digit Dial (RDD) telephone survey of Canadians. The survey was 13 minutes in length and was conducted with 1,598 members of the general population. The fieldwork was conducted from August 11 to 31, 2016.

1.2 Sampling

Within the research, the target audience consisted of individuals aged 18 years and over selected randomly from the Canadian general population. As well, there was an oversample of members of the Canada’s Indigenous peoples.

The sample source for this study was primarily Canada Survey Sampler, produced by ASDE. The software uses the most up to date directories as they become available and is updated quarterly. It samples by Random Digit Dial (RDD) methodology and checks its samples against published phone lists to divide the RDD into "Directory Listed" (DL) and "Directory Not Listed" (DNL) RDD components. The flexibility of this software allows one to sample within specific regions or cities. You can sample according to population representativeness or stipulate stratification parameters, as required. Once the sample is determined for a specific survey, the numbers are imported into our Computer Assisted Telephone Interviewing (CATI) system and quotas are set for individual characteristics.

Ekos’ Probit panel was used to oversample members of Canada’s Indigenous peoples community. Probit is a research panel that has been designed by EKOS to provide statistically representative data. The online panel offers complete coverage of the Canadian population (i.e., Internet, phone, cell phone), random recruitment (in other words, participants are recruited randomly, they do not opt themselves into our panel), and equal probability sampling. All respondents to our panel are recruited by telephone using random digit dialling and are confirmed by live interviewers. The panel is considered to be probability based as it is recruited from random digit dial (RDD) sample, both landline and cell phone. The overall panel size is roughly 90,000 Canadian households. A random stratified sample was drawn from the panel database for this research assignment.

A dual 80/20 landline and cell phone probability sampling approach was undertaken. We included cell phone only sample to ensure that we covered the growing proportion of Canadians with no landline telephone service (i.e., cell phone only).Footnote 1

The sample was stratified by region as well as overall quotas set for gender, age and membership in the Indigenous peoples community, to allow for meaningful sub-group analysis and to ensure that weighting factors are within acceptable research standards.

The final data was weighted according to region, age, gender (using Statistics Canada 2011 Census data) and membership in the Indigenous peoples community (using the 2011 National Household Survey), in order to reflect the actual proportions of these variables in the Canadian adult population.

The following table summarizes the targeted, actual and weighted sample frame and how it compares to the Canadian adult population:

  Targeted Completes (n) Actual Unweighted Completes (n) Actual Weighted Completes (n) Actual Weighted Completes (%) Canadian Population (%)
Region
Atlantic Canada 150 151 114 7% 7%
Newfoundland and Labrador 30 30 25 2% 2%
Nova Scotia 60 61 45 3% 3%
New Brunswick 50 50 38 2% 2%
PEI 10 10 7 <1% <1%
Quebec 325 332 383 24% 24%
Ontario 550 552 610 38% 38%
Prairies (MB/SK) 150 151 104 6% 6%
Manitoba 80 80 56 4% 3%
Saskatchewan 70 71 47 3% 3%
Alberta 200 200 168 11% 11%
British Columbia/Territories 200 197 219 14% 14%
Gender
Male 785 797 777 49% 48%
Female 790 801 821 51% 52%
Age
18-34 265 321 446 28% 28%
35-54 580 559 592 37% 37%
55 and over 730 718 561 36% 35%
Immigration Status
Born in Canada 1,275 1,285 1,238 77% 79%
Immigrant to Canada 300 311 358 22% 21%
Membership in the Indigenous peoples community
Non-indigenous person 1,425 1,409 1,520 95% 96%
Indigenous person 150 179 68 4% 4%
Total 1,575 1,598 1,598 100% 100%

1.3 Pre-test

The questionnaire was pre-tested over the telephone in English and in French on August 11, 2016. The objective of the pre-test was to ascertain the clarity of the questions, the flow of the sequencing, the overall length of the interviews and any factors that may affect the response rate. No problems were revealed through the pre-test and full fieldwork commenced.

1.4 Survey Implementation/Quality Control

Throughout the data collection, survey supervisors continuously monitored interviewing to ensure consistency of questionnaire administration and interviewing techniques.

Up to eight call-backs were made to each member of the sample for which initial attempts at contact were unsuccessful. Follow-up calls were made on subsequent days, at varying time periods to maximize the potential for reaching a given respondent. Appointments were made for respondents wishing to reschedule a survey. Daily records were kept of all calls made, whether successful or not.

1.5 Analysis of Non-Response Bias

The table below provide a comparison of the (unweighted) survey sample with population parameters across region, gender and age to help determine the potential for non-response bias in the sample. The population parameters were obtained through Statistics Canada data.

Gender
  Statistics Canada Survey Sample
Male 48.46% 49.87%
Female 51.54% 50.13%
Age
  Statistics Canada Survey Sample
18-34 27.87% 20.09%
35-54 37.00% 34.98%
55+ 35.13% 44.93%
Region
  Statistics Canada Survey Sample
NB, NS, PEI, NL 7.12% 9.45%
Quebec 23.91% 20.78%
Ontario 38.22% 34.54%
Manitoba, Saskatchewan 6.46% 9.44%
Alberta 10.61% 12.52%
BC and Territories 13.68% 13.27%

As can be seen, the survey sample generally reflects the population in terms of gender and region, although the survey sample contains somewhat fewer Ontario residents, and somewhat more Prairie respondents. The survey sample contains somewhat fewer of those aged less than 35, and somewhat more of those aged 55 and over than is found in the population.

We also examined (weighted) differences between the survey sample and population parameters across other demographics (income, language) to help determine other potential non-response bias in the sample. The population parameters were obtained through Statistics Canada data.

Language
  Statistics Canada Survey Sample
English 56.94% 58.14%
French 21.30% 21.68%
Other 21.76% 20.18%
Household Income
  Statistics Canada Survey Sample
Under $20,000 13.28% 8.10%
$20,000 - $40,000 18.51% 17.45%
$40,000 - $60,000 17.34% 16.73%
$60,000 - $100,000 24.95% 28.55%
$100,000 - $150,000 15.49% 14.97%
$150,000 + 10.43% 14.20%

As can be seen, the survey sample generally reflects the population in terms of language and income, although the survey sample contains somewhat fewer low (under $20,000) income earners, and somewhat more high ($150,000+) income earners.

1.6 Weighting

Results were weighted according to age, region, gender and membership in the Indigenous peoples community to ensure the sample was representative of the general public aged 18 years and older. Weighting for age, region and gender was based on Statistics Canada data and weighting for Indigenous peoples was based on National Household Survey (NHS) proportions. The weighting proportions are included in the table in section 1.2.

1.7 Survey Response Rate

The tables below provide the call disposition and the response rate for the survey using MRIA calculations.

The empirical response rate for the completed interviews was 13% for the landline telephone sample and 5% for the cell sample (10% overall). The response rate is calculated by dividing the in-scope responding eligible by the total (functional) sample – see tables below.

Call Disposition - Overall

Invalid numbers
Blocked 97
Business 485
Duplicate 13
Invalid 7,388
Total invalid numbers 7,983
Unresolved (U)
Callback 3,146
No answer / Answering machine 11,494
Total unresolved 14,640
In-scope – Not responding (IS)
Household refusal 0
Respondent refusal 2,756
Illness, incapable 0
Selected respondent not available 18
Qualified respondent break-off 126
Total in-scope – not responding (IS) 2,900
In-scope – Responding (R)
Language disqualify 294
Quota filled 12
Other disqualify 58
Completed interviews 1,598
Total in-scope – responding (R) 1,962
Total (U + IS + R) 19,502
RESPONSE RATE (R divided by Total) 10.1%
Total Numbers Attempted 27,485

Call Disposition - Landline

Invalid numbers
Blocked 70
Business 376
Duplicate 10
Invalid 2,836
Total invalid numbers 3,292
Unresolved (U)
Callback 2,713
No answer / Answering machine 5,528
Total unresolved 8,241
In-scope – Not responding (IS)
Household refusal 0
Respondent refusal 2,202
Illness, incapable 0
Selected respondent not available 13
Qualified respondent break-off 92
Total in-scope – not responding 2,307
In-scope – Responding (R)
Language disqualify 218
Quota filled 12
Other disqualify 45
Completed interviews 1,283
Total in-scope – responding 1,558
Total (U + IS + R) 12,106
RESPONSE RATE (R divided by Total) 12.8%
Total Numbers Attempted 15,391

Call Disposition - Cell

Invalid numbers
Blocked 27
Business 109
Duplicate 3
Invalid 4,552
Total invalid numbers 4,691
Unresolved (U)
Callback 433
No answer / Answering machine 5,966
Total unresolved 6,399
In-scope – Not responding (IS)
Household refusal 0
Respondent refusal 554
Illness, incapable 0
Selected respondent not available 5
Qualified respondent break-off 34
Total in-scope – not responding 593
In-scope – Responding (R)
Language disqualify 76
Quota filled 0
Other disqualify 13
Completed interviews 315
Total in-scope – responding 404
Total (U + IS + R) 7,396
RESPONSE RATE (R divided by Total) 5.4%
Total Numbers Attempted 12,094

Appendix B: Questionnaire used in the telephone survey

PINTRO

Hello/Bonjour,

My name is [name] from EKOS Research Associates, the Government of Canada is conducting a research survey on issues of interest to Canadians. The survey takes about 12 minutes to complete. Your participation is voluntary and completely confidential. May I continue?

INTERVIRWER ASK: Would you prefer that I continue in English or French? Préférez-vous continuer en français ou en anglais?

INTERVIEWER NOTE: if at this point the respondent prefers to respond in French then the interviewer must be able to either proceed with the interview in French or read the following statement: "Je vous remercie. Quelqu'un vous rappellera bientôt pour mener le sondage en français."

IF ASKED: The survey is registered with the Marketing Research and Intelligence Association.

PRIV

This call may be recorded for quality control or training purposes.

QAGE

In what year were you born?

QAGE2

If… QAGE = Don’t know / No Response

Would you be willing to tell me in which of the following age categories you belong?

QREGION

In which province or territory do you live?

QGENDR

(Do not ask: record based on interviewer observation)

Q1

I'd like to start with a few questions about immigration issues.

In your opinion do you feel that there are too many, too few or about the right number of immigrants coming to Canada?

Q2

In total, approximately how many new immigrants do you think Canada allows into the country each year?

(GET BEST ESTIMATE, NEED ONE NUMBER, NOT A RANGE)

Q3

In fact, in the last few years approximately 260,000 new immigrants came to Canada each year. Knowing this, do you feel there are too many, too few, or about the right number of immigrants coming to Canada?

PREQ4

Currently, there are different categories of immigrants entering Canada. In your view, which of the following categories should be the most important priority?

(READ LIST. REPEAT OPTIONS AS NECESSARY. AFTER FIRST PRIORITY IS GIVEN, ASK SECOND PRIORITY. THE THIRD PRIORITY WILL BE THE REMAINING OPTION.)

Q4A

The family members of people already in Canada

Q4B

Economic immigrants, for example, skilled workers, caregivers and entrepreneurs

Q4C

Refugees

Q5

The Canadian population is approximately 36 million. This year, the Government of Canada may bring in up to 160,000 economic immigrants such as skilled workers, caregivers and entrepreneurs.

Thinking ahead over the next five years, the government may wish to increase the number of immigrants coming to Canada with that increase coming MAINLY from economic immigrants. To what extent would you support or oppose this? Please use a scale of 1 to 10, where 1 means "Strongly oppose" and 10 means "Strongly support".

Q6

If… Q5 not = Don’t know

And what is the main reason why you say that?

(ACCEPT ONE RESPONSE. DO NOT PROBE MORE THAN ONCE. EMPHASIZE "MAIN REASON".)

Q7A

Half sample between Q7A and Q7B

Over the next five years, to what extent would you support or oppose increasing the number of economic immigrants by 100,000? Please use a scale of 1 to 10, where 1 means "Strongly oppose" and 10 means "Strongly support".

Q7B

Half sample between Q7A and Q7B

Over the next five years, to what extent would you support or oppose increasing the number of economic immigrants by 200,000? Please use a scale of 1 to 10, where 1 means "Strongly oppose" and 10 means "Strongly support".

PREQ8

Please tell me to what extent you either agree or disagree with each of the following statements. Please use a scale from 1 to 10, where 1 means "strongly disagree" and 10 means "strongly agree".

Q8A

Half sample between Q8A and Q8B

Immigration is necessary if Canada is to sustain its economic growth.

Q8B

Half sample between Q8A and Q8B

Immigration is necessary if Canada is to sustain its economic growth in the face of an aging population.

Q8C

The Government of Canada has an important part to play in helping immigrants to integrate into Canadian society.

Q8D

The Government of Canada has an important part to play in helping Canadians to accept and welcome immigrants into their communities.

Q8E

Canada has the capacity to welcome more immigrants than it is currently accepting.

Q8F

Immigrants to Canada support our country by fostering innovation and new ideas.

Q8G

Canada has a history of welcoming immigrants.

Q8H

Immigrants contribute to our economy by working, starting businesses or creating jobs.

PREQ9

In general, what effect does immigration to this country have on…? Is the effect very positive, somewhat positive, neither positive nor negative, somewhat negative or very negative?

(INTERVIEWER NOTE: REPEAT SCALE AS NECESSARY)

Q9A

Your city

Q9B

Half sample between Q9B and Q9C

Your province

Q9C

Half sample between Q9B and Q9C

Your province's economy

Q9D

Your community

Q9E

Your neighbourhood

Q9F

You personally

Q9G

Half sample between Q9G and Q9H

Canada

Q9H

Half sample between Q9G and Q9H

Canada's economy

Q10

Refugees can come to Canada in different ways. Some of them come from overseas and are selected by the Canadian government to come to Canada. Other people come to Canada as visitors and, after arriving, claim that they are refugees, saying that they cannot go home because they face danger or persecution.

In your opinion, do you feel that there are too many, too few or about the right number of refugees coming to Canada?

PREQ11

Please tell me to what extent you either agree or disagree with each of the following statements. Please use a scale from 1 to 10, where 1 means "strongly disagree" and 10 means "strongly agree".

Q11A

Accepting refugees is part of Canada's humanitarian tradition.

Q11B

Half sample between Q11B and Q11C

Canada has a responsibility to do its part in accepting refugees

Q11C

Half sample between Q11B and Q11C

Canada has a responsibility to do its part in accepting refugees from refugee camps

Q11D

Canada has a responsibility to help asylum seekers, that is, those who come to Canada as visitors and, after arriving, claim that they are refugees who cannot go home because they face danger or persecution.

Q11E

Half sample between Q11E and Q11F

Refugees have a positive impact on Canada's economy

Q11F

Half sample between Q11E and Q11F

Refugees have a positive impact on Canada's economy in the long run

Q12

Now I would like to ask you a few last questions for statistical purposes only.

Were you born in Canada?

Q13

If… Q12 = No

In what year did you come to Canada?

Q14

Did your parents immigrate to Canada from another country?

READ LIST

Q15

Are you an Indigenous person, that is, First Nations (North American Indian), Métis or Inuk (Inuit)?

Q16

What is the highest level of formal education that you have completed to date?

READ LIST; ACCEPT ONE RESPONSE.

Q17

What is your current employment status?

DO NOT READ LIST. ACCEPT ONE RESPONSE. STICK STRICTLY TO THE CODES IDENTIFIED BELOW. PROBE IF NECESSARY

Q18

Which of the following best describes your total household income? That is, the total income of all persons in your household combined, before taxes. Is it…?

READ LIST, ACCEPT ONE RESPONSE ONLY

Q19 [1,15]

What were the ethnic or cultural origins of your ancestors?

DO NOT READ LIST. ACCEPT MULTIPLE RESPONSES

Q20 [1,3]

What is the language that you first learned at home in childhood and still understand?

READ LIST. MULTIPLE RESPONSES ACCEPTED ONLY IF LANGUAGES LEARNED AT THE SAME TIME.

THNK

That concludes the survey. Thank you very much for your thoughtful feedback. It is much appreciated.

THNK2

Screened-out

We regret but your responses have shown that you are ineligible to participate in this survey. Thank you for your time!