2021-22 Annual Tracking Study

Final report

Prepared for: Immigration, Refugees and Citizenship Canada

Supplier Name: Ipsos
Contract Number: B8815-220310/001/CY
Contract Value: $249,981.07 (including HST)
Award Date: 2021-12-22
Delivery Date: 2022-03-31

Registration Number: POR 072-21

For more information on this report, please contact IRCC at:
IRCC.COMMPOR-ROPCOMM.IRCC@cic.gc.ca

Ce rapport est aussi disponible en français.

Copyright

This public opinion research report presents the results of a survey conducted by Ipsos on behalf of Immigration, Refugees and Citizenship Canada. The research was conducted with 2,923 Canadians by telephone, 3,010 Canadians online, and 1,950 telephone surveys across 15 selected municipalities by telephone, between January 17^th, 2022, and March 29^th, 2022.

Cette publication est aussi disponible en français sous le titre : Étude de suivi annuelle de 2021-22.

This publication may be reproduced for non-commercial purposes only. Prior written permission must be obtained from Immigration, Refugees and Citizenship Canada. For more information on this report, please contact Immigration, Refugees and Citizenship Canada at IRCC.COMMPOR-ROPCOMM.IRCC@cic.gc.ca or at:

Communications Branch
Immigration, Refugees and Citizenship Canada
Jean Edmonds Tower South
365 Laurier Ave W
Ottawa ON K1A 1L1

Catalogue Number: Ci4-183/1-2020E-PDF
International Standard Book Number (ISBN): 978-0-660-35523-8

Related publications (registration number: POR 072-21):
Catalogue Number: Ci4-183/1-2020F-PDF (Final Report, French)
ISBN: 978-0-660-35524-5

© His Majesty the King in Right of Canada, as represented by the Minister of Immigration, Refugees and Citizenship Canada, 2022

Political neutrality statement

I hereby certify as Senior Officer of Ipsos that the deliverables fully comply with the Government of Canada political neutrality requirements outlined in the Communications Policy of the Government of Canada and Procedures for Planning and Contracting Public Opinion Research. Specifically, the deliverables do not include information on electoral voting intentions, political party preferences, standings with the electorate, or ratings of the performance of a political party or its leaders.

Mike Colledge
President
Ipsos Public Affairs

Executive summary

Ipsos Public Affairs is pleased to present this report to Immigration, Refugees and Citizenship Canada.

Background

Since 1994, when it was established as a new department bringing together immigration services and citizenship registration, Immigration, Refugee and Citizenship Canada (IRCC) has played several key roles: admitting immigrants, foreign students, visitors and temporary workers; resettling refugees; helping immigrants adapt to Canadian society and become Canadian citizens; and managing access to Canada.

IRCC conducts an ongoing research program to help the Department develop a better understanding of Canadian attitudes toward the issues surrounding citizenship and immigration. By gauging and analyzing the opinions of newcomers, immigrants and the broader public, the Department gains insights into important policy areas related to the mandate of the Department and related services.

Research objectives

This year’s study explored views of members of the Canadian general population, including newcomers and Indigenous Peoples, in the context of COVID-19. More specifically, the research objectives of this study included the following:

• Measuring perceptions of the resumption of immigration to Canada after borders reopened;
• Measuring perceptions of the number of immigrants coming to Canada;
• Measuring perceptions of the impact of immigration and refugees on Canada;
• Measuring perceptions of Canada’s immigration system and priorities;
• Measuring perceptions of the settlement and integration of immigrants and refugees;
• Compare differences between online and telephone survey results.

Attitudes of Canadians on issues such as immigration, settlement, integration, and citizenship as well as IRCC services are of key importance to IRCC’s policies and programs. By gauging and exploring attitudes about key elements of the Department’s mandate, this research supports IRCC in ensuring high quality policy options, program design; encouraging and effectively managing citizen-focused services; managing organizational and strategic risks proactively; and gathering and using relevant information on program results.

The value of this contract, including HST, is $249,981.07.

Methodology

To meet the research objectives, Ipsos conducted a national telephone survey, a national online survey, and a targeted telephone survey to selected municipalities across the country. The 15-minute national telephone survey was conducted among a nationwide sample of n=2,923 Canadian adults between February 15^th and March 29^th, 2022. The telephone survey sample was a probability sample generated through random digit dialing obtaining an overall margin of error of ±1.8 percentage points (calculated at a 95% confidence interval). The 15-minute national online survey was conducted among 3,010 respondents between March 1^st and 24^th, 2022. As the online survey used non-probability sampling, a margin of error cannot be calculated. Respondents were offered the survey in the official language of their choice.

Ipsos also conducted an 11-minute telephone survey with a random sample of 1,950 individuals across 15 selected municipalities (with 100 to 150 surveys completed per municipality) between January 17^th and February 5^th, 2022. The sample of members of the general population aged 18+ was a probability sample generated through random digit dialing. The margins of error for each municipality are between ±7.9 and ±9.8 percentage points, depending on sample size (calculated at a 95% confidence interval).

A full quantitative methodology report, including all information about the execution of the fieldwork that is needed to replicate the research initiative, may be found in Appendix 1. The quantitative survey research instruments and a set of tabulated results from the quantitative surveys are provided under a separate cover.

Should you have any questions or comments, please contact:

Martin Hrobsky
Senior Vice President
Ipsos Public Affairs
Telephone: 416-324-2017
Email: Martin.Hrobsky@Ipsos.com

Daniel Kunasingam
Senior Research Manager
Ipsos Public Affairs
Telephone: 416-324-2298
Email: Daniel.Kunasingam@Ipsos.com

Appendix 1 – Quantitative methodology

Telephone survey (National)

Ipsos conducted a 15-minute telephone survey among a nationwide sample of n=2,923 Canadian adults between February 15^th and March 29^th, 2022. The sample is a probability sample generated through random digit dialing. For respondents contacted on a landline, respondents within households were selected at random, by using the “birthday method” of identifying and interviewing the member of the household (aged 18+) who had their birthday last.

Respondents contacted on a cellphone were also random digit dialed and needed to be 18+ to participate. Wireless samples were selected on a provincial and community level (where possible) from a database containing all possible numbers in 1000-blocks of area codes and exchanges dedicated to wireless numbers.

Within the total sample of 2,923 Canadians for this survey, 1,060 respondents were contacted on their landlines, while the other 1,863 respondents were contacted on their cellphones. The margin of error for a telephone survey of 2,923 respondents is ±1.8%, using a confidence interval of 95% (19 times out of 20). The final questionnaire used was provided by IRCC to ensure adequate tracking of previous research results conducted by the department.

Telephone sample weighting

The tables below indicate the unweighted and weighted distributions of the telephone sample. The sample was stratified by region, with quotas used to ensure appropriate representation. Weighting was applied to the sample to ensure that the final data reflects the adult population of Canada by region, age and gender according to the 2016 Census.

Please note, the totals below may not add up to 2,923 due to some respondents’ refusal to provide socioeconomic information.

Statistics presented in the table above show minimal differences between the final unweighted and weighted samples. However, those 18 to 34 years old are underrepresented, resulting in a higher unweighted to weighted ratio.

Call dispositions

The following table provides the call dispositions and response rate calculation, as per the former MRIA’s empirical method of calculating response rates for telephone surveys.

The response rate, calculated as the number of in-scope – responding units divided by the sum of unresolved units, in-scope – non-responding units, and in-scope – responding units, was 5.38% for landline numbers, 7.36% for cellphone numbers, and 6.61% for all telephone numbers. The total response rate of 6.61% for a telephone survey of the Canadian general population with up to 8 call-backs per household is typical.

Non-response analysis

As with any probability sample, there exists within the current sample the possibility of non-response bias. In particular, this survey would not include members of the population who do not have access to a telephone (either landline or cellphone) or who are not capable of responding to a survey in either English or French. In addition, some groups within the population are systemically less likely to answer surveys.

The table below compares the unweighted sample to the 2016 Census results by region, age, gender, education, income and country of birth. The comparison between the two samples for the three variables used in the weighting scheme (using interlocking weights for region with age and region with gender) shows underrepresentation of younger Canadians (18 to 34 years of age). However, this discrepancy is small enough that it can be corrected through weighting without affecting the quality of the final results. As the regional distribution was set through hard quotas, the weighting is correcting for the selected quota targets, rather than non-response.

This comparison between the unweighted sample distribution and the actual population figures for variables not included in the weighting scheme shows that the final sample obtained was mostly representative of the general population for this survey. However, there are noticeable differences in education levels between the sample and the Canadian adult population, with the telephone sample being more educated than Census figures show. The largest gap was for the university educated stratum, with 46% of the sample having obtained a university degree, compared to 22% among Canadian adults. Education is a variable that could be considered in future weighting schemes for national surveys to correct for this imbalance. Income distributions for the sample are very close to those measured in the 2016 Census, except who have a household income of under $40K (17% vs 26%). The country of birth distribution matches the 2016 Census.

Online sample (National)

The online sample of 3,010 respondents was drawn from two online panels: the Ipsos iSay panel and the Maru panel. As this is a non-probability sample, a margin of error cannot be calculated. Respondents to the online survey were invited to participate via email, with a unique URL link to the survey provided to them. This link could only be used once, with respondents being allowed to take pause during completion and return to complete it at a later time. Survey questionnaires took 15 minutes to complete on average. All surveys were completed between March 1^st and 24^th, 2022.

Incentives and quality control measures

Respondents to Ipsos’ and Maru online surveys are offered a number of innovative incentive programs in the forms of a point-based system where participants can redeem points for various items. We do not reward our panelists using cash payments.

Extensive quality-control procedures are in place within IIS (Ipsos Interactive Services, who manage our panel and Maru, who manages their own panel) to ensure that the survey inputs (sample and questionnaire design) allow for high-quality survey outputs (survey data). These processes span the life cycle of a panelist and are in place for all Ipsos online surveys. Panel experts are constantly monitoring and reviewing the performance of our quality measures and updating and integrating new ones as respondents’ behaviors and the online landscape evolve.

• Panelists are who they say they are
• Double Opt-In approach to confirm identity
• Country validation via Geo-IP
• Mismatch between device settings and geolocation
• Anonymous proxy detection
• Detection of robots via Captcha code
• Detection of “5 minutes“ emails (temporary email addresses)
• Detection of data anomalies and patterns
• Maintenance of Ipsos blacklist
• RealAnswer™- detection of pasted and robot answers

They have not participated recently in similar surveys

• Strict panel usage rules to avoid interviewing the same people too often and prevent them from becoming too used to a type of survey or product category
• Duplicate devices identification through digital Fingerprinting (RelevantID®) and web/flashcookie

They complete surveys seriously

• Survey taking behavior: speeding, straight lining, open-ends quality evaluation
• Panelists’ history monitored across surveys and used for panel purge removing “bad” or inactive respondents

They can only take the survey once

• Duplicate emails identification
• Duplicate devices identification through digital fingerprinting (RelevantID®) and web/flashcookie
• Duplicate contact details identification

Online sample weighting

The tables below indicate the unweighted and weighted distributions of the online sample. The sample was stratified by region, with soft quotas also set for gender and age to ensure appropriate representation across categories. Weighting was applied to the sample to ensure that the final data reflects the adult population of Canada by region, age and gender according to the 2016 Census.

Please note, the totals below may not add up to 3,010 due to some respondents’ refusal to provide socioeconomic information.

Statistics presented in the tables above show minimal differences between the final unweighted and weighted samples, with the exception of region where weighting is correcting for selected quota targets.

Email statistics

The table below presents general statistics regarding the response rate for the email phase of research.

The response rate, calculated as the number of in-scope – responding units divided by the sum of unresolved units, in-scope – non-responding units, and in-scope – responding units, was 12.88%. This response rate is within normal ranges for a survey of the Canadian adult population.

Non-response analysis

As with any non-probability sample there exists within the current sample the possibility of non-response bias. In particular, this survey would not include members of the population who do not have access to a computer with an Internet connection (either at home or at work) or who are not capable of responding to a survey in either English or French. In addition, some groups within the population are systemically less likely to answer surveys.

The tables below compare the unweighted sample to the 2016 Census results by region, age, gender, education, income and country of birth. Overall, the sample is highly representative of the national adult population, except for a few gaps which are described below.

The comparison for the variables used in the weighting scheme shows minimal gaps. As the regional distribution was set through hard quotas, the weighting is correcting for the selected quota targets, rather than non-response. The largest observable gaps between the unweighted sample and Census 2016 data relates to education levels, as observed with the phone sample as well. We find that the unweighted sample tends to overrepresent more educated Canadians, underrepresent Canadians who have a household income of under $40K and $100,000 and above, as well as immigrants.

Comparison of phone and online samples by socioeconomic information not used in weighting (National)

The tables below show a comparison between the weighted telephone and online samples for education and income levels, as well as country of birth, which were not included in the weighting scheme. Considering that no quotas were set for any of these three variables during fieldwork, the similarities between the two samples are notable, though there is an 8-point gap in those who report a household income of $100,000 and above, and a 6-point difference in the share of respondents born outside of Canada.

Municipal telephone survey

Ipsos conducted an 11-minute telephone survey targeting 15 specific municipalities, with a random sample of 1,950 individuals selected from members of the general population (aged 18 or older) residing in these municipalities, between January 17^th and February 5^th, 2022. The sample is a probability sample generated through random digit dialing.

For respondents contacted on a landline, respondents within households were selected at random, by using the “birthday method” of identifying and interviewing the member of the household (aged 18+) who had their birthday last.

Respondents contacted on a cellphone were also random digit dialed and needed to be 18+ to participate. Wireless samples were selected on a municipality level from a database containing all possible numbers in 1000-blocks of area codes and exchanges dedicated to wireless numbers.

Within the total sample of 1,950 for this survey, 656 respondents were contacted on their landlines, while the other 1294 respondents were contacted on their cellphones. The margins of error for each municipality using a confidence interval of 95% (19 times out of 20) are shown in the table below. The final questionnaire used was provided by IRCC to ensure adequate tracking of previous research results conducted by the department.

Call dispositions

The following table provides the call dispositions and response rate calculation, as per the former MRIA’s empirical method of calculating response rates for telephone surveys.

The response rate, calculated as the number of in-scope – responding units divided by the sum of unresolved units, in-scope – non-responding units, and in-scope – responding units, was 8.32% for landline numbers, 5.93% for cellphone numbers, and 6.41% for all telephone numbers. The total response rate of 6.41% for a telephone survey of the Canadian general population with up to 8 call-backs per household is typical.

Municipal sample weighting

The tables below indicate the unweighted and weighted distributions of the municipal sample. The sample was stratified by municipality. Weighting was applied to the samples from 13 of the 15 municipalities to ensure that the final data reflects their adult population by age according to 2016 Census profiles. Weighting was not applied to the samples for two municipalities (Altona/Rhineland and West Kootenay) due to a lack of available census data.

Appendix 2 – Quantitative instruments

English and French quantitative instruments are provided under separate cover.