Measuring Agency Strategic Performance Framework Outcomes (2021-2022): Methodological Report




Prepared for the Canada Revenue Agency



Submitted by Narrative Research
PSPC Contract Number: 46558-220059/001/CY
Contracted Value: $49,521.80
Award Date: February 3, 2022
Delivery Date: March 31, 2022


Registration Number: POR 120-21
For more information, please contact: cra-arc.media@cra-arc.gc.ca



Ce rapport est aussi disponible en français.

Measuring Agency Strategic Performance Framework Outcomes (2021-2022)

Methodological Report

Prepared for Canada Revenue Agency
Supplier Name: Narrative Research Inc.
March 2022

This report presents the methodological details for the Measuring Agency Strategic Performance Framework Outcomes, 2021-2022 study conducted by Narrative Research Inc. on behalf of the Canada Revenue Agency (CRA). This study was conducted with 500 respondents from the Canadian tax-filers aged 18 years and older, between February 22 and March 10, 2022, and with 502 small businesses and tax-intermediaries between February 28 and March 17, 2022.

Ce rapport est aussi disponible en français sous le titre: Mesure des résultats du cadre de mesure du rendement stratégique de l’Agence (2021-2022)

This publication may be reproduced for non-commercial purposes only. Prior written permission must be obtained from the Canada Revenue Agency. For more information on this report, please contact the Canada Revenue Agency at: cra-arc.media@cra-arc.gc.ca.


101 Colonel By Drive
Ottawa, Ontario K1A 0K2
Canada

Catalogue Number: Rv4-154/1-2022E-PDF

International Standard Book Number (ISBN): 978-0-660-42762-1

Related publications (registration number: POR 120-21):

Catalogue Number: Rv4-154/1-2022F-PDF (Final Methodological Report, French) ISBN (French): 978-0-660-42764-5

© Her Majesty the Queen in right of Canada, as represented by the Canada Revenue Agency, 2022

Table of Contents

Executive Summary


Narrative Research Inc.
Contract Number: 46558-220059/001/CY
POR Registration Number: 120-21
Contract Award Date: February 3, 2022
Contracted Cost: $49,521.80

Background

Canadian taxpayers, businesses, and tax intermediaries are all directly impacted by the performance of the Canada Revenue Agency (CRA). As such, the CRA contracted Narrative research to conduct the data collection of public opinion research (POR) among all three groups, in order to meet the need of measuring the CRA’s Agency Strategic Performance Framework (ASPF) outcomes. The research was conducted through both telephone and online data collection. A telephone survey was administered to adult Canadians of the general public between February 22 and March 10, 2022. Meanwhile, an online survey was administered to decision-makers at small businesses and tax-intermediaries between February 28 to March 17, 2022.

Research Objectives

The research results will support the development of Agency level indicators for the ASPF outcomes, namely compliance, fair treatment, trust in CRA, and client-centric service. The proposed research will generate knowledge in the field of tax administration and further strengthen the CRA’s position as a research-driven organization. This research project will, as explained in the Statement of Work, also support and contribute to the following sections in Minister Diane Lebouthillier’s Mandate Letter:

Target Population

As specified in the Statement of Work (SOW), there are three distinct target audiences for the Strategic Outcomes study, namely:

  1. Adult Canadian taxpayers/General population – aged 18 and over;
  2. Businesses – with a minimum revenue of $30K in the 2020 tax year, including both self-employed/sole proprietors, and other businesses (e.g., incorporated companies with more than one Full-Time Equivalent [FTE] employee); will include decision-makers or those involved in decisions related to tax matters, payroll, GST/HST preparation, or bookkeeping. Acceptable job titles include, for example:
  3. Tax intermediaries – those who prepare taxes for individuals & business clients on tax-related payroll matters.

A telephone survey was administered to adult Canadians of the general public between February 22 and March 10, 2022, and required approximately 14 minutes to administer in both French and English. There was a total of 500 usable surveys from Canadian tax-filers completed via telephone, as well as 25 non-tax filers.

Meanwhile, an online survey was administered to decision-makers at businesses and tax-intermediaries between February 28 - March 17, 2022, and required approximately seven minutes to administer in both official languages. A total of 502 surveys were completed online. The email contact records for this research were drawn from panelists administered by Dynata. Given that this online survey methodology used a non-probability sample, the data collected cannot be extrapolated to Canadian businesses/tax-intermediaries.

Research Usage

As stated in the project’s Statement of Work and related communications, the Strategic Outcomes study sought to develop indicators needed for measuring the CRA’s ASPF outcomes. Results of this POR project will be used to: (1) Develop meaningful performance indicators using robust scientific methodology, and (2) Generate insights into compliance that will be used to assist in educational communications.

Expenditure

The project expenditure was $49,521.80, including HST.

Consent

Narrative Research offers this written consent allowing the Librarian and Archivist of Canada to post, in both official languages, this Methodological Report.

Political Neutrality Statement and Contact Information

I hereby certify as a Senior Officer of Narrative Research that the deliverables fully comply with the Government of Canada political neutrality requirements outlined in the Communications Policy of the Government of Canada and Procedures for Planning and Contracting Public Opinion Research. Specifically, the deliverables do not contain any reference to electoral voting intentions, political party preferences, standings with the electorate, or ratings of the performance of a political party or its leader.


Peter MacIntosh
Chief Research Officer & Partner
Narrative Research
pmacintosh@narrativeresearch.ca
902-493-3832

Study Methodology

The research was conducted through both telephone and online data collection. A telephone survey was administered to adult Canadians of the general public between February 22 to March 10, 2022. Meanwhile, an online-based data collection region entailed the administration of surveys to both small businesses and tax-intermediaries between February 28 to March 17, 2022.

Questionnaire Design

The questions utilized in this study were provided by Canada Revenue Agency. For the survey administered to the general public, Narrative Research reviewed the questions, providing suggestions and prepared them in a format suitable for telephone administration. With respect to the online survey to be administered to a business audience, Narrative Research reviewed questions, provided suggestions where appropriate, and ensured that respondents were able to complete the survey on various platforms including computers, tablets or smartphones.

As required by Government of Canada standards, English and French pre-test surveys were collected. As well, a line of questioning was included at the end of the pre-test surveys in which respondents were asked if they encountered any questions or survey wording that was difficult to understand. In the telephone survey, one pre-test respondent replied in the affirmative. When asked to identify which question or questions were problematic from a comprehension perspective, their response did not point to any immediate issues with the survey structure, and hence, all pre-test questions were retained in the final dataset. Additionally, in the online survey, one respondent indicated that they found questions difficult to understand, but this was found to be the result of a programming error. Survey data from the 33 unblemished pre-test respondents was retained in the final dataset.

Sampling

The survey approach utilized in both waves was designed to be administered a sample of approximately 1,000 respondents; 500 Canadian members of the general public 18 years and older, 400 businesses, and 100 tax intermediaries. The telephone survey was designed to be administered to 500 adult Canadian tax-filers, and approximately 10 adult non-tax filers. The sample provided for dialing entailed contact records reflecting Random Digit Dialing (RDD), thus engendering a large number of Not in Service (NIS) telephone numbers. For landlines, records were drawn from a list of randomly-selected households compiled from telephone numbers in Canada, selected from a database that is updated quarterly. Both listed and unlisted numbers were included in the sample.

Narrative Research utilized ASDE Inc.’s Canada Survey Sampler (CSS) sampling software to generate general population telephone landline samples within Canada, which has become a standard software for many companies in Canada. This software has been proven to provide a sample that is equivalent to RDD. Randomly generated cellular numbers were also used. The sample was stratified by region in order to ensure regional representation with approximate targets at the outset of the data collection as follows:

Sampling
Region Target Completions Margin of Error (19 in 20 times)
Atlantic 60 ± 12.6 percentage points
Quebec 120 ± 8.9 percentage points
Ontario 180 ± 7.3 percentage points
Western/Northern 150 ± 8.0 percentage points
Total 510 ± 4.3 percentage points

The target interviews plan entailed overall quotas by age and gender, as well as by region. The gender quotas were approximately 50/50, while the age quotas were broken into three groupings: 18-34, 35-54, and 55 years of age or older. Please note, the actual final figure achieved of non-tax filer interviews was 25.

The online survey was designed to be administered to an online business panel sample of approximately 500 business decision-makers. Although hard quotas were not set, Narrative Research worked to ensure that the surveys collected closely reflected the natural fallout of the Canadian business landscape in terms of gender, age group and region, as required by the project’s Statement of Work. Targets for the number of completed surveys were set such that approximately 100 surveys were to be collected from tax intermediaries, 200 from sole proprietors/partnerships, and the remaining 200 from incorporated businesses.

Contact Records Source

Narrative Research utilized the services of Dynata for the online component of this research. With almost 60 years of leadership experience and innovation, Dynata (formerly Research Now SSI) delivers world class market research sample and data services.

Dynata was the first to make random sample available to researchers and were the inventors of online and B2B panels with the advent of online research. Dynata is an independent single-source for permission-based data collection across the globe, managing thousands of projects each month. They are experienced, research-literate, multi-lingual data collection specialists, servicing clients from across 41 offices worldwide, serving nearly 6000 market research agencies, media and advertising agencies, consulting and investment firms and healthcare and corporate customers in North America, South America, Europe and Asia-Pacific. Dynata adheres to the highest standards of sampling science across every aspect of every project and sponsors extensive “research on research” revealing critical insights into better sampling and survey design. They are active contributors to 24 market research associations around the world.

Dynata recruits for its panel through a combination of open-enrollment and their proprietary ‘By-Invitation-Only’ recruitment campaigns. The following are panel sources for Dynata studies:

Dynata has established a variety of quality assurance processes to proactively identify invalid respondents. These include checking for duplicate respondents by looking at email addresses, matches across demographic data and by employing their digital fingerprint technology. Their ‘By-Invitation-Only’ methodology also ensures that only real people can enroll. Additionally, Dynata uses various other techniques such as external list matching to maintain panel quality.

Dynata provides sample selection based on client needs, including customized sampling, such as nationally representative sampling as was employed in this instance. Dynata balances sample on outbound invitations, survey starts or completed interviews, by using a variety of targeting criteria. Panelists’ participation is rewarded using a structured incentive scheme, where incentive amount is dependent upon survey length and content.

Survey Administration

Survey Programming and Testing

As noted, the 500 surveys with adult Canadian tax-filers were completed via telephone. The survey was programmed by Narrative Research in both English and French via Computer-Assisted Telephone Interviewing software (CATI). Respondents had the option to complete the survey questionnaire in the official language of their choice. Assistance was available from bilingual staff members as required, with ongoing bilingual supervision.

In terms of training, in addition to a thorough general screening and training process, supervisors and interviewers were provided with extensive, customized project-specific training, a review of the questionnaire including specific terminology, acronyms and pronunciations, and background information on the project goals and objectives.

In terms of supervision, as with all projects there was a ratio of one supervisor for every 15 interviewers working. This ‘floor supervisor’ answers questions, handles escalations, ensures that technology is functioning properly, and blind monitors interviewers. In addition, a minimum of 10 percent of interviews were audited through the review of recorded interviews or live monitoring (twice the percentage required by industry guidelines).

For the approximately 500 surveys conducted with a business audience, the online surveys were programmed by Narrative Research in both English and French, using Voxco Acuity programming software. Respondents were formally invited to the survey in the official language of their choice. As well, at any point when completing the questionnaire, respondents had the option to change the questionnaire language to the other official language. Assistance in completing the survey was available from bilingual Narrative Research staff, as required. Respondents were able to verify the legitimacy of the survey via representatives from Narrative Research, or via the survey registration system made available by the Canadian Research Insights Council (CRIC), Canada’s national research agency for this sector.

The programmed surveys were tested to ensure that question order and skip patterns were properly implemented. Testing included Narrative Research researchers ensuring the accuracy of the survey delivery, text, links, and so on. CRA staff were also provided with the pre-test link for the telephone and online components.

A total of 10 English and 10 French pre-tests were completed for the telephone portion of this study, while 24 English and 11 French pre-tests were conducted for the online portion. Pre-test survey completions were conducted via a survey “soft launch” whereby a small number of panel respondents were invited to participate in the survey. The pre-testing of the surveys allowed the collected data to be reviewed to ensure accuracy and to identify any programming aspects that should be modified. Pre-test respondents were asked if they had any difficulty understanding any aspect of the surveys. One telephone (adult Canadian) and one online (business) respondent replied in the affirmative. The telephone respondent’s response did not point to any issues with the structure of the survey, and hence the pre-test was maintained in the final telephone dataset. The online respondent’s issue was determined to be the result of a programming error and thus, all pre-test surveys not affected by this error were maintained in the final online dataset.

Data Collection

During the telephone data collection, a minimum of five call-backs for landline telephone numbers, and five call-backs for cellular telephone numbers was instituted. Calls and call-backs were varied throughout the day which includes both daytime and evening calling, limited to 9 p.m. in a given time zone.

Narrative Research and its data collection partner employed a number of techniques for keeping response rates as high as possible:

If an interviewer did not speak the requested interview official language, the interview transferred to another interviewer or a call back arranged within 20 minutes (or at another time if requested by the respondent). When calling to a particular location with a predominant language (e.g., French in Quebec), calling was done by interviewers who speak the predominant language to minimize the number of transfers required. Interviews took an average of 14 minutes to be completed and were conducted from February 22 to March 10, 2022.

The online data collection was conducted between February 28 and March 17, 2022 and required an average of seven minutes to complete. The survey invitations as well as reminder invitations were sent to panel members during the data collection period. Fieldwork was monitored and reviewed on an ongoing basis to ensure target breakdown of tax intermediaries, sole proprietors/partnerships, and incorporated businesses was being met. Narrative Research provided regular reports to CRA representatives regarding progress, as requested or pre-determined. No individual was able to complete the survey questionnaire more than once.

ÉA total of 526 surveys were submitted by respondents, and 502 were ultimately used in the final online dataset. It is important to note that for various reasons, a small percentage of submitted online panel surveys is often removed from study data sets after submission. Thus, given the unavoidable possibility of having to remove surveys, post collection, Narrative Research as a precautionary measure collected more than the initially targeted number of surveys. Reasons for removing surveys ultimately included an error in the programming, as well as those who were straight-lined “speedsters”. Thus overall, a small number (n=24) were removed.

A non-probability sample approach was implemented given that this component of the study was designed to be conducted among online Canadian businesses. All such panels are inherently non-probability in nature, given that panelists self-select to become members of such panels, and not all Canadian businesses belong to such a panel.

Data Tabulation (Telephone): For the telephone research conducted with Canadian adults, there were a total of 36 interlocking statistical weighting cells created from the study design using the weighting factors of: Region (6: Atlantic, Quebec, Ontario/NU, MB/SK, AB/NT, BC/YK); Age group (3: 18–34, 35–54, 55+); Gender (2: Male, Female). The 36 non-interlocking statistical weighting cells thus were derived from Region (6) x Age (3) x Gender (2) dimensions = 36 unique statistical weighting cells. Population data for the 36 statistical weighting cells and immigration weights were obtained from the most recent (2016) Census of Canada, and can be found here:

It is important to note that the regions used for the purposes of the data collection quotas differ in certain instances from the regions used for tabulation weighting purposes. This more ‘granular’ approach was employed so as to maximize the regional representativeness of the data being tabulated.

Nonetheless, it is suggested that the quantitative impact of implementing this approach was very modest, thereby recommending the specific statistical weighting approach as helpful. It should also be noted that a small number of individuals were not able to be placed into one of the 36 weighting cells due to the fact that they identified as gender diverse. For tabulation purposes, these individuals were given a weight value of 1.0.

Data Tabulation (Online): For the online research conducted with Canadian businesses, no hard quotas for age, gender and region were set, although Narrative Research was careful to ensure that the geographic distribution of businesses that completed the survey closely resembled that of the actual distribution of Canadian businesses.

Additionally, as per the SOW provided by the CRA, approximately 100 of the approximately 500 businesses surveyed were tax-intermediaries and the remaining 400 were split between business that are sole proprietorships/partnerships (n=200) and incorporated businesses (n=200).

Percentages may not sum exactly to 100%, owing to rounding

Telephone Survey of Canadian Tax-filers (n=500) (excludes non-tax filers) by region
Region 2016 Census Quota Targets - Surveys (n=) Quota Targets - Surveys (%) Surveys Completed (Unweighted) (n=) Surveys Completed (Unweighted) (%) Surveys Completed (Weighted) (n=) Surveys Completed (Weighted) (%)
Atlantic 6.8% 60 11.7% 57 11.4% 35 7.1%
Quebec 23.4% 120 23.5% 110 22.0% 116 23.1%
Ontario 38.3% 180 35.3% 184 36.8% 190 38.0%
Western/Northern 31.5% 150 29.4% 149 29.8% 159 31.8%
Telephone Survey of Canadian Tax-filers (n=500) (excludes non-tax filers) by Gender
Gender1 2016 Census Quota Targets - Surveys (n=) Quota Targets - Surveys (%) Surveys Completed (Unweighted) (n=) Surveys Completed (Unweighted) (%) Surveys Completed (Weighted) (n=) Surveys Completed (Weighted) (%)
Male 48.6% 248 48.6% 245 49.0% 238 47.6%
Female 51.4% 252 49.4% 245 49.0% 252 50.4%

1 Ten respondents identified as gender diverse and are not presented in the table.

Telephone Survey of Canadian Tax-filers (n=500) (excludes non-tax filers) by Age (Quotas)
Age (quotas) 2016 Census Quota Targets - Surveys (n=) Quota Targets - Surveys (%) Surveys Completed (Unweighted) (n=) Surveys Completed (Unweighted) (%) Surveys Completed (Weighted) (n=) Surveys Completed (Weighted) (%)
18 – 34 27.4% 138 27.1% 112 22.4% 139 27.8%
35 – 54 34.1% 173 33.9% 160 32.0% 169 33.8%
55+ 38.6% 199 39.0% 228 45.6% 192 38.4%
Online Survey of Canadian Businesses (n=502)
Age (Quotas) 2016 Census Quota Targets - Surveys (n=) Quota Targets - Surveys (%) Surveys Completed (Unweighted) (n=) Surveys Completed (Unweighted) (%)
Tax intermediaries N/A 100 20.0% 100 19.9%
Sole proprietorships/ partnerships N/A 200 40.0% 200 39.8%
Incorporated businesses N/A 200 40.0% 202 40.2%

Participation Rate: The rate below was derived using the formula recommended by the Public Opinion Research Directorate of the Government of Canada:

Telephone Survey (n=525, where n=25 were ‘non tax-filers’)

Participation/Response Rate [R ÷ (U + IS + R)] = [ 628 ÷ (38 326 + 8 471 + 628)] 1.3%

Participation Rate: The participation rate for the online component of this study cannot be calculated due to the data collection procedures employed for this component of the research. In such instances, as per section 1.2.2.7 of the Standards for the Conduct of Government of Canada Public Opinion Research for Online Surveys, “a description of the design/selection procedure and any potential sampling bias that may result” must be provided in lieu of a participation rate. Specifically, online participants were recruited to the online survey via a sample router rather than via direct email invitation. Participants were invited to participate in surveys including the study under examination in this report.

Non-Response Bias Analysis

Any survey that is conducted is potentially subject to bias or error. When a survey is conducted with a sample of the population, there are two general classes of bias or error: sampling error, which is quantifiable, and non-sampling error, which is typically not quantifiable. Sampling error necessarily arises from the fact that surveys are administered to only a subset of the targeted population, and thus is it possible that the survey results obtained from this group of respondents is not reflective of the population as a whole.

In contrast, non-sampling error encompasses a number of different types of errors including coverage error, measurement error, non-response error, and processing error.

For the telephone component, the actual achieved margins of error for the tax filers component provide a reflection of the sampling error and are presented in the table below:

Sampling error
Region Completed Surveys Margin of Error (19 in 20 times)
Atlantic 57 ± 13.0 percentage points
Quebec 110 ± 9.3 percentage points
Ontario 184 ± 7.2 percentage points
Western/Northern 149 ± 8.0 percentage points
Total 500 ± 4.3 percentage points

For the online component, no measurement of sampling error can be attributed to the current study, given that the contact records utilized in the data collection process were derived from an online panel businesses, which is to say, a non-probability sample source.

With respect to non-sampling error, a number of steps were taken to minimize bias due to these sources. All surveys utilized telephone or online survey programming technology, respectively, to ensure proper survey skip patterns were followed and to minimize errors due to data entry and data capture. The French and English survey instruments from each campaign themselves were pre-tested with a small sample of respondents to ensure the survey material was easily understood by respondents, and that the resultant data were being captured properly.

In terms of coverage, the telephone survey was conducted from a random sampling of a robust sample frame of landline and cellular numbers. Quotas were established for demographic groups traditionally regarded as central in quantitative survey research, such as gender, age, and region/province. The final data set was statistically weighted to closely match the true distribution of these dimensions as reflected in the 2016 Statistics Canada census. The statistical weights implemented were relatively small, given that the data collected already closely matched the actual distribution of adult Canadians along these demographic dimensions.

For the online component, completed surveys were collected from online Canadian business panelists of the target audiences, drawn from commercially available online panelists. As implied above in this section of the report, all online panel data collection endeavours necessarily must recognize the potential limitations of, for example, the ‘coverage’ of non-probability sampling. In this instance, it is impossible to know, for instance, if there were coverage weaknesses in the overall panel composition from the perspective of, for example, “Were the Tax Intermediary panelists from whom the survey data was collected initially representative of potentially relevant dimensions such as the years of experience as TIs?”

Canada Revenue Agency
Measuring Agency Strategic Performance Measurement Framework Outcomes
(2021-2022)
General Public Questionnaire

Introduction

Hello/Bonjour, My name is ___ representing Narrative Research, a survey research company. We are conducting a telephone survey on current issues of interest to Canadians on behalf of the Government of Canada, in accordance with the provisions of the Privacy Act. The survey takes about 15 minutes and is voluntary and completely confidential. Your answers will remain anonymous. Would you prefer that I continue in English or French? (IF NEEDED: Je vous remercie. Quelqu'un vous rappellera bientôt pour mener le sondage en français.)

This call may be monitored or recorded for quality control purposes only.

The survey is registered with the Canadian Research Insights Council, should you wish to verify the survey.

IF NEEDED: If you have any questions regarding this survey or would like to verify the legitimacy of this research, you can contact Kim Huang at kim.huang@cra-arc.gc.ca, or visit canada.ca/por-cra. You may also leave a message with Narrative Research at 1-888-854-6555, and someone will call you back.

IF NEEDED: To verify the survey, please visit: canadianresearchinsightscouncil.ca/rvs/home/?lang=en The registration number is: INSERT

Screener

Perception of CRA’s fairness

Motivations to pay taxes

NOTE: IF F2 = YES, read the MA:

MA. I will now continue with a series of statements, and ask you to rate them using the same scale of 1 to 7. Please let me know if you need a reminder for the scales [IF SAID YES/THEY NEED REMINDER SAY: 1 means that you strongly disagree, 4 means that you neither agree nor disagree, and 7 means that you strongly agree]. For the series of statements we ask for your opinion based on your general impressions of CRA, whether from personal experience, or from what you have seen, read or heard. The first one is… [RANDOMIZE. READ LIST] INCLUDE “DON’T KNOW/NO ANSWER’ AND ‘NOT APPLICABLE’ RESPONSE OPTIONS

IF F2 = NO, read MB:

MB. Now, I will be asking you to rate a series of statements. We will be using a scale of 1 to 7, where 1 means that you strongly disagree, 4 means that you neither agree nor disagree, and 7 means that you strongly agree. For the series of statements we ask for your opinion based on your general impressions of CRA, whether from personal experience, or from what you have seen, read or heard. The first one is… [RANDOMIZE. READ LIST – PROBE TO AVOID ACCEPTING A RANGE]

  1. I think most taxpayers would not report income in their tax returns, if they receive it in cash
  2. I think most taxpayers over state their tax deductions
  3. I think cheating on taxes is justifiable, if I can get away with it
  4. I think most people think cheating on taxes is justifiable, if they can get away with it
  5. It would be morally wrong for me to cheat on my taxes
  6. If I cheated on my taxes, most people who are important to me would not care
  7. I think hard work pays off
  8. I think having a good education is important for getting ahead in life
  9. I think one’s family's socio-economic status is important for getting ahead in life
  10. I think knowing the right people is important for getting ahead in life
  11. I think paying taxes is a social responsibility
  12. I think the CRA is interested in catching those who make mistakes
  13. I think the CRA is interested in helping me do the right thing

E-Services

Next, I will be asking you a few questions regarding electronic services, or e-services that the CRA provides such as ‘My Account’ or ‘My Business Account’, which lets taxpayers view their personal income tax and benefit information, and manage their tax affairs online.

Perceptions of CRA’s integrity

D1. Thank you. We are nearing the end, but there is another series of statements and we will continue to use the scale of 1 to 7. Please let me know if you want me to repeat the scales. The first one is… (IF SAID YES/THEY NEED REMINDER SAY: 1 means that you strongly disagree, 4 means that you neither agree nor disagree, and 7 means that you strongly agree) [RANDOMIZE. READ LIST – PROBE TO AVOID ACCEPTING A RANGE - INCLUDE “DON’T KNOW/NO ANSWER’ AND ‘NOT APPLICABLE’ RESPONSE OPTIONS]

  1. I think the CRA administers tax law to everyone in the same manner
  2. Overall, I think the CRA has fair procedures for dealing with problems
  3. I think the CRA shares its dispute processes on their website with the public
  4. I think the CRA is clear when it comes to its procedures
  5. I know I can look into CRA’s performance on their website, if I wanted to
  6. I think the CRA has the proper safeguards in place to protect sensitive information
  7. I would feel comfortable with filing objections to the CRA, if I needed to
  8. I think the CRA behaves ethically and honestly when addressing tax law issues
  9. I think the CRA imposes fair penalties on wrongdoers

Respondent Profile

Thank you, and now before we finish up I will be asking you a few questions for statistical purposes. Please be assured that all of your answers will remain completely confidential. If you would like to skip a question please indicate once you hear the question.

PRE-TEST ONLY: TO BE REMOVED AFTER PRE-TEST [n = at least 10 in each official language]

IF YES: PT2. Which questions did you find difficult to understand?

RECORD VERBATIM

That concludes the survey. Thank you very much for your thoughtful feedback. It is much appreciated

Agence du revenu du Canada
Mesure des résultats du cadre de mesure du rendement stratégique de l’Agence
(2021-2022)
Questionnaire du grand public

Introduction

Hello/Bonjour, je m’appelle ___ et je représente Narrative Research, une entreprise de recherche par sondage. Nous menons un sondage téléphonique sur les enjeux actuels qui intéressent les Canadiens au nom du gouvernement du Canada et conformément aux dispositions de la Loi sur la protection des renseignements personnels. Ce sondage dure environ 15 minutes, s’effectue sur une base volontaire et est entièrement confidentiel. Vos réponses demeureront anonymes. Préférez-vous continuer en français ou en anglais? (AU BESOIN : Thank you. Someone will call you back soon to complete the survey in English.)

Cet appel peut être écouté ou enregistré aux fins de contrôle de la qualité seulement.

Le sondage est enregistré auprès du Conseil de recherche et d’intelligence marketing canadien, si vous souhaitez vérifier sa légitimité.

AU BESOIN : Si vous avez des questions au sujet de ce sondage ou si vous souhaitez vérifier la légitimité de cette recherche, vous pouvez communiquer avec Kim Huang à l’adresse kim.huang@cra-arc.gc.ca, ou visiter le https://www.canada.ca/por-cra. Vous pouvez également laisser un message auprès de Narrative Research, au 1-888-854-6555, et quelqu’un vous rappellera.

AU BESOIN : Pour vérifier le sondage, visitez la page https://www.canadianresearchinsightscouncil.ca/rvs/home/?lang=fr. Le code de projet est : INSÉRER.

Sélectionneur

Perception de l’équité de l’Agence

Motivations pour payer l’impôt

REMARQUE : SI F2 = OUI, lisez MA :

MA. Je vais maintenant poursuivre avec une série d’énoncés et vous demander de les évaluer en utilisant la même échelle de 1 à 7. N’hésitez pas à me dire si vous avez besoin d’un rappel quant à la signification de l’échelle [SI LA PERSONNE DIT OUI/VEUT UN RAPPEL, DITES : 1 signifie que vous êtes tout à fait en désaccord, 4 signifie que vous n’êtes ni d’accord ni en désaccord, et 7 signifie que vous êtes tout à fait d’accord]. Pour la série d’énoncés, nous vous demandons votre opinion en fonction de vos impressions générales à l’égard de l’Agence, qu’il s’agisse de votre expérience personnelle, de ce que vous avez vu, lu ou entendu. Le premier, c’est... [LISEZ DE MANIÈRE ALÉATOIRE. LISEZ LA LISTE - INCLUDE “Ne sais pas / Préfère ne pas dire’ AND ‘ne s'applique pas’ RESPONSE OPTIONS]

SI F2 = NON, lisez MB :

MB. Maintenant, je vais vous demander d’évaluer une série d’énoncés. Nous utiliserons une échelle de 1 à 7, où 1 signifie que vous êtes tout à fait en désaccord, 4 signifie que vous n’êtes ni d’accord ni en désaccord, et 7 signifie que vous êtes tout à fait d’accord. Pour la série d’énoncés, nous vous demandons votre opinion en fonction de vos impressions générales à l’égard de l’Agence, qu’il s’agisse de votre expérience personnelle, de ce que vous avez vu, lu ou entendu. Le premier, c’est... [LISEZ LA LISTE DE FAÇON ALÉATOIRE – SOYEZ PERSISTENT POUR ÉVITER D’ACCEPTER UNE APPROXIMATION]

  1. Je pense que la plupart des contribuables ne déclareraient pas un revenu dans leurs déclarations de revenus s’ils le recevaient en argent comptant.
  2. Je pense que la plupart des contribuables déclarent trop de retenues d’impôt.
  3. Je pense que la fraude fiscale est justifiable, si je peux m’en tirer.t
  4. Je pense que la plupart des gens pensent que la fraude fiscale est justifiable, s’ils peuvent s’en tirer.
  5. Il serait moralement inacceptable pour moi de commettre une fraude fiscale.
  6. Si je commettais de la fraude fiscale, la plupart des gens qui sont importants pour moi ne s’en soucieraient pas.
  7. Je pense que le travail acharné est payant.
  8. Je pense qu’il est important d’avoir une bonne éducation pour progresser dans la vie.
  9. Je pense que le statut socioéconomique de la famille d’une personne est important pour que cette personne puisse avancer dans la vie.
  10. Je pense que le fait de connaître les bonnes personnes pour progresser dans la vie.
  11. Je pense que le paiement de l’impôt est une responsabilité sociale.
  12. Je pense que l’Agence souhaite attraper ceux qui commettent des erreurs.
  13. Je pense que l’Agence souhaite m’aider à faire la bonne chose.

Services électroniques

Ensuite, je vais vous poser quelques questions au sujet des services électroniques que l’Agence fournit, comme « Mon dossier » ou « Mon dossier d’entreprise », qui permet aux contribuables de consulter leurs renseignements personnels sur l’impôt sur le revenu et les prestations et de gérer leurs affaires fiscales en ligne.

Perceptions de l’intégrité de l’Agence

D1. Merci. Nous approchons de la fin, mais il y a un autre ensemble d’énoncés; nous continuerons d’utiliser l’échelle de 1 à 7. Veuillez m’indiquer si vous voulez que je répète les échelles. Le premier, c’est... (SI LA PERSONNE DIT OUI/VEUT UN RAPPEL, DITES : 1 signifie que vous êtes tout à fait en désaccord, 4 signifie que vous n’êtes ni d’accord ni en désaccord, et 7 signifie que vous êtes tout à fait d’accord) [LISEZ DE MANIÈRE ALÉATOIRE - INCLUEZ “Ne sais pas / Préfère ne pas dire’ ET ‘ne s'applique pas’ OPTIONS DE RÉPONSES]

  1. Je pense que l’Agence applique les lois fiscales à tout le monde de la même façon.
  2. Dans l’ensemble, je pense que l’Agence a des procédures équitables pour régler les problèmes.
  3. Je pense que l’Agence communique ses processus de règlement des différends sur son site Web avec le public.
  4. Je pense que l’Agence est claire en ce qui concerne ses procédures.
  5. Je sais que je peux enquêter sur le rendement de l’Agence sur son site Web, si je le souhaite.
  6. Je pense que l’Agence a mis en place les mesures de protection appropriées pour protéger les renseignements de nature délicate.
  7. Je me sentirais à l’aise de déposer des oppositions à l’Agence, si je devais le faire.
  8. Je pense que l’Agence se comporte de façon éthique et honnête lorsqu’elle aborde des questions liées aux lois fiscales.
  9. Je pense que l’Agence impose des pénalités équitables aux contrevenants.

Profil des répondants

Merci. Maintenant, avant de terminer, je vais vous poser quelques questions à votre sujet à des fins statistiques. Soyez assuré que toutes vos réponses demeureront strictement confidentielles. Si vous souhaitez sauter une question, veuillez l’indiquer une fois que vous avez entendu la question.

PRE-TEST UNIQUEMENT

SI OUI, POSEZ LA QUESTION PT2 Quelle(s) question(s) avez-vous trouvé difficile à comprendre? (ENREGISTREZ LA RÉPONSE)

Voilà ce qui met fin à notre sondage. Merci beaucoup pour vos commentaires réfléchis. Nous vous en sommes fort reconnaissants.

Canada Revenue Agency
Measuring Agency Strategic Performance Measurement Framework Outcomes
(2021-2022)
Businesses and Tax Intermediaries Questionnaire

Introduction

Hello/Bonjour, on behalf of Canada Revenue Agency (sometimes referred to as the CRA) and in accordance with provisions of the Privacy Act and other relevant acts, Narrative Research is administering a survey. The following questionnaire focuses on current issues of interest to Canadians. Si vous préférez répondre au sondage en français, veuillez cliquer sur FRANÇAIS [DIRECT RESPONDENT TO THE FRENCH LANGUAGE VERSION]

Your decision to participate is voluntary and will in no way affect your relationship with the Government. Your answers will be kept entirely confidential, and we assure you that your answers will remain anonymous. The survey takes about 10 to 15 minutes to complete. PRIVACY POLICY AND VERIFICATION ON BOTTOM OF EACH SURVEY PAGE

Click next to start the survey.

If you have any questions regarding this survey or would like to verify the legitimacy of this research, you can contact Kim Huang at kim.huang@cra-arc.gc.ca, or visit canada.ca/por-cra. You may also leave a message with Narrative Research at 1-888-854-6555, and someone will call you back.

Screener

Interaction with CRA

Thank you for your responses. This survey is [Business: geared towards businesses] [TI: being conducted among tax intermediaries] to help the CRA learn about your experiences.

Perception of CRA - Fairness

Motivations to pay taxes

E-Services

Next, please rate the following statements regarding electronic services, or e-services that the CRA provides such as ‘My Business Account’ or ‘Represent A Client,’ which lets the taxpayers view their tax and benefits information and manage their tax affairs online.

Perceptions of CRA - Integrity

Corporate Profile

These last few questions will be used for statistical purposes only. Please be assured that all of your answers will remain completely anonymous and confidential.

PRE-TEST ONLY: TO BE REMOVED AFTER PRE-TEST [n = at least 10 in each official language]

That concludes the survey. Thank you very much for your thoughtful feedback. It is much appreciated.

Agence du revenu du Canada
Mesure des résultats du cadre de mesure du rendement stratégique de l’Agence
(2021-2022)
Questionnaire sur les entreprises et les intermédiaires fiscaux

Introduction

Bonjour/Hello, au nom de l’Agence du revenu du Canada, et conformément aux dispositions de la Loi sur la protection des renseignements personnels, Narrative Research mène un sondage de recherche. Le sondage suivant les enjeux actuels qui intéressent les Canadiens. If you prefer to complete the survey in English, please click on ENGLISH. [DIRIGE LE RÉPONDANT VERS LA VERSION ANGLAIS].

La participation à ce sondage est volontaire et votre décision d’y participer ou non n’aura aucune influence sur votre relation avec le gouvernement. Vos réponses demeureront entièrement confidentielles, et nous vous assurons que vos réponses demeureront anonymes. Le sondage prend environ 10 à 15 minutes à remplir.

Cliquez sur suivant pour commencer le sondage.

Si vous avez des questions concernant ce sondage ou si vous souhaitez vérifier la légitimité de cette recherche, vous pouvez contacter Kim Huang à kim.huang@cra-arc.gc.ca, ou visiter canada.ca/por-cra. Vous pouvez aussi laisser un message avec Narrative Research à 1-888-854-6555, quelqu’un vous rappellera.

Questionnaire de sélection

Interaction avec de l’Agence

Merci de vos réponses à notre sondage. Ce sondage est [Entreprises: axé sur les petites et moyennes entreprises] [TI : mené auprès d’intermédiaires fiscaux] pour aider l’Agence à en apprendre davantage sur vos expériences.

Perceptions de l’équité de l’Agence

Motivations pour payer l’impôt

Services électroniques

Ensuite, veuillez évaluer les énoncés suivants concernant les services électroniques que l’Agence fournit, comme « Mon dossier d’entreprise » ou « Représenter un client », qui permet aux contribuables de consulter leurs renseignements sur l’impôt et les prestations et de gérer leurs affaires fiscales en ligne.

Perceptions de l’intégrité de l’Agence

Profil de l’entreprise

Pour terminer, nous aimerions vous poser quelques questions à des fins purement statistiques. Soyez assuré que toutes vos réponses demeureront strictement anonymes et confidentielles.

Final SONDAGE-TEST SEULEMENT :

Voilà ce qui met fin à notre sondage. Merci beaucoup pour vos commentaires réfléchis. Nous vous en sommes fort reconnaissants.