Creative Testing and Advertising Campaign Evaluation Tool (ACET) for the Services for Seniors Advertising Campaign

Prepared for Employment and Social Development Canada

Supplier: Ekos Research Associates Inc.

Registration Number: POR 040-18

Contract Number: G9292-191660/001/CY

Contract Value: $117,458.42 (tax included)

Award Date: August 22, 2018

Delivery Date: August 13, 2019

For more information on this report, please contact Employment and Social Development Canada at nc-por-rop-gd@hrsdc-rhdcc.gc.ca

Ce rapport est aussi disponible en français

Ekos Research Associates

Contact: Susan Galley

Ottawa Office

359 Kent Street, Suite 300

Ottawa, Ontario

K2P 0R6

Tel: (613) 235 7215

Fax: (613) 235 8498

E-mail: pobox@ekos.com

www.ekos.com

Creative Testing and Advertising Campaign Evaluation Tool (ACET) for the Services for Seniors Campaign

Prepared for Employment and Social Development Canada

Supplier name: Ekos Research Associates Inc.

Date: August 13, 2019

This public opinion research report presents the results of in-person and online focus groups testing three proposed concepts, and two online surveys measuring campaign recall and impact. Each was conducted by Ekos Research Associates Inc. on behalf of Employment and Social Development Canada.

Cette publication est aussi disponible en français sous le titre : Test de concept et outil d'évaluation des campagnes publicitaires de la campagne Services pour les aînés.

This publication is available for download at canada.ca/publicentre-ESDC.

It is available upon request in multiple formats (large print, MP3, braille, audio CD, e-text CD,

DAISY or accessible PDF), by contacting 1 800 O-Canada (1-800-622-6232).

By teletypewriter (TTY), call 1-800-926-9105.

Catalogue Number:

POR-105-12-19E

PDF: Em4-22/2019E-PDF

International Standard Book Number (ISBN):

978-0-660-32003-8

Related publications (registration number: POR 40-18):

Catalogue Number: Em4-22/2019F-PDF (Final Report, French)

ISBN: 978-0-660-32004-5

© Her Majesty the Queen in Right of Canada, 2019

For information regarding reproduction rights: droitdauteur.copyright@HRSDC-RHDCC.gc.ca.

Summary

As part of its mandate to build a stronger and more competitive Canada and support Canadians in leading productive and rewarding lives, the Government of Canada (GC) offers many programs and services to help older Canadians prepare for and live in retirement. In an effort to support Canadians in leading productive and rewarding lives, the GC is working to make Canadians aware of the programs and services offered by Employment and Social Development (ESDC) and other departments to support those retired or planning to retire. To address this objective, the GC launched a Services for Seniors campaign to make older Canadians aware of the programs and services offered by Employment and Social Development (ESDC) and other departments. Canadians who are 55 or older, preparing for or living in retirement are the primary target for the campaign. Veterans and vulnerable populations 55 or older, who are Indigenous, have a low income, and/or are living with a disability or chronic illness are a secondary target audience of the campaign.

In accordance with the Policy on Communications and Federal Identity, all advertising campaigns that have a media buy over $1 million require pre-testing and evaluation using the Advertising Campaign Evaluation Tool (ACET) issued by the Communications and Consultations Secretariat of PCO. ESDC commissioned two phases of research: first to test proposed concepts providing communication material aimed at making older Canadians aware of the programs and services available; and second, to test advertising recall from the campaign, as well as measuring impact on related perceptions and behaviours, using the ACET.

Concept Testing (Focus Groups)

The study involved a series of focus groups (4 in person and 12 online) with older Canadians to garner feedback on three creative concepts, gathering reactions to animatic television ad mock ups, print ads and potential webpage layouts. The focus groups were conducted between September 25th and October 1st, 2019

Participants indicate they have searched for information to support their retirement online, in person at Service Canada offices, or through an employer. Some have felt that there was no need to look for information. Many are unaware of what resources there are from the Government of Canada, for those retired or planning to retire, beyond financial support programs such as the Canada Pension Plan.

Research findings revealed some general considerations based on feedback of participants. Across concepts, many participants noted confusion on the target audience of the communication material or the website; these participants pointed out the different needs of those retired and those planning to retire. Participants would like the intent of the ad (to go to a website for information for help with retirement) to be clearer in print ads and presented earlier in the television ads. Participants would also like to have the option of calling a 1-800 number for information rather than relying exclusively on a website.

Some wording preferences were identified. Participants felt that "seniors" is an appropriate term in the context of these concepts, along with "older Canadians". "Later years" is also an acceptable term to some, but "Golden Years" imparted negative reactions. Participants would like material to read in plain language, avoiding euphemisms and government-speak.

Of the three concepts tested, 'We Know a Lot' proved to be the most highly rated concept, with participants commending the positive and respectful tone toward older Canadians. The two concepts relying on humour to catch attention were not as well received. 'Silver Squad' was rated second overall with participants appreciating the images of seniors taking action during their retirement. The 'Prepare Right' concept conjured strong negative reactions for many participants, with the humour interpreted as being condescending towards seniors. More details regarding reactions to these concepts can be found within the report.

Three website layouts were presented to participants during the study. Overall, most participants supported a layout that was clean and uncluttered. The use of contrasting colours was preferred by many as a way to highlight and distinguish between the categories of programs and services presented in the website. Participants were divided on the need for a description of the categories on the home page of the website, as the additional wording, while intended to be informative, can take away from the clear navigability of the ideal web layout. Most participants would look at the website through their desktop or laptop computer, while some anticipate they would access through a tablet or smartphone.

Advertising Campaign Evaluation Tool (ACET) (Online Survey)

The Services for Seniors campaign was launched in late 2018, continuing throughout 2019, including multimedia advertising. In accordance with the Policy on Communications and Federal Identity, all advertising campaigns that have a media buy over $1 million require pre-testing and evaluation using the Advertising Campaign Evaluation Tool (ACET) issued by the Communications and Consultations Secretariat of PCO. The ACET was conducted in two phases; a baseline phase prior to the campaign, and a post-campaign phase. Data collection to evaluate the advertising campaign supports the goal of effectively gauging older Canadians (55 years and older), with regard to their awareness of programs for them, and in determining the effectiveness of this campaign in influencing older Canadians' knowledge and behaviour. Information gathered from this process will provide ESDC with concrete data that will assist in developing/adjusting future media strategies.

Research Purpose

Specifically, the purpose of the ACET surveys was to jointly evaluate the Services for Seniors Campaign and to gauge:

Information obtained through this research can be extrapolated to the wider population of Canadians 55 or older who access the Internet, as the sample was provided from a randomly recruited survey panel of Canadians who are online. This allows ESDC to determine the impact of its advertising campaign and provide direction on areas where the campaign can be adjusted to reach Canadians 55 or older. The findings provide useful information to improve future campaigns which are better targeted, more informative and better geared to the target population and Canadians who are 55 years of age or older.

Sample design

National online surveys were conducted: one in November 2018 as a baseline, in advance of the campaign, and one in June 2019 to measure change in awareness and to assess impact of the campaign. The baseline included 2,036 Canadians 55 years of age or older, while the post campaign sample included 2,010 Canadians, also 55 years of age or older. In each sample, just over 600 cases were completed among Veterans and vulnerable populations, including those who are Indigenous, have a low income, and/or are living with a disability or chronic illness. Each survey instrument was based on the Advertising Campaign Evaluation Tool (ACET) issued by the Communications and Consultations Secretariat of PCO. Questions testing the impact on knowledge, perceptions and behaviour targeted through the campaign were also added. Each survey instrument included a sample of randomly selected respondents from all provinces and territories. Each survey sample relied on Ekos' Probit panel, which is assembled using a random digit dial process for sampling from a blended land-line cell-phone frame, and provides full coverage of Canadians with telephone access. The distribution of the recruitment process (for the panel) is meant to mirror the actual population in Canada (as defined by Statistics Canada). As such, our more than 90,000 member panel can be considered representative of the general public in Canada (meaning that the incidence of a given target population within our panel closely resembles the public at large) and margins of error can be applied. The baseline and post-campaign surveys were sampled from the portion of the Probit panel who access the Internet, and therefore results do not represents those Canadians 55 or older who do not access the Internet.

Political Neutrality Certification

I hereby certify as Senior Officer of Ekos Research Associates Inc. that the deliverables fully comply with the Government of Canada political neutrality requirements outlined in the Policy on Communications and Federal Identity and the Directive on the Management of Communications. Specifically, the deliverables do not include information on electoral voting intentions, political party preferences, standings with the electorate, or ratings of the performance of a political party or its leaders.

Signed by:

Susan Galley (Vice President)