Assessment of Health Canada’s communications to external stakeholders on marketed health products

Qualitative research

Final report

Prepared For: Health Canada
Supplier name: Pollara Strategic Insights
Contract Number: HT372-184553/001/CY
Contract Value: $84,805.05 (HST Extra)
Award Date: March 19, 2019
POR Registration Number: 136-18
Health Canada POR Number: 18-25
February 10, 2020

For more information on this report,
please contact Health Canada at:
hc.cpab.por-rop.dgcap.sc@canada.ca

Submitted by:
Richard Leigh-Bennett,
Vice President richardleighbennett@pollara.com
613-793-7753
1255 Bay Street, Suite 900 Toronto, ON M5R 2A9

Copyright

This public opinion research presents the results of a series of in-depth stakeholder interviews conducted by Pollara Strategic Research on behalf of Health Canada. This study consisted of 81 telephone interviews with Health Canada stakeholders from across the country. The purpose of the study was to understand current perceptions of stakeholders of various Health Canada communication tools related to Marketed Health Products.

This publication may be reproduced for non-commercial purposes only. Prior written permission must be obtained from Health Canada. For more information on this report, please contact Health Canada at: hc.cpab.por-rop.dgcap.sc@canada.ca or at:

Health Canada, CPAB
200 Eglantine Driveway, Tunney’s Pasture
Jeanne Mance Building, AL 1915C
Ottawa Ontario K1A 0K9

February 10, 2020
Contract Number: HT372-184553/001/CY
POR Registration Number: 136-18
Catalogue Number: H14-344/2020E-PDF
International Standard Book Number (ISBN): 978-0-660-33938-2
Related publications (registration number: POR 136-18):
Catalogue Number: H14-344/2020F-PDF (Final Report, French)
ISBN: 978-0-660-33939-9

© Her Majesty the Queen in Right of Canada, as represented by the Minister of Health, 2020

Table of contents

Political neutrality certification

I hereby certify as Senior Officer of Pollara Strategic Insights that the deliverables fully comply with the Government of Canada political neutrality requirements outlined in the Policy on Communication and Federal Identity and the Directive on the Management of Communications.

Specifically, the deliverables do not include information on electoral voting intentions, political party preferences, standings within the electorate or ratings of the performance of a political party or its leaders.

Signed:

Richard Leigh-Bennett,
Vice President
Pollara Strategic Insights

Executive summary

Pollara Strategic Insights (Pollara) is pleased to present this report to Health Canada summarizing the results of interviews with its stakeholders regarding the Marketed Health Products Directorate’s external communications.

Feedback from this research will be used to inform the refinement of Health Canada’s communications to key stakeholders to better meet their information needs related to health product safety and effectiveness.

The purpose and objectives of this research were as follows:

It is important to note that qualitative research is designed to reveal a rich range of opinions and interpretations rather than to measure what percentage of the target population holds a given opinion. These results must not be used to estimate the numeric proportion or number of individuals in the population who hold a particular opinion because they are not statistically projectable.

Key findings were:

Research Firm: Pollara Strategic Insights (Pollara)
Contract Number: HT372-184553/001/CY
Contract award date: March 19, 2019
Contract value: $84,805.05 + HST

Background and objectives

Health product safety in Canada is a shared responsibility. Many different organizations and individuals, including Health Canada, health care professionals, manufacturers, consumers and others, have a role to play in the effective and timely communication of health product safety information.

As part of its role, Health Canada develops a wide range of products designed to communicate externally to key stakeholders (including the public) on issues related to health product safety, including, but not limited to:

Timely communication of important safety information allows health care professionals, patients, consumers, manufacturers, and other interested persons, access to the most current information concerning the potential risks and benefits of marketed health products.

The key responsibility for communicating externally regarding the safety of marketed health products rests with the Marketed Health Products Directorate (MHPD), situated within the Health Products and Food Branch (HPFB), which assesses and manages the safety of health products in the context of real-world use. MHPD oversees a wide range of products, regulated under various legal frameworks, including pharmaceuticals (prescription and non-prescription); biologics including biotechnology, radiopharmaceuticals and vaccines; natural health products; medical devices; and materials and therapeutic products of human origin (blood; cells, tissues and organs, and gametes for assisted human reproduction). Through the monitoring and assessment of new safety risk issues, the MHPD identifies risks that require communicating to health care professionals and/or the general public.

The Regulatory Operations and Enforcement Branch (ROEB), as well as the Communications and Public Affairs Branch (CPAB), also produce tools designed to communicate externally on topics related to health product safety.

In an effort to understand the effectiveness of its existing external communications approach and to inform its approach moving forward, Health Canada engaged Pollara to work with key stakeholders to assess uptake of its communications tools, obtain feedback on its current approach (including timing and utility of products), and provide recommendations on how Health Canada can improve its communication to key stakeholders and better meet their information needs related to health product safety and effectiveness.

Input from these key stakeholders is required in an effort to inform the approach moving forward. More specifically, feedback was sought to determine the effectiveness of Health Canada’s existing communications, as well as what Health Canada needs to do to ensure its information is reaching key stakeholders with the information/content they need, in the formats they need it, through a mode that is easy and convenient, and in ways that maximize the likelihood that the information will be accessed and used.

The purpose and objectives of this research were as follows:

Due to the qualitative nature of this study, results cannot be extrapolated to a broader audience and should be considered indicative, rather than definitive.

Contract Value for this research: $84,805.05 + HST

Research approach

A total of 81 confidential in-depth stakeholder interviews were conducted for this research. They were identified in the sample provided by Health Canada as belonging to or being representatives of one or more stakeholder subgroups, as follows:

Stakeholder group(s) # of interviews

Government

6

Pharmacists

9

Industry

21

Health care professionals (physicians, nurses)

16

Patient safety/Advocacy

11

Pharmacists + Industry

13

Pharmacists + Advocacy

1

Other

4

Total

81

Health Canada sent bilingual email invites to its stakeholders, explaining the background and objectives of the research, and introducing Pollara as the neutral third party conducting the research (See Appendix A).

Follow-up invites were then sent by Pollara and interviews were scheduled with interested stakeholders between July 22 and September 10, 2019. Upon scheduling of the interview, stakeholders were sent a background document containing a list of and links to the communications tools that would be discussed. Interviewees were asked to read the document in preparation for the interview (See Appendix D).

Interviews were conducted by telephone in the participants’ official language of  choice, resulting in 10 interviews conducted in French and 71 in English. Interviews lasted approximately 45-60 minutes and followed a pre-established interview guide (See Appendix B). The interview guide included an introduction section, reiterating the objectives of the research, and informing the interviewee of confidentiality and anonymity. It also allowed for confirmation of the stakeholder’s organization or profession and stakeholder group, in order to ensure that the correct person was reached.

In order to offer interviewees optimal scheduling flexibility, a team of three senior qualitative research professionals conducted the interviews. Notes were captured and shared by the research team through a database. The team also met regularly to discuss findings and provide updates throughout the interviewing period.

In addition to interviews, select web usage data from January 1 to June 30, 2019, were supplied by Health Canada. Data included metrics on visits, page views and bounce rates for five different website landing pages, as well as six sub-pages for one website. These numbers excluded internal government of Canada traffic.

A website is typically made up of web pages. A visit occurs when someone lands on a website; a visit can be divided into what the visitor does, including going to different web pages (called ‘page views’). Page views are typically higher than visits, especially if there are many web pages on a website. If the visitor leaves without clicking on anything (or does nothing for 30 minutes or more) then it is considered a ‘bounce.’ Bounce rate is the percentage of visits that were bounces; the rate can be an indicator of a problem but if the website has little-to-no web pages then the bounce rate can also be high.

Detailed findings

Except where specifically indicated, the findings represent the combined results across the various stakeholder groups and for both English and French respondents.

1. Information sources

Virtually all stakeholders use Health Canada sources for information on marketed health products.

Many participants declared both receiving and looking for information themselves on the safety of marketed health products.

Among all of those interviewed, few reported either only having information sent to them or only searching for information themselves. Often, looking up information would be as a result of having received a communication. For example, stakeholders reported  that they would sometimes follow a link to find out more information or follow up directly online or with a Health Canada contact to get more information about a topic of interest or importance to them that was first brought to their attention through an email.

Top-of-mind, a few issues were brought up about the communications in general:

“It seems to be random what gets sent directly and what does not.”
“Be more transparent about how often communications are supposed to come out, what one is signed up for, how to sign up for other emails, or how they select who gets what - especially Letters to Professionals.”

As mentioned by many, there is a lingering concern that they may not be subscribed to all that is relevant to them. As one participant put it, “you can’t know what you don’t know.”

This only serves to underscore the importance of finding a simple, streamlined and comprehensive method for stakeholders to subscribe to communications and ascertain that they will receive all of the information that is relevant to their needs.

“Would be nice not to have to sign up for everything separately.”
“would be nice if we could request summary of pediatrics topics, or check off some boxes for more narrower scope of topics to get emails about.”

A corollary to not having one single area for subscribing, is that it also causes stakeholders to not know what Health Canada has to offer them. A case in point is the list of communication tools that was forwarded to participants ahead of the interview.

“I hadn’t seen all of this…I didn’t know some of these things existed.”
“This document should be distributed, or put online as a one-stop resource. There should be a list, and a how-to use, or a quick reference list to everything that they may have instead of having to search for information.”
"The PDF you sent me, it’s great! They should send it out [to everyone].”

Given their responsibilities, a number of those interviewed reported concern about possibly missing something important.

Many of those interviewed, at some point or another, will search for information on the Health Canada website. The main feedback on the website revealed that:

“It’s not very intuitive, but to be expected for a government site.”
“Documents aren’t always in the right date order.”
“I’ll consult the Health Canada site. I'll type in Google, for example, "Health Canada, gentian violet" because I find the site difficult to navigate." (“Je vais consulter le site de Santé Canada. Je vais taper dans Google, par exemple, ‘Santé Canada, violet de gentiane’ parce que je trouve le site difficile à naviguer.”)

Many participants stated, at various points in the interview, that they rely on multiple sources of information, in addition to Health Canada:

Multiple sources result in receiving the same or similar information multiple times.

Virtually no one mentioned referring to social media for information on marketed health products, without being prompted.

With respect to the information stakeholders want to receive from Health Canada, regarding the safety of marketed health products, answers were quite disparate.

2. Familiarity with communication tools

In preparation for the interview, a list with links to a multitude of communication tools from Health Canada’s Marketed Health Products Directorate (MHPD) was sent to all stakeholders who agreed to participate in the study. The list (see Appendix D) was divided into four categories (each with multiple tools, except for Guidance and Regulations), as follows:

  1. Guidance and Regulations (only one tool)
  2. Risk Communications
  3. Health Product Safety Information
  4. Communications around Transparency/Transparency Initiatives for the Public

As part of the interview, participants were asked to identify the category they were most familiar with, as well as the other categories they had some degree of familiarity with.

Regardless of which set of communication tools respondents identified as the one they were the most familiar, many of the stakeholders interviewed were at least somewhat familiar with all four categories.

Multiple tools were listed in each of the Risk Communications and the Transparency Initiatives categories. Many respondents were at least familiar with one or two within each respective set.

To put these findings in perspective, web anyaltics were provided for five tools in the Risk Communications (Annual Trends Report and Health Product Infowatch)and the Transparency Initiatives (Canada Vigilance Adverse Reaction Online Database, New Safety and Effectiveness Reviews, and Reports and Publications - MedEffect Canada) categories. 

This analysis shows that the Canada Vigilance Adverse Reaction Online Database had the highest number of visits and page views of the five tools. A total of 22,102 page views for the English version and 2,497 for the French version were recorded. Health Product InfoWatch garnered the second most number of page views at 7,512 for the English site and 1,218 for the French site.

The Annual Trends Report recorded the fewest number of page views at just over one thousand (1,005) for the English site and just under one hundred (93) for the French site. See Figure 1.

There could be a range of reasons for the disparity between the tools most familiar to the interviewees and the web usage data. As stipulated in the qualitative disclaimer, qualitative data cannot be generalized to the whole population. Additionally, this study focussed on specific stakeholders (e.g., industry, health care professionals) while anyone can visit the websites.

Figure 1. Page views and visits for select English and French tools from January 1 to June 30, 2019.

Figure 1. Text version below.

Text description
Tool Page Views Visits

Canada Vigilance Adverse Reaction Online Database

22,102

16,076

Base de données en ligne des effets indésirables de Canada Vigilance

2,497

1,899

Health Product InfoWatch

7,512

5,689

InfoVigilance sur les produits de santé

1,218

965

New Safety and Effectiveness Reviews

5,155

4,364

Nouveaux examens de l'innocuité ou de la sûreté et de l’efficacité

1,673

1,396

Reports and Publications - MedEffect Canada

3,232

2,311

Rapports et publications - MedEffet Canada

238

151

Annual Trends Report

1,005

831

Rapport annuel sur les tendances

93

78

As indicated in Figure 2, Canada Vigilance Adverse Reaction Online Database had the lowest bounce rate among the four categories of communication tools at 15% for the English version and 34% for the French version, indicating that once at this site, more visitors viewed other pages within this site.

The highest bounce rate (i.e., visitors viewing the site then leaving) was for the New Safety and Effectiveness Reviews (73% for the English site and 75% for the French site). This particular site is a listing of Brand Name/Product Class/Medical Device(s), Medicinal Ingredient(s), and Potential Safety Issues with only two links to other pages so visitors can scroll through the one page and find most of the information they are looking for.

Figure 2. Bounce rate for select tools from January 1 to June 30, 2019.

Figure 2. Text version below.

Text description
Tool Bounce Rate

New Safety and Effectiveness Reviews

73%

Nouveaux examens de l'innocuité ou de la sûreté et de l'efficacité

75%

Annual Trends Report

54%

Rapport annuel sur les tendances

59%

Health Product InfoWatch

37%

InfoVigilance sur les produits de santé

35%

Reports and Publications - MedEffect Canada

20%

Rapports et publications - MedEffet Canada

43%

Canada Vigilance Adverse Reaction Online Database

15%

Base de données en ligne des effets indésirables de Canada Vigilance

34%

Web page metrics for January to June 2019 InfoWatch monthly issues

Health Product InfoWatch also has monthly issues. Metrics for page views, visits, and bounce rates for January to June 2019 were collected.

The January issue page received the most number of page views and visits of the monthly issues pages for both languages, followed by the May version. See Figure 3. Bounce rates among the monthly updates range from just over 52% up to 68%. See Figure 4.

Figure 3. Page views and visits for January to June 2019 InfoWatch monthly issues.

Figure 3. Text version below.

Text description
Monthly issue Page Views Visits

January 2019

5,504

4,267

Janvier 2019

3,209

2,699

February 2019

2,329

1,918

Fevrier 2019

741

621

March 2019

2,608

2,072

Mars 2019

546

451

April 2019

2,346

1,899

Avril 2019

496

439

May 2019

4,825

3,871

Mai 2019

1,797

1,535

June 2019

1760

1,530

Juin 2019

798

721

Figure 4. Bounce rate for January to June 2019 InfoWatch monthly issues.

Figure 4. Text version below.

Text description
Monthly issue Bounce Rate

January 2019

57%

Janvier 2019

68%

February 2019

52%

Fevrier 2019

60%

March 2019

54%

Mars 2019

52%

April 2019

54%

Avril 2019

53%

May 2019

58%

Mai 2019

57%

June 2019

62%

Juin 2019

68%

3. Evaluation of communication tools

After identifying the category they were most familiar with, stakeholders were asked to evaluate the sources for the information in this category, the importance and value as a source of information, as well as how it compared to various other sources they may use.

Health Canada is generally considered the most important source, or certainly among the most important ones, for information related to the category selected by the respondent.

“Health Canada is the most important source.”

There were only a few participants who suggested that Health Canada was the only source of information regarding the safety of marketed health products.

For each of the individual categories, which were the focus of more in-depth evaluations, most participants identified other important sources of information:

“Many health care professionals don’t access these types of databases, [such as], MedEffect, Canada Vigilance Database and others, whether to input or search for information.”
"I receive the information another way and I don't report it."  (“Je reçois l’information autrement et je ne fais pas de signalements.”)

Without being prompted, certain stakeholders stated that they look at what is being done by the FDA and the EMA, and to a much lesser degree Australia’s Therapeutic Goods Administration (TGA), as a frequent indicator of the direction that will be taken by Health Canada.

"The FDA, the EMA and the Australia sites, because there are a lot of similarities between Australia and us." (“Le site de la FDA, de l’EMA et de l’Australie, car il y a beaucoup de similarités entre l’Australie et nous.”)

When specifically asked how the information from Health Canada generally compares to that of other regulatory agencies, most respondents went beyond simply contrasting the information and delved into a more general assessment of how the various agencies differed:

"But one has the impression that Health Canada takes less of a stance than the others." (“Mais on a l’impression que Santé Canada prend moins position que les autres.”)

As was often mentioned in the top-of-mind general discussion, when speaking about the tools, Health Canada’s website, overall, is for the most part said to be much less user-friendly than those in other jurisdictions.

“The USFDA and European Medicine Agency, it’s easier to find information on these websites. They are a little easier to navigate.”
“It's not user-friendly. There is a lot of information, but it’s poorly categorized. Searches are now done on Canada.ca and not on Health Canada and the results you get back are hellish! We’re now going to Google first.” (“C’est pas user-friendly. Il y a beaucoup d’info mais, mal classifié. Les recherches sont maintenant sur Canada.ca et pas sur Santé Canada et le retour d’information, c’est l’enfer! On va maintenant sur Google en premier.”)
“…A lot of clicks to get to what I’m looking for. I have to work for it but (I have) a lot of tricks and bookmarks to help out.”

Many of the stakeholders interviewed will, for the most part, characterize the quality of Health Canada products as good, if not excellent.

There were virtually no issues with the language used, in any of the communication tools discussed. Although some felt it was often “governmenteez” or has a quite formal tone, this was seen to be fitting for both the communicator (Health Canada) and its audience (professional stakeholders in the health care sphere).

However, timeliness is a definite issue for many, saying that Health Canada tends to lag and not be proactive in sharing information. However, it was also mentioned by those who have been in the health care field for longer periods of time, that Health Canada is getting better, often specifically mentioning the Transparency Initiative as a catalyst for this move in a positive direction in the past few years. There is still a sense that more can be done to be truly transparent. It was said for example that when it comes to guidance and regulations, a consistent feedback loop is missing. Stakeholders expressed that it would be nice to receive acknowledgement when they respond to a consultation and for Health Canada to keep them in the loop when decisions are made, when guidance is finalized, and to let them know what they did with feedback. While this is related to stakeholder engagement in general, the lack of transparency in communications negatively affects stakeholder opinions of the organization and its communications as a whole.

The most positive assessment of Health Canada is with regards to perceptions of trust and of having public confidence:

“Health Canada should be more vocal because there is a lot of confusion and misinformation. They are making strides but need to take this seriously.”
“Health Canada is uniquely positioned to be a home base for information. They have to get better at this. Not because of their failures, but because of the depth of challenge in general with people accepting any authority on scientific information in this day in age.”

The quality of the written French of some of the online tools was mentioned by several respondents.

4. How information is received

The majority of the stakeholders interviewed receive information from Health Canada via email. Virtually all of them prefer this approach because emails arrive in their inbox where they can be filtered, managed, filed and transferred to others. That said, some suggestions were made as to how to improve this form of communication:

The use of RSS feeds is also an effective way of keeping up-to-date. It is rarely the sole means for participants to ensure they receive all pertinent information, but more of an additional method.

A few respondents also proposed that Health Canada/MHPD be more active on social media, as an additional means of communicating with stakeholders.

Health care practitioners appear to have a lower awareness of the tools than other stakeholders who, unlike these practitioners, are not necessarily on the front line (such as those who work for industry, associations, NGOs, health care administration or research). They have formed their own habits and use other sources in order to obtain information.

“Make clinicians aware that reporting adverse events is important, lends to data quality, making it more useful and improves prescribing and patient care….Doing that without it coming across as double-documentation and a lot of work.”

Those who use tools that are not pushed but rather reside on the Health Canada website somewhere (such as product monographs, various databases, guidelines and regulations) are more likely to say that they are not easy to find/access. Some other issues were also mentioned specifically:

“Frustrating that the monograph does not have a fixed URL.”

5. Relevance and clarity and use of information

Generally-speaking, the information respondents receive or find in databases and on the website tends to be “the right information.”

However, a number of the stakeholders interviewed raised issues about the information, beyond its relevance.

“I have emailed for clarification. Sometimes a person I know, otherwise have reached out to the individual noted on the email. But if it was a generic “info” email, turnaround time tends to be slow. I try to avoid that.”

Regardless of the aforementioned issues, if people subscribed to emails and RSS feeds, it was because they have, or at some point in the past, had, an interest in the information.

Indeed, everyone who receives information reported looking at it immediately or at a designated point in time, as part of their routine.

The information was usually skimmed through for relevance and read in depth when it was warranted.

Virtually everyone reported that they shared some of the information they received at one time or another. In fact, when asked what is typically done with this information, or whether it changes behaviour, the answer for the most part was that it does not change their behaviour (besides perhaps adding to their to-do-list that they need to respond to a request for consultation) and that their typical action is to also share it. This could be internally or externally.

Once deemed appropriate, the form that the information-sharing takes will vary by stakeholder.

Besides sharing it, uses for the information varies greatly by stakeholder group, by the individual responsibilities of each respondent and, of course, the nature of the information itself.

There is an acknowledgement, by most who have been engaging regularly with Health Canada over a certain number of years, that Health Canada has been improving in the past few years with respect to clarity of information, language used in communications, and overall transparency.

“It is not easy to follow and understand… they have to have info that is more readable for the general population.”

It should be noted that given the number of front-line health care providers who were part of the study and the fact that many did not regularly look at, or receive information from Health Canada directly, there were generally not a lot of “behaviour changes” as a result of such communications.

6. Recommendations

The Health Canada website and the subscription services and communications tools were two major areas for suggested improvement identified by almost all stakeholders across all classifications and communication categories.

The website

The Health Canada website, or at least that which is front-facing for the stakeholders who were interviewed, should ideally be redesigned to incorporate the following considerations:

Subscription services and communications tools

There are issues related to the awareness of some services and communication tools, how to register for these tools, and to specific content that must be addressed.

Ideally, stakeholders should be made aware of the various communications products and tools that are available to them. In other words, not only communicating the information, but also about the tools and communications products that are out there. The PDF document that was provided to respondents, prior to the interviews, would be a good start in terms showing the products that are available from MHPD.  The following considerations should be incorporated:

Appendix A: Invite letter    

Hello,

Health Canada’s Marketed Health Products Directorate (MHPD) oversees a wide range of products regulated under various legal frameworks, including pharmaceuticals, biologics, including cell and gene therapies, natural health products, and medical devices.  MHPD works to protect Canadians by monitoring and assessing the safety and effectiveness of health products on the Canadian market, while minimizing and managing their risks, and communicating those risks to healthcare professionals and/or the general public.

Health Canada has engaged Pollara Strategic Insights, a national market research firm,to carry out a series of key stakeholder interviews to evaluate the effectiveness of its external communications approach and various communications tools including: Guidance and Regulations Documents; Risk Communications; Health Product Safety Information; and Communications around Transparency Initiatives for the Public. Health Canada is also seeking recommendations on how to improve its communications to better meet information needs related to health product safety and effectiveness.

As an important stakeholder who may use these tools, your opinion is important to us and you are invited to share your views in this research project through a confidential telephone interview with a researcher from Pollara. Your insights and comments will greatly assist Health Canada in making future communications more accessible and relevant to its intended audiences.

In the next few weeks, you may be contacted by a representative from Pollara to schedule a one-hour interview. If you are interested in participating, you can also directly contact Richard Leigh-Bennett, Vice President, at  RichardLeigh-Bennett@pollara.com or by telephone at 613-793-7753 (French letter: Marcel Proulx, Senior Associate at Marcelproulx@pollara.com / 514-232-8270). The interview will be conducted in the official language of your choice. Should you believe that someone else from your organization would be better suited to participate in the interview, please feel free to refer them instead. Further details and background information will be shared prior to the interview.

If you have any questions or concerns about this research, please contact Tracey Hazelwood, Manager, Strategic Partnerships and Integrated Engagement, Health Canada, by email at tracey.hazelwood@canada.ca, or by telephone at 613-866-4687.

We thank you in advance for your cooperation in this important research project.

Sincerely,
Hamida Rahim
Director

Bureau of Strategic Engagement & Integrated Management Services (BSEIMS)

Marketed Health Products Directorate

Health Canada

Appendix B: Interview guide      

Introduction

Part 1 – General

Just so we are on the same page: marketed health products are pharmaceuticals (prescription and over the counter drugs), biologics and biotechnology products, natural health products, and medical devices, that are authorized for sale in Canada.

First I have some general questions, before we get to the discussion of the materials:

  1. Does your day involve advising on, prescribing and/or using any of the marketed health products in your work? This could be something you do as a professional, maybe you are part of an advocacy group, etc.? You don’t need to give any personal or professional details. (may need to reread the definition above)
  2. Do you go looking for information on the safety of the marketed health product(s) or does the information get sent to you, or both? Do you typically refer to industry, government, social media, etc., for information about marketed health products?
  3. In general, what information do you want to receive from Health Canada regarding the safety of marketed health producsts?

Part 2 – Products used by stakeholders

Now, let’s talk about the specific communications tools we sent you to have a look at.

  1. You were sent a document listing four types of communications or information, each with some examples. Which one of these were you the most familiar with before we sent them to you? (Prompt: Guidance and regulations? Risk communications? Health product safety information? Communications around transparency to the Canadian public?)
  2. Which of the other four types were you also familiar with? [Interviewer to check off on list below]
  3. If the stakeholder is not familiar with any of the four types in the package: Why not? (Awareness? Not clear? Not useful? Other sources better?) [Interviewer to choose document to talk about and address in the following questions, assuming they had a chance to look at them pre-interview]

Interviewer note: Use table below to keep track of the buckets familiar with. Ask about buckets most familiar with and then second most familiar.

Buckets with its tools

Guidance and regulations (only one tool)

Risk communications

Health Product Safety Information

Transparency Initiatives

Part 3 – Questions for each bucket that SH says they are familiar with

Now I’d like to talk about insert bucket name from table above.

Note: Go through questions for most familiar bucket. Repeat for second bucket (if mentioned) given time.

  1. What is typically the first or most important source for this type of information? What other sources do you use for this type of information? (for example: Health Canada website, media, pharma sales representatives, professional associations, scientific literature, conferences, foreign regulatory agencies, friends, social media, etc.)
  2. How does Health Canada’s information in general compare to those other sources or regulators (i.e., the US Food and Drug Agency)? (probe: from other regulators? From industry?)
  3. Are the most appropriate formats to diseminate this information being used by Health Canada
  4. How often do you use/read them (i.e., every time you get a notice? You look something up when you have a question or concern?)
  5. Are they read carefully, or just skimmed?
  6. Do the communications tools or products contain the right information?               
  7. Is the information easy to follow / understand and clearly written?
  8. Do you share them with colleagues?
  9. How do you use this information?
  10. Does this information typically influence your behaviour? How?
    a. If no: Why not?

Note: If focusing on guidance and regulations, communication tools or risk communications, ask q11-12 or q13-15, respectively. If not, move to q16

Guidance and regulations

  1. Do you find the guidance easy to find and access?
  2. When new guidance comes out, letters are sent in advance. Do you receive these? Do you get them in a timely fashion?

Risk communications

  1. If familiar: How did you first hear of these risk communications?
  2. If familiar: Do you typically take action after receiving these communications? (Probe: deliver a warning sticker, reduce prescription, use a checklist, contact a HCP for clarification etc…?)
  3. Regarding a point of contact for you as a stakeholder to share their concerns: is this useful? Have you used it?
  1. How can the approach be improved?
  2. Anything else you’d like to share about these documents in particular?

Part 4 – Final comments

  1. Besides the tools we have been discussing that I specifically asked you to focus on, do you have any comments about any of the other documents that you may have reveiwed before this interview?
  2. Health Canada continues to communicate new health product safety information as it becomes available. How can we make this information more useful to your practice as a healthcare professional?
  3. Are there any other comments or suggestions before we wrap up?

Part 5 – Thank you and next steps

Appendix C: Thank you note      

Subject: Thank you on behalf of Health Canada

Dear (Name),

On behalf of Health Canada and Pollara Strategic Insights, we’d like to thank you for sharing your views on the various communication tools used by Health Canada to communicate risks and other information about marketed health products. Your feedback and opinions are very valuable and will assist Health Canada in making future communications more accessible and relevant to its intended audiences.

We are currently in the process of compiling all the feedback and preparing a report of what we heard in the interviews. Within six months, the final report will be public and posted online though Library and Archives Canada.

Once again, our sincerest thanks for taking the time to talk with us and provide your insights.

The Pollara Team

Appendix D: List of communication tools sent to participants       

Health Canada communication tools

These four categories of communication tools include a few documents that may or may not be familiar to you. If the document is unfamiliar, you will have an opportunity to share this with the interviewer. We have provided links and descriptions for your reference. You are not expected to be knowledgeable on any of the communication tools used by Health Canada.

1. Guidance and regulations (guidance documents, guidelines and all regulation-related communications)

Industry and other healthcare professionals have specific guidance and regulations they must adhere to in order to meet Health Canada’s requirements. If you are a healthcare professional, or represent industry, these may be familiar to you. Please see the links below for examples of such guidance.

Reports and Publications - MedEffect Canada then scroll down to Guidance Documents and Guidelines.

Policies and Guidance Documents for examples of advertising regulations.

2. Risk communications

Risk Communication tools may also be familiar to healthcare professionals:

Canadian Medical Devices Sentinel Network Bulletin (CMDSNet)

The CMDSNet issues a monthly bulletin to keep the members of the network aware of a number of items related to adverse events associated with medical devices. For instance: updates to the program, recent reports of adverse events, recent regulatory actions and outcomes which have resulted from their reports, lessons learned, highlighted issues, recently completed and upcoming safety reviews, and educational opportunities. A list of all reports submitted to the Network is also included with the monthly bulletin. The distribution of the bulletin and list of reports is limited to Health Canada and those in the CMDSNet, and are not to be distributed beyond the Network, and therefore, no example is provided.
For more information: Canadian Medical Devices Sentinel Network.

Annual Trends Report

The primary objective of the Annual Trends Report is to provide the numbers and trends of adverse drug reaction case reports and medical device incident reports to Health Canada on an annual basis. The data are based on reports submitted to Health Canada through the Canada Vigilance Adverse Reaction Online Database (more below) for reporting adverse reactions to drugs, the CV-MDS (where people report problems with medical devices), and CMDSNet.

Annual trends for the adverse reaction case reports of health products and medical device problem incidents to Health Canada (2008-2017)

Health Product InfoWatch

This is a Health Canada monthly publication to raise awareness and to provide clinically relevant information to healthcare professionals concerning marketed health products and their safety. In some cases, information is intended to stimulate reporting of similar adverse reactions.

Health Product InfoWatch

Recalls and Safety Alerts 

Health Canada sometimes needs to recall a product that is on the market, or issue a safety alert. There are several ways these recalls and safety notices are communicated. These are detailed below. 

You can search for recalls and safety alerts through this link: Search recalls and safety alerts.

3. Health Product Safety Information

Health Product Safety Information tools may also be familiar to healthcare professionals and industry:

Health-related products in Canada must be safe and effective. Each drug product has information associated with it, and this information is easily accessible through the drugs and health products portion of the Health Canada website. In addition, Health Canada has specific guidelines for each product that includes providing clear directions and ensuring the proper labelling of products. 

Product Monographs

A Product Monograph is a factual, scientific document on a drug product that describes the properties, claims, indications, and conditions of use of the drug, and contains any other information that may be required for optimal, safe and effective use of the drug.

Drug Product Database: Access the database

Directions for use/Product Labelling

These are the directions and labels on each product.

The Drug and Health Product Register (DHPR)

The DHPR was created to make information on health products available to Canadians.

The Drug and Health Product Register

4. Communications around Transparency/Transparency Initiatives for the Public

Transparency tools may also be familiar to healthcare professionals and industry:

Summary Safety Reviews (SSRs)

SSRs are Health Canada’s summaries of its safety reviews of products and drugs on the market. These are intended to provide greater transparency to Canadians. They are brief 3-page summaries that outline what was assessed, what was found and what action was taken by Health Canada, if any.  These are found in the DHPR. Here is the link: Summary Safety Reviews Search Results.

New Safety and Effectiveness Reviews

Health Canada posts lists of new safety reviews to increase transparency with Canadians and inform them of the products and risks that Health Canada is assessing. Once a new safety and effectiveness review is completed, an SSR (see above) is published to inform Canadians of what was found and what action was taken by Health Canada, if any.

New safety and effectiveness reviews

Medical Devices Online Incidents Database

The Medical Device Online Incidents Database is an online initiative for reporting adverse reactions to medical devices. It contains medical device incident reports and information regarding recalls in a user-friendly, searchable, online format. There is also a full data extract available for download.

Medical Devices

MedEffect Canada

MedEffect Canada provides consumers, patients, and health professionals with an easy way to: report an adverse reaction or side effect; obtain new safety information on drugs and other health products; and, learn and better understand the importance of reporting side effects.

MedEffect Canada

Canada Vigilance Adverse Reaction Online Database

The Canada Vigilance Adverse Reaction Online Database contains information about suspected adverse drug reactions reported to Health Canada by consumers, health professionals and market authorization holders. 

Canada Vigilance adverse reaction online database