Public Health Agency of Canada
Symbol of the Government of Canada

E-mail this page





Resource Library

Hepatitis C Prevention, Support and Research Program
Health Canada

Get the Facts: Mid-term evaluation report

Appendix 1
Data Collection Matrix

1.0 Scope of the Problem

Evaluation Question

Planned Approach

Indicators

Method/
Instrument

1.01 What is the current state of hepatitis C in Canada? A review of the literature related to hepatitis C in Canada. A comparative analysis will focus on diseases that share important characteristics with hepatitis C. The analysis will compare hepatitis C with hepatitis B and HIV/AIDS on the following:
  • Disease epidemiology
  • Federal response
  • Risk factors and groups at risk
  • Social and economic costs of the disease
  • Care and treatment support, prevention, community-based support and research
A general overview of other similar hepatitis C programs in other jurisdictions.

A survey of health experts to gather feedback related to hepatitis C in Canada.

Interviews with Other Stakeholders to gather feedback related to hepatitis C in Canada.
1.01a Incidence, prevalence, co-infection and transmission trends

1.01b Evidence of federal response to hepatitis C situation

1.01c Identification of social and economic costs of disease

1.01d Evidence of risk behaviours among populations at risk

1.01e Care and treatment support, prevention, community-based support and research
Literature review
HES
OSI

Legend:

HES: Health Expert Survey
OSI: Other Stakeholder Interview
I/OS: Implementation/Outcome Achievement Survey
SI: National and Regional Staff and Advisory Group/Committee Interview
CCS-DES: Community Case Study Descriptions 
CCS-PCI: Community Case Study – Primary Client Interview 
CCS-SCI: Community Case Study – Secondary Client Interview

2.0 Program Implementation

Evaluation Question

Planned Approach

Indicators

Method/
Instrument

2.01 Has the hepatitis C Program been implemented as designed? Review the Program documents, Program Logic Model and framework, and look for evidence (data/information obtained by Program staff, other stakeholders/ partners) of Program delivered according to planned activities and outputs. The following items will be included in the review:
  • development and dissemination of information, tools, guidelines
  • funding of prevention, support and research projects
  • ongoing consultation/liaison
  • development of strategic directions
For each activity and output identified by the Program explore and note suggestions for improvement.

Link information on Program Implementation to Program outcomes:
  • survey funded projects/ initiatives to determine if the Program is on its way to achieving its intended outcomes
  • interview national and regional Program staff and advisory group/committee members to determine if the Program is on its way to achieving its intended outcomes
2.01a Information tools, best practices, training adequately developed and disseminated

2.01b Evidence of consultation with stake- holders, partners, regions and target groups

2.01c Number of organizations and researchers the Program has enabled to work on hepatitis C issues

2.01d Evidence of analysis of needs and gaps in HCV projects and initiatives funded

2.01e Evidence of Program responsiveness to changing interests and priorities

2.01f Evidence of consistent application of Program guidelines and delivery mechanisms

2.01g Identified duplication in implementation
I/OS
Document Review
SI

Legend:

HES: Health Expert Survey
OSI: Other Stakeholder Interview
I/OS: Implementation/Outcome Achievement Survey
SI: National and Regional Staff and Advisory Group/Committee Interview
CCS-DES: Community Case Study Descriptions
CCS-PCI: Community Case Study – Primary Client Interview
CCS-SCI: Community Case Study – Secondary Client Interview

3.0 Outcome Achievement

Evaluation Question

Planned Approach

Indicators

Method/
Instrument

3.01 To what extent has knowledge been generated through research about hepatitis C as a result of the Program?

For each of the six evaluation questions listed, a review of the extent of progress in achieving the expected outcomes will be made. To do this the following will be undertaken through a review of Program documents and the Outcome Achievement Survey:
  • An inventory of outcome data based on identified/ selected indicators
  • Time series comparisons of indicator information (newly collected data and existing data, when possible)
  • Funded vs. non-funded comparisons of data when possible
3.01a Research findings attributable to Program

3.01b Dissemination activities
Literature review
Document review
I/OS
3.02 To what extent has there been increased use of hepatitis C information by people infected with/ affected by and at risk of HCV and by individuals, groups, caregivers, and organizations providing support and care, as a result of the Program?

3.02a Statements/ evidence of research/ prevention/care and awareness of treatment support information by HC, NGOs, community organizations and primary clients

3.02b Use and integration of needs assessments, best practices and resources developed

3.02c Community groups integrate research component into project activities

I/OS
CCS-PCI
CCS-SCI and OSI
Document review
3.03 To what extent have effective partnerships and collaborations been developed in response to hepatitis C issues, as a result of the Program? 3.03a Number of partnerships and collaborations per year

3.03b Number of new partnerships and collaborations or evidence of efforts to engage new partners

3.03c Type and quality of partnerships/ examples of working together

I/OS and CCS-SCI
Document review
3.04 To what extent have the community-based organizations, partners in Program delivery and researchers developed capacity to address hepatitis C issues, as a result of the Program?

  3.04a Number of professionals and non-professional caregivers trained by Program

3.04b Types of capacity developed within community groups and partner organizations (degree of participation, volunteer leadership, etc.)

3.04c Number of volunteers

3.04d Ability of social and scientific researchers supported by the Program to contribute to HCV body of knowledge

I/OS
Document review
CCS-SCI
3.05 To what extent has there been improved access to prevention and care and treatment support?

3.05a Development of innovative care and treatment models and application of models to programming

3.05b Availability of innovative support services for infected and affected individuals

3.05c Referrals to care and treatment support resources

3.05d Type and number of clients served

I/OS
Document review
CCS-PCI
CCS-SCI
3.06 What is the level of public awareness of hepatitis C? 3.06a Public sensitivity to and awareness of hepatitis C

3.06b Awareness of risk factors, transmission

3.06c Awareness of prevention methods

3.06d Knowledge of drug use practices and support for harm reduction programming
CCS-PCI

Legend:

HES: Health Expert Survey
OSI: Other Stakeholder Interview
I/OS: Implementation/Outcome Achievement Survey
SI: National and Regional Staff and Advisory Group/Committee Interview
CCS-DES: Community Case Study Descriptions
CCS-PCI: Community Case Study – Primary Client Interview
CCS-SCI: Community Case Study – Secondary Client Interview

4.0 Lessons Learned

Evaluation Question

Planned Approach

Indicators

Method/
Instrument

4.01 What has worked well and what has not worked well?

Through interviews, surveys and case studies, identify Program successes and best practices, Program weaknesses and areas needing improvement

4.01a Identified Program successes and best practices

4.01b Identified Program weaknesses and areas needing improvement

All methods/ instruments


All methods/ instruments
4.02 What are some of the Program’s best practices and what are some of the recommendations for Program change and improvement? Through interviews, surveys and case studies, identify recommendations to support the long term success and sustainability of the Program outcomes 4.02a Identified recommendations to support the long term success and sustainability of Program outcomes All methods/ instruments

Legend:

HES: Health Expert Survey
OSI: Other Stakeholder Interview
I/OS: Implementation/Outcome Achievement Survey
SI: National and Regional Staff and Advisory Group/Committee Interview
CCS-DES: Community Case Study Descriptions
CCS-PCI: Community Case Study – Primary Client Interview
CCS-SCI: Community Case Study – Secondary Client Interview

[Previous] [Table of Contents] [Next]