Service Quality Review: EI Claimant Survey

FINAL: 2016-09-08

Introduction

Hello, may I speak to [Insert: your name](INSERT CLAIMANT’S NAME FROM LIST)

IF NECESSARY, EXPLAIN PURPOSE OF PHONE CALL. SAY “I’M CALLING ON BEHALF OF THE GOVERNMENT OF CANADA TO ASK SOME QUESTIONS ABOUT THE QUALITY OF SERVICE PROVIDED BY THE GOVERNMENT”.

IF ASKED HOW WE GOT THE PERSON’S NAME, INFORM THEM IT WAS DRAWN FROM A RANDOM SAMPLE OF CANADIANS WHO MAY HAVE RECEIVED SERVICE FROM THE GOVERNMENT OF CANADA.

Would you prefer to continue in English or French? / Préférez-vous continuer en anglais ou en français? [SEE PROGRAM NOTE ON NEXT PAGE]

Hello, my name is [Insert: your name]. I’m calling on behalf of Phoenix, a Canadian public opinion research company. We’re conducting a survey for the Government of Canada to ask questions about the quality of service it provides to Canadians. This survey averages 15 minutes in length, and is registered with the national survey registration system.

Your participation in the research is completely voluntary and your decision on whether or not to participate will not affect any dealings you may have with the Government of Canada. By answering these questions, you will help the government improve the service it provides to Canadians. The information you provide will be used for research purposes only and will be administered in accordance with applicable privacy laws. Would you be willing to take part in this survey?

S1. During the past 7-8 months, have you been in contact with the Government of Canada to get information or service related to  Employment Insurance?

S2. Did someone else contact the Government of Canada during the last 7-8 months on your behalf about Employment Insurance?

Interviewer/Programming Notes

SURVERY REGISTRATION SYSTEM: IF RESPONDENT ASKS ABOUT NATIONAL SURVEY REGISTRATION SYSTEM, SAY:

The registration system has been created by the survey research industry to allow the public to verify that a survey is legitimate, get information about the survey industry or register a complaint. The registration system’s toll-free phone number is 1-800-554-9996.

PROXY RESPONDENTS: IF RESPONDENT IS NOT COMFORTABLE PARTICIPATING IN THE SURVEY FOR WHATEVER REASON (OR HAS TROUBLE UNDERSTANDING WHAT THE INTERVIEWER IS SAYING), INFORM THE RESPONDENT THAT HE/SHE CAN IDENTIFY SOMEONE ELSE TO ANSWER QUESTIONS ON HIS/HER BEHALF IF THAT PERSON HAS DEALT WITH THE GOVERNMENT OF CANADA ON HIS/HER BEHALF. IF SO, TAKE NAME/PHONE NUMBER OF PROXY CONTACT AND ASK RESPONDENT TO CONTACT THAT PERSON RIGHT AWAY TO INFORM THEM THAT THEY WILL BE CALLED (AND HAVE BEEN AUTHORIZED TO ANSWER ON THE RESPONDENT’S BEHALF). THIS IS MOST RELEVANT FOR DISABLED CANADIANS AND NEW CANADIANS, BUT NOT ONLY.

LANGUAGE OF SURVEY: IF THE RESPONDENT PREFERS TO RESPOND IN FRENCH [IF INTERVIEW IS STARTED IN ENGLISH], THEN THE INTERVIEWER MUST BE ABLE TO EITHER PROCEED WITH THE INTERVIEW IN FRENCH OR READ THE FOLLOWING STATEMENT: "JE VOUS REMERCIE. QUELQU'UN VOUS RAPPELLERA BIENTÔT POUR MENER LE SONDAGE EN FRANÇAIS." THE REVERSE IS TRUE FOR INTERVIEWS COMMENCING IN FRENCH.

HOW WE OBTAINED RESPONDENT’S NAME: IF RESPONDENT ASKS HOW WE GOT HIS/HER NAME, INFORM RESPONDENT OF THE FOLLOWING:

AUTHORITY TO COLLECT INFORMATION: IF RESPONDENT ASKS UNDER WHAT AUTHORITY THIS INFORMATION IS BEING COLLECTED, INFORM HIM/HER IT IS BEING COLLECTED UNDER THE AUTHORITY OF THE DEPARTMENT OF EMPLOYMENT AND SOCIAL DEVELOPMENT ACT, SECTION 6(a).

EMPLOYMENT INSURANCE/EI PROGRAM: THE TERM ‘EI’ IS OFTEN USED TO DENOTE THE EMPLOYMENT INSURANCE PROGRAM. ENSURE THAT RESPONDENTS UNDERSTAND THIS – THAT THE ACRONYM ‘EI’ REFERS TO EMPLOYMENT INSURANCE.

ASSESSMENTS OF SERVICE CHANNELS: ALL RESPONDENTS WHO HAVE CALLED AN EMPLOYMENT INSURANCE SPECIALIZED CALL CENTRE (I.E. USED TELEPHONE SERVICE) WILL BE ASKED THE QUESTIONS IN THE PHONE SERVICE MODULE. ASSESSING THE OTHER TWO SERVICE CHANNALS [IN-PERSON OFFICE AND ONLINE] WOULD BE DONE RANDOMLY IF SOMEONE HAS USED BOTH THOSE CHANNELS. THE FILTER QUESTIONS TO DETERMINE CHANNEL USAGE ARE Qs 1, 11 & 20.

SCALE INSTRUCTIONS: RESPONSE CATEGORIES/INSTRUCTIONS FOR SOME OF THE SCALE QUESTIONS ARE REPETITIVE. ADJUST THE FREQUENCY OF REPEATING THE INSTRUCTIONS TO ENSURE CLARITY BUT AVOID TEDIUM.

HEADINGS: HEADINGS ARE USED IN THE QUESTIONNAIRE TO STRUCTURE THE CONTENT. THEY ARE NOT TO BE PROGRAMMED OR READ TO RESPONDENTS.

Pre-application—Information Gathering about EI Benefits

I’d like to ask you some questions about your experience getting information about Employment Insurance prior to submitting an application for benefits.

[INTERVIEWER NOTE: Ensure that the respondent is clear that these next questions deal with the steps he/she took before applying for EI.]

1. How did you find out how to apply for Employment Insurance? [READ LIST; RECORD YES/NO FOR EACH ITEM. MULTIPLE RESPONSES ACCEPTED] [USE TOP 4 ITEMS, EXCEPT 1-800 O’CANADA, AS FILTER FOR SERVICE CHANNEL MODULES] [CODING DEFAULT IS EI CALL CENTRE IF RESPONDENT IS UNSURE WHO THEY CALLED]

Visit the Government of Canada website
Call an Employment Insurance Specialized Call Centre
Call 1-800 O’Canada
Visit a Service Canada office

[INTERVIEWER NOTE: ONLY THE RESPONDENT’S EXPERIENCE RELATED TO EI IS RELEVANT NOT THEIR EXPERIENCE WITH OTHER GOVERNMENT PROGRAMS SUCH AS OLD AGE PENSION, CANADA PENSION PLAN, ETC.]

 [ASK IF MORE THAN 1 OF THE TOP 4 ITEMS SELECTED AT Q1]

2. Thinking about the government information sources you used, which did you use first? [PROMPT RESPONDENT WITH ITEMS FROM Q1 AS NEEDED]

[POPULATE WITH ITEMS FROM Q1]

[ASK NEXT TWO QUESTIONS IF WEBSITE SELECTED AT Q2]

3. When using the website, did you need any help or assistance?

4. Was the assistance helpful in getting you what you needed?

5. Did you get the information you needed in a reasonable amount of time?

[ASK IF OPTIONS 1-4 SELECTED AT Q1; EVERYONE ELSE GO TO NEXT SECTION]

6. Overall, please tell me how easy or difficult each of the following were when you were getting information about Employment Insurance. Would you say it was very difficult, somewhat difficult, somewhat easy, or very easy to…? [DO NOT ROTATE LIST]

  1. Find the information you were looking for.
  2. Determine if you were eligible for EI benefits.
  3. Determine the steps in the application process.
  4. Know what documents you needed to apply for EI benefits.

[ASK IF VERY DIFFICULT/DIFFICULT FOR Q6A]

7. You said it was hard to find the information you were looking for. Why was this difficult? [DO NOT READ LIST; ACCEPT 2 RESPONSES]

8. Thinking about your experience looking for information about Employment Insurance before you applied for benefits… which of the following changes, if any, would have had the biggest positive impact on this part of the process for you? [READ LIST; ACCEPT ONE RESPONSE; ROTATE OPTIONS]

Application Process—Applying for EI Benefits

Thinking back to when you actually applied for Employment Insurance benefits,

9. Where did you complete your online application? [READ LIST]

10. Did you require any help or assistance to complete your online application?

[ASK NEXT TWO QUESTIONS IF ‘YES’ AT Q10]

11. How did you get that assistance? Anywhere else? [DO NOT READ LIST; ACCEPT MULTIPLE RESPONSES] [USE TOP 4 ITEMS, EXCEPT 1-800 O’CANADA, AS FILTER FOR SERVICE CHANNEL MODULES]

12. Was the assistance helpful in getting you what you needed?

13. Were you able to complete the application in a reasonable amount of time?

14. Please tell me how easy or difficult each of the following were when you were applying for Employment Insurance. Would you say it was very difficult, somewhat difficult, somewhat easy, or very easy to…? [DO NOT ROTATE LIST]

  1. Understand the requirements of the application.
  2. Put together the information you needed to apply for EI.
  3. Complete the online application form.

[ASK IF VERY DIFFICULT/DIFFICULT FOR Q14C]

15. You said it was hard to complete the online application form. Why was this difficult? [DO NOT READ LIST; ACCEPT 2 RESPONSES]

16. How long did it take for you to be informed about whether you would receive benefits? [DO NOT READ LIST]

17. Was this a reasonable amount of time to wait? [INTERVIEWER NOTE: THE QUESTION IS ABOUT THE DECISION REGARDING THEIR EI APPLICATION. WE DO NOT WANT RESPONDENTS TO ANSWER BASED ON THE LENGTH OF TIME IT TOOK TO RECEIVE THEIR FIRST PAYMENT. CLARIFY IF THIS IS NOT CLEAR BASED ON THE RESPONDENT’S RESPONSE.]

18. Which of the following changes, if any, would have had the biggest positive impact on your experience applying for EI benefits? [READ LIST; ACCEPT ONE RESPONSE; ROTATE OPTIONS]

Post-application—Follow-Up

19. After you submitted your EI application, did you…? [READ LIST; RECORD YES/NO FOR EACH ITEM. ACCEPT MULTIPLE RESPONSES]

[*INTERVIEWER NOTE: IF NEEDED, PLEASE TELL THE RESPONDENT THAT THIS IS THE LETTER THEY WERE SENT THAT INCLUDED INFORMATION ABOUT THEIR CLAIM, LIKE HOW TO SET UP THEIR SERVICE CANADA ACCOUNT.]

20. Please tell me how easy or difficult each of the following were in terms of your communications with the government about Employment Insurance. Would you say it was very difficult, somewhat difficult, somewhat easy, or very easy to…? [DO NOT ROTATE LIST]

IF Q19 received a letter

IF Q19 needed to provide missing information

IF Q19 checked status of application

21. In which of the following ways did you contact the government to follow up on your EI application? [READ LIST; RECORD YES/NO. MULTIPLE RESPONSES ACCEPTED][USE TOP 4 ITEMS, EXCEPT MAIL, AS FILTER FOR SERVICE CHANNEL MODULES]

[*INTERVIEWER NOTE: THIS QUESTION IS ASKING ABOUT FOLLOW-UP RELATED SPECIFICALLY TO THEIR EI APPLICATION. CONTACT DOES NOT INCLUDE THEIR WEEKLY REPORTING TO SERVICE CANADA.]

[ASK IF MULTIPLE ITEMS SELECTED AT Q21]

22. Which method did you use first? [PROMPT RESPONDENT WITH ITEMS FROM Q20 AS NEEDED]

[POPULATE WITH ITEMS FROM Q21]

23. Which of the following changes, if any, would have had the biggest positive impact for you when communicating with the government during your follow-up? [READ LIST; ACCEPT ONE RESPONSE; ROTATE OPTIONS]

Service Channel Assessments

QUESTIONS 1, 11 & 20 TO BE USED AS FILTERS TO DETERMINE PARTICIPATION IN SERVICE CHANNEL ASSESSMENTS.

Call Centre

[ASK THOSE WHO CONTACTED AN EMPLOYMENT INSURANCE SPECIALIZED CALL CENTRE. NO ONE WHO ONLY CALLED 1-800 O’CANADA ANSWERS THIS SECTION]

Earlier you mentioned that you had called an Employment Insurance Specialized Call Centre to obtain information or service related to EI.

24. On average, how many times did you call before you were able to reach an agent? [DO NOT READ LIST]

25. How long did you have to wait, on average, to speak to an agent? [DO NOT READ LIST]

26. Was this a reasonable amount of time to wait?

27. Please tell me how much you agree or disagree with the following statements about your most recent experience calling an Employment Insurance Specialized Call Centre. Use a 5-point scale where ‘1’ means strongly disagree, and ‘5’ means strongly agree. (ROTATE LIST; REPEAT INSTRUCTIONS AS NEEDED; RECORD SEPARATELY ‘DOES NOT APPLY’ AND ‘DON’T KNOW’)

  1. Your questions were answered completely.
  2. The information you received was easy to understand.
  3. Staff were helpful.
  4. You were treated respectfully.
  5. You received conflicting information from different agents.

28. How satisfied were you with the overall quality of service you received during your phone call(s) to Service Canada about EI in the last 7-8 months? Please use a 5-point scale, where ‘1’ means very dissatisfied, and ‘5’ means very satisfied.

Service Canada Office

[ASK THOSE WHO USED AN IN-PERSON OFFICE]

Earlier you mentioned that you had visited a Service Canada office to obtain information or service related to EI.

29. What was the purpose of your most recent visit? [READ LIST; ACCEPT 1 RESPONSE]

30. Thinking about your most recent visit to a Service Canada office, how long did you have to wait for service? [DO NOT READ LIST]

31. Was this a reasonable amount of time to wait?

32. Please tell me how much you agree or disagree with the following statements about your most recent experience at a Service Canada office to obtain information or service related to EI. Use a 5-point scale where ‘1’ means strongly disagree, and ‘5’ means strongly agree. [READ ITEM; REPEAT INSTRUCTIONS AS NEEDED; RECORD SEPARATELY ‘DOES NOT APPLY’ AND ‘DON’T KNOW’]

  1. Your questions were answered completely.
  2. The information you received was easy to understand.
  3. Staff were helpful.
  4. You were treated respectfully.

33. How satisfied were you with the overall quality of service you received at the Service Canada office about EI in the last 7-8 months? Please use a 5-point scale, where ‘1’ means very dissatisfied, and ‘5’ means very satisfied.

34. I’d like you to tell me which of the following are most important to you when it comes to in-person service for EI…[PRESENT ITEMS IN PAIRS TO SUPPORT CONJOINT ANALYSIS]

[OPTIONS]

Online Services

[ASK THOSE WHO USED ONLINE SERVICE]

Earlier you mentioned that you visited the Government of Canada website to get information or service related to EI.

35. Please tell me how much you agree or disagree with the following statements about the government website related to EI using a 5-point scale where ‘1’ means strongly disagree, and ‘5’ means strongly agree. [ROTATE LIST; REPEAT INSTRUCTIONS AS NEEDED; RECORD SEPARATELY ‘DOES NOT APPLY’ AND ‘DON’T KNOW’]

  1. You were quickly able to find what you were looking for.
  2. The process to create a My Service Canada Account was straightforward.

36. How satisfied were you with the overall quality of service you received when you visited the government website you used about EI in the last 7-8 months? Please use a 5-point scale, where ‘1’ means very dissatisfied, ‘5’ means very satisfied,

Overall Satisfaction

I’m now going to ask you some questions about the overall quality of service you received related to Employment Insurance.

37. Thinking about the service you received during the past 7-8 months, please tell me how much you agree or disagree with the following statements, using a 5-point scale where ‘1’ means strongly disagree, and ‘5’ means strongly agree. [ROTATE LIST; REPEAT INSTRUCTIONS AS NEEDED]

  1. You were able to move smoothly through all of the steps related to your EI claim.
  2. You got bounced around from one person to another
  3. You are confident that any personal information you provided will remain confidential. 
  4. Being able to complete steps online made the process easier for you.
  5. It was clear what to do if you had a problem or question.
  6. You had to keep following up to get information.

38. Did you have any difficulty with your EI application because you are not comfortable in English or French?

39. How satisfied were you with the overall quality of service you received from Service Canada related to your EI benefits during the last 7-8 months. Please use a 5-point scale, where ‘1’ means very dissatisfied, ‘5’ means very satisfied,

40. If someone were to ask you, would you speak positively about the service you received? [READ LIST]

Demographic Profile

These last questions are for statistical purposes only. All responses will remain confidential.

41. In general, how often would you say you use online services provided by government, businesses and other organizations through their websites? [NOTE: E.G. ONLINE BANKING, ONLINE PURCHASING, ON-LINE ACCOUNTS, BILL PAYMENT]

42. What is the highest level of formal education that you have completed? [READ LIST]

43. Were you born in Canada?

If NO to Q43, ASK:

44. In what year did you come to Canada?

45. Are you an Aboriginal person, that is, First Nations (North American Indian), Métis or Inuk (Inuit)?

46. Are you a person with a disability?

That completes the survey. Thank you very much. Your participation is appreciated.

READ ONLY IF RESPONDENT ASKS HOW TO ACCESS RESEARCH RESULTS:
Once the study is complete, your anonymous responses will be added to all responses gathered during the study, then aggregated, analyzed and published as public information. The survey results will be posted on the Library and Archives Canada website. 

Characteristics to be identified in the sample: