Steps to follow after a Critical / Blocker issue is escalated to the team
  1. Alert comes in from NOC or Pagerduty
  2. Acknowledge alert
    1. Starting with most immediate communication channel that has reached out about the escalation (Slack, Text, Email), respond with acknowledgement to stakeholders “We are engaging our teams to investigate.”
  3. Visit https://status.zendesk.com/
  4. Enter in Zendesk Subdomain disneyplus.zendesk.com into the field at the top-center of the screen or choose Pod 20
  5. Check to see if any current known issues exist that are causing the issue


No known issues are causing the critical/blocker issue

CLICK HERE FOR ESPN+ ESCALATION EMAIL TEMPLATE (Windows Users)

Hello,


We are currently experiencing an issue affecting Support Disney.  This issue was first reported at [time of escalation].


Summary

[Summarize the issue]

(Example) – The web widget is not loading when guests click on contact channels on https://support.espn.com. 


Guest Impact:

[Summarize Guest Impact]

(Example) - Guests visiting the support.espn.com site are not able to contact support via the help site contact channel icons (Email, Phone, and Chat).


Agent Impact:

[Summarize Agent Impact]

(Example) – Agents are unable to answer newly created emails as they are not arriving in Zendesk; however, agents can continue to support email tickets that have already been created in Zendesk.

  

We have set up a bridge for troubleshooting at https://disney.zoom.us/j/94309969200


We will provide our next update on this thread by ____ [current time + 30 mins]


  1. Start internal escalation bridge by clicking  https://disney.zoom.us/j/94309969200
  2. Reply to NOC email (or start a new thread if escalated via PagerDuty):
    1. To: #DPEP DL-GX Zendesk Notification ESPN Plus <DPEP.DL-GX.Zendesk.Notification.ESPN.Plus@disney.com>
    2. CC: DPEP.DL-GX.Technology@disney.com (#DPEP DL-GX Technology)
    3. Include the following in the email body:
      1. Summary
      2. Guest impact
      3. “We have set up a bridge for troubleshooting at  https://disney.zoom.us/j/94309969200”
      4. We will provide our next update on this thread by ____ [current time + 30 mins]
  3. View below to see if Jacquie should be texted to receive a direct escalation
    1. MATRIX of when to text
    2. Text Jacquie Armstrong at (250) 575-9381 informing her that there is an escalation and include very brief summary of issue, and BlueJeans bridge URL
A known Zendesk issue is responsibe for the critical/blocker issue

CLICK HERE FOR ESPN+ ESCALATION EMAIL TEMPLATE (Windows Users)

Hello,


We are currently experiencing an issue affecting Support Disney.  This issue was first reported at [time of escalation].


Summary

[Summarize the issue]

(Example) – The web widget is not loading when guests click on contact channels on https://support.espn.com. 


Guest Impact:

[Summarize Guest Impact]

(Example) - Guests visiting the support.espn.com site are not able to contact support via the help site contact channel icons (Email, Phone, and Chat).


Agent Impact:

[Summarize Agent Impact]

(Example) – Agents are unable to answer newly created emails as they are not arriving in Zendesk; however, agents can continue to support email tickets that have already been created in Zendesk.

  

We have set up a bridge for troubleshooting at https://disney.zoom.us/j/94309969200


We will provide our next update on this thread by ____ [current time + 30 mins]


  1. Reply to NOC email (or start a new thread if escalated via PagerDuty):
    1. To: #DPEP DL-GX Zendesk Notification ESPN Plus <DPEP.DL-GX.Zendesk.Notification.ESPN.Plus@disney.com>
    2. CC: DPEP.DL-GX.Technology@disney.com (#DPEP DL-GX Technology)
    3. Include the following in the email body
      1. Summary
      2. Guest impact
      3. “Zendesk has confirmed this is a known issue and are tracking it here[URL to issue on status.zendesk.com].  We will provide our next update on this thread by _____ [current time + 60 mins].”
  2. View below to see if Jacquie should be texted to receive a direct escalation
    1. MATRIX of when to text
    2. Text Jacquie Armstrong at (250) 575-9381 informing her that there is an escalation and include very brief summary of issue.  Inform her we are monitoring the known issue and providing further updates via the NOC email thread.
When to text Jacquie
IssueExampleBU's
Help Center OutageOne of the help sites are down entirely and not accessible by guests.DisneySupport, ESPN, ABC, ShopDisney, Licensing, Publishing, Disney+, ESPN+
Contact ChannelsOne or all of the main contact channels are not accessible to guests (Email, Phone, Live Chat)DisneySupport, ESPN, ABC, ShopDisney, Licensing, Publishing, ESPN+
Revenue ImpactA feature from our platform is blocking functionality for guests to complete purchases on a partners web site.ShopDisney


How to contact Zendesk
  1. Email support@zendesk.com
    1. CC: Sarobertson@zendesk.com (Our Zendesk Success Engineer)
  2. Summarize the issue we're experiencing
  3. State what Pod & Instance you're seeing the issue on (eg. disneyplus.zendesk.com Pod 20)
  4. Note the urgency/impact of this issue, and request Zendesk to get back to you via _____ method of contact

Once the support case has been created, you can view it by logging in using your Zendesk credentials at https://support.zendesk.com/hc/en-us/requests



Once issue is resolved

Reply to NOC email with the following:

  1. Issue is now resolved and _____ is functioning as normal (Bold at top of email)
  2. Summary
  3. Guest Impact including full time between start/stop of incident
  4. “A full root cause analysis and mitigation steps will be provided by ________” (end of the following business day)
  5. “Since this issue is now resolved, please escalate any further issues by following the escalation procedure to notify NOC”


Attachments:

Down left arrow.png (image/png)
Down Right arrow.png (image/png)
Down Arrow.png (image/png)