Overview

Hulubot is moving from Salesforce Einstein to the custom built Chatbot platform that is integrated with Google Dialogflow. We expect to gain efficiencies with maintaining Hulubot while piloting the chatbot platform on a non-DDEG product. 

Relevant Docs

Product Brief

MVP Hulu intents - WIP

Hulubot - Conversation Design project from Braulio (accessible with disneystreaming account)

Analytics Brief

Testing pages

Hulu stage (homepage only)

Bernard testing page (must be on VPN)**currently intents are only in Dev

Meeting Notes

Attendees

PMO: Joe

PM: Jesse, Katie

Tech: Darryl, Dylan, Horven, Drew

Analytics, Derek, Julia, Heather


Actions:

  • Reporting: Julia and team to review logistics of Domo vs Tableau and confirm possible timeline
  • Advocate impact: Dylan, Katie sync with support ops on impact (Danny G and Courtney D)
  • Dylan: organize tech deep dive for using current CSAT/Snap-in solutions
  • Katie/Jesse: Analytics brief, discuss implications if we do not have a CSAT for the chatbot experience (possibly build into Dialogflow as an intent instead)
  • Katie: reach out to Alissa to confirm the unauth bot experience will not impact the overall AB testing of the auth/unauth HC project slated for Apr/May 

Overview:

Live chat - use of Snap-in chat is preferred route to keep launch on track

  • Dylan, Drew, Darryl to discuss tech details and implications (eg chatbot session transcript)

CSAT - Q: can we use the current Salesforce CSAT experience 

  • If we use the snap-in, would we be able to use the CSAT for the live agent experience?
  • Do we need a CSAT for the chatbot session
    • prefer that we do as it is used as a measure of deflection success

Reporting - Where will it go, are there requirements/restrictions of keeping Hulu data separate (Darryl confirmed this is possible)

Current conversations

Possibility of using snap-in chat to transfer to Salesforce 

(plus) Using existing feature

(minus)  May not be able to pass through transcript

(minus) 

Possibility of using existing Salesforce CSAT 

(plus) Using existing feature

(minus) 

  • TBD Tableau or Domo
  • Data coming from Chatbot server and Salesforce



Jira




From the Chatbot Feature Comparison Table



Platform
Einstein


ClientBernardbotSalesforce
Feature CategoryFeature NameDescriptionCURRENT STATECURRENT STATEPRIORITY
OverviewAuthenticated StateBot version for authenticated users.

NOT MVP

TRUE0
OverviewUnauthenticated StateBot version for unauthenticated users.

AVAILABLE

TRUE0
OverviewNLP EnabledBot has NLP capability.

AVAILABLE

TRUE0
OverviewText Field EnabledBot has text field enabled permanently.

AVAILABLE

TRUE0
OverviewAgent EscalationBot can escalate user to a human agent.

IN PROGRESS

TRUE0
OverviewMulti-Lang SupportBot has multi-language support.

NOT MVP

FALSE3
OverviewResolution Confirmation / RatablesBot presents question that asks if the bot resolved user's issue.

AVAILABLE

TRUE1
OverviewRich Text FormattingBot platform allows for rich text formatting (bold, italics, etc.) OOTB.

AVAILABLE

FALSEN/A
OverviewRich MediaBot platform allows for rich media (carousels, videos, etc.) OOTB.

REQ DEV

TRUE2
OverviewAuthentication via BotUser is able to authenticate via the bot.

NOT MVP

FALSEN/A
OverviewMain MenuUser is presented with a main menu (or quick replies) at the start of the interaction.

AVAILABLE

TRUE0
OverviewBackend TriggersBot leverages backend triggers for set conditions.

REQ DEV

TRUE1
OverviewCustom StylingBot UI leverages custom styles.

AVAILABLE

TRUE1
OverviewEnd-of-chat surveyBot serves an experience survey at the end of the interaction.

IN PROGRESS

TRUE1






System IntegrationsAccount ManagementUser is able to update PII within bot experience (email address, mailing address etc)

NOT MVP

FALSEN/A
System IntegrationsSubscription Management / BillingUser is able to view/edit subscriptions, view previous billing or current access that is non-recurring

NOT MVP

FALSEN/A
System IntegrationsLibrary ManagementUser is able to view/edit library content (e.g. watch list, delete content from library?)

NOT MVP

FALSEN/A
System IntegrationsDevice ManagementUser is able to view/delete devices activate on their account (possibly also view useage per device?)

NOT MVP

FALSEN/A
System IntegrationsSubscription CreationUser is able to create a new account and complete purchase flow of subscription/one time billing

NOT MVP

FALSEN/A






NLPNumber of IntentsNumber of intents currently live in bot.TBD48
NLPMinimum Training Phrases per IntentThe minimum number of training phrases required per intent for the model to function.10-15 (can function with less)150-200
NLPModel Build TimeTime it takes for the NLP model to be "trained".seconds~1.5 hr
NLPTraining Phrase Generation AssistancePlatform provides training phrase generation assistance using past user utterances.

TRUE Think GAP work Jesse has set up is more refined than OTB DF

TRUE3
NLPHolistic NLP Model AssessmentPlatform provides holistic model assessment (confusion between intents, etc.).

TRUE

FALSEN/A
NLP"Follow-Up" IntentsBot leverages follow-up intents in conversation design.

TRUE

FALSEN/A
NLPFallback IntentsBot leverages fallback intents.

TRUE

TRUE0
NLPSmall Talk CapabilityBot has small talk capabilities to emphasize conversational aspect of interaction.

TRUE

FALSEN/A
NLPContent Gap IdentificationPlatform has content gap identification capabilities, leveraging past user utterances.

TRUE Think GAP work Jesse has set up is more refined than OTB DF

FALSEN/A
NLPEscape HatchesBot conversation design contains escape hatches.

TRUE

TRUE0
NLPContext RetentionBot leverage context retention in conversation design.

TRUE

FALSEN/A
NLPDuplicate Detection Within IntentPlatform is able to detect duplicate training phrases across intents.

TRUE

FALSEN/A






Content | Account ManagementSubscription ManagementBot guides users on how they can manage their subscription.

TRUE

TRUE1
Content | Account ManagementCancellationBot guides users on how they can cancel their account.

TRUE

TRUE1
Content | Account ManagementDevice ManagementBot guides users on how they can manage devices on their account.

TRUE

TRUE2
Content | Account ManagementUser ManagementBot guides users on how they can manage the users on their account.

TRUE

TRUE2
Content | Account ManagementLogging In AssistanceBot guides users on how they can resolve their login issues.

TRUE

TRUE1






Content | BillingPayment UpdateBot guides users on how they can update their payment information.

TRUE

TRUE1
Content | BillingRefundsBot guides users on how they can request / confirm a refund(s).

TRUE

TRUE1
Content | BillingUnexpected ChargesBot guides users on what an unexpected charge(s) might mean and how they can get assistance.

TRUE

TRUE1






Content | Product-RelatedTroubleshootingBot guides users on how they can troubleshoot a product issue.

TRUE

TRUE1
Content | Product-RelatedProduct Launches (What)Bot informs users of product launches (ex. offline downloads feature, Oscars, etc.).

TRUE

TRUE2
Content | Product-RelatedProduct Guides (How)Bot guides users through how they can set up or use the product / feature (ex. live tv, offline downloads, etc.).

TRUE

TRUE1