SlideShare ist ein Scribd-Unternehmen logo
1 von 14
1
Sara Tresch
SVP, Digital Services
Charles Schwab
Experimentation
through Client Eyes
Charles SchwabInformation classification here (Public for events content)2
“There’s always another new
idea, another convention to
challenge, a million ways to
make investing better. We
just need to do it”
Charles Schwab, Invested 2019
Charles Schwab
Enablers Proof Points Opportunities
Information classification here (Public for events content)3
Today’s Discussion
Charles Schwab
Enablers
Information classification here (Public for events content)4
Charles Schwab
Start with a Holistic Experience
End to End
Clients come to you with a job to do.
They experience your brand thru many
different touchpoints, and an experience
design should start with this in mind.
Front to Back
Front to back experience design can be
a win-win-win. Save time for clients,
higher value rep interactions, and
operational scale.
Charles Schwab
Get it right for the Client
Information classification here (Public for events content)6
Help & Guidance Minutes Saved Client Easy Score Get Invested
A simple, focused approach creates clarity
Learn Fast to Act Fast
Continuous Discovery
Openness to change
Cross functional ideation
Client-centric goals
Continuous Delivery
Understand the hypothesis
Radical Collaboration
Ongoing Experimentation
Continuous Measurement
Deliver a Minimal Viable Solution
Fast response to client needs
Iterations based on client data
Charles Schwab
Proof Points
Information classification here (Public for events content)8
Charles Schwab
Accelerate Quality and Time
9
MVP Launch
70% Client Easy 94%
2 Design sprints 5
8 Dev sprints 2
Old Way New Way
Highly
volatile, lots of
rework
Better design that
clients LOVE
Client
frustration
Charles Schwab10
Unlock Cross Channel
Feedback Fridays
Multi-year build for B2B Experience
Recurring front line and user feedback
=> Ongoing delivery to clients and service team
=> Opportunity backlog
=> Feeds launched software tests
Charles Schwab11
Explore Big Questions…
How do we serve clients better in
digital?
“Our Digital Transformation simply means serving clients better!
That’s it. No Spin. No Complexities.”
- Walt Bettinger, President and CEO, Charles Schwab
Charles Schwab
…And Answer themFidelity&TestingValue
Storyboards
Medium # of variations
Hand Drawn Flows
Very high # of variations
Refined Screen Flows
High # of variations
Low-Fidelity Mockups
Very high # of variations
Medium-Fidelity Screens
High # of variations
Design Prototypes
Medium # of variations
Coded Prototype
Low # of variations
A/B testing
Minor Variations
Prototype Value Curve
Team ‘1’ Continuous Discovery
Charles Schwab
Opportunities
Information classification here (Public for events content)13
14
Opportunities
We are early in this journey
End to end
Experimentation
1
Turn insights into
Action
2
Improve speed
on every team
3
Empathy at Scale
4

Weitere ähnliche Inhalte

Was ist angesagt?

Introducing Program Management
Introducing Program ManagementIntroducing Program Management
Introducing Program ManagementOptimizely
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth StackOptimizely
 
Cultivating a Culture of Experimentation
Cultivating a Culture of ExperimentationCultivating a Culture of Experimentation
Cultivating a Culture of ExperimentationOptimizely
 
World Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesWorld Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesOptimizely
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8Optimizely
 
Opticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOpticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOptimizely
 
Optimizely for Developers
Optimizely for DevelopersOptimizely for Developers
Optimizely for DevelopersOptimizely
 
Optimizely Demo Deck
Optimizely Demo DeckOptimizely Demo Deck
Optimizely Demo DeckMattharth
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New WinningOptimizely
 
Definition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by OptimizelyDefinition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by OptimizelyRusseWeb
 
Optimizely x Live Demo
Optimizely x Live DemoOptimizely x Live Demo
Optimizely x Live DemoOptimizely
 
Intuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramIntuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramOptimizely
 
Maximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceMaximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceOptimizely
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Optimizely
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersOptimizely
 
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...Optimizely
 
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...Optimizely
 
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely
 
Content Targeting and Personalization: Improving Engagement at the Account Level
Content Targeting and Personalization: Improving Engagement at the Account LevelContent Targeting and Personalization: Improving Engagement at the Account Level
Content Targeting and Personalization: Improving Engagement at the Account LevelG3 Communications
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing ProgramJill Martay
 

Was ist angesagt? (20)

Introducing Program Management
Introducing Program ManagementIntroducing Program Management
Introducing Program Management
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
 
Cultivating a Culture of Experimentation
Cultivating a Culture of ExperimentationCultivating a Culture of Experimentation
Cultivating a Culture of Experimentation
 
World Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesWorld Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ Companies
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
 
Opticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOpticon 2017 Decisions at Scale
Opticon 2017 Decisions at Scale
 
Optimizely for Developers
Optimizely for DevelopersOptimizely for Developers
Optimizely for Developers
 
Optimizely Demo Deck
Optimizely Demo DeckOptimizely Demo Deck
Optimizely Demo Deck
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
 
Definition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by OptimizelyDefinition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by Optimizely
 
Optimizely x Live Demo
Optimizely x Live DemoOptimizely x Live Demo
Optimizely x Live Demo
 
Intuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramIntuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation Program
 
Maximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceMaximizing Optimizely Website Performance
Maximizing Optimizely Website Performance
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into Consumers
 
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
 
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
 
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
 
Content Targeting and Personalization: Improving Engagement at the Account Level
Content Targeting and Personalization: Improving Engagement at the Account LevelContent Targeting and Personalization: Improving Engagement at the Account Level
Content Targeting and Personalization: Improving Engagement at the Account Level
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing Program
 

Ähnlich wie Experimentation through Clients' Eyes

Lean Startup Tools for Agile Product Teams
Lean Startup Tools for Agile Product TeamsLean Startup Tools for Agile Product Teams
Lean Startup Tools for Agile Product TeamsLitheSpeed
 
Digital Transformation Solution PowerPoint Presentation Slide
Digital Transformation Solution PowerPoint Presentation SlideDigital Transformation Solution PowerPoint Presentation Slide
Digital Transformation Solution PowerPoint Presentation SlideSlideTeam
 
Digital Transformation Solution PowerPoint Presentation Slides
Digital Transformation Solution PowerPoint Presentation SlidesDigital Transformation Solution PowerPoint Presentation Slides
Digital Transformation Solution PowerPoint Presentation SlidesSlideTeam
 
Digital Transformation Solution Powerpoint Presentation Slides
Digital Transformation Solution Powerpoint Presentation SlidesDigital Transformation Solution Powerpoint Presentation Slides
Digital Transformation Solution Powerpoint Presentation SlidesSlideTeam
 
Leanstartuptoolsforproductowners
LeanstartuptoolsforproductownersLeanstartuptoolsforproductowners
LeanstartuptoolsforproductownersRaj Indugula
 
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...constantadevelopers
 
Workshop lean startup (Open workshop)
Workshop lean startup (Open workshop)Workshop lean startup (Open workshop)
Workshop lean startup (Open workshop)Avatech Accelerator
 
Lean Startup Basics - Evidence Based Entrepreneurship
Lean Startup Basics - Evidence Based EntrepreneurshipLean Startup Basics - Evidence Based Entrepreneurship
Lean Startup Basics - Evidence Based EntrepreneurshipKelly Schwedland
 
Qualtrics-Salesforce
Qualtrics-SalesforceQualtrics-Salesforce
Qualtrics-SalesforceDaniel Wade
 
Introducing-the-Scaled-Agile-Framework-6.0.pptx
Introducing-the-Scaled-Agile-Framework-6.0.pptxIntroducing-the-Scaled-Agile-Framework-6.0.pptx
Introducing-the-Scaled-Agile-Framework-6.0.pptxFabien PETEL
 
How Enterprise SaaS Companies Justify Investment in Customer Success
How Enterprise SaaS Companies Justify Investment in Customer SuccessHow Enterprise SaaS Companies Justify Investment in Customer Success
How Enterprise SaaS Companies Justify Investment in Customer SuccessGainsight
 
Pursuing Customer Inspired Growth
Pursuing Customer Inspired GrowthPursuing Customer Inspired Growth
Pursuing Customer Inspired GrowthKearney
 
Tech Talk: Measuring Innovation
Tech Talk: Measuring InnovationTech Talk: Measuring Innovation
Tech Talk: Measuring InnovationCA Technologies
 
User Research: The Superpower Behind Experimentation Programs | VWO Webinars
User Research: The Superpower Behind Experimentation Programs | VWO WebinarsUser Research: The Superpower Behind Experimentation Programs | VWO Webinars
User Research: The Superpower Behind Experimentation Programs | VWO WebinarsVWO
 
Differentiating your professional services in a flat economy
Differentiating your professional services in a flat economyDifferentiating your professional services in a flat economy
Differentiating your professional services in a flat economyChangepoint
 
9 Steps to a World-Class VoC Program
9 Steps to a World-Class VoC Program9 Steps to a World-Class VoC Program
9 Steps to a World-Class VoC ProgramQualtrics
 
Empired Convergence 2017 - Transforming you customer experience
Empired Convergence 2017 - Transforming you customer experienceEmpired Convergence 2017 - Transforming you customer experience
Empired Convergence 2017 - Transforming you customer experienceEmpired
 
Cloudslate Berkeley Final Presentation
Cloudslate Berkeley Final PresentationCloudslate Berkeley Final Presentation
Cloudslate Berkeley Final PresentationStanford University
 
CloudSlate Lean LaunchPad Berkeley Haas School of Business
CloudSlate Lean LaunchPad Berkeley Haas School of BusinessCloudSlate Lean LaunchPad Berkeley Haas School of Business
CloudSlate Lean LaunchPad Berkeley Haas School of Businessmcharafeddine
 

Ähnlich wie Experimentation through Clients' Eyes (20)

Lean Startup Tools for Agile Product Teams
Lean Startup Tools for Agile Product TeamsLean Startup Tools for Agile Product Teams
Lean Startup Tools for Agile Product Teams
 
Digital Transformation Solution PowerPoint Presentation Slide
Digital Transformation Solution PowerPoint Presentation SlideDigital Transformation Solution PowerPoint Presentation Slide
Digital Transformation Solution PowerPoint Presentation Slide
 
Digital Transformation Solution PowerPoint Presentation Slides
Digital Transformation Solution PowerPoint Presentation SlidesDigital Transformation Solution PowerPoint Presentation Slides
Digital Transformation Solution PowerPoint Presentation Slides
 
Digital Transformation Solution Powerpoint Presentation Slides
Digital Transformation Solution Powerpoint Presentation SlidesDigital Transformation Solution Powerpoint Presentation Slides
Digital Transformation Solution Powerpoint Presentation Slides
 
Leanstartuptoolsforproductowners
LeanstartuptoolsforproductownersLeanstartuptoolsforproductowners
Leanstartuptoolsforproductowners
 
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
 
Workshop lean startup (Open workshop)
Workshop lean startup (Open workshop)Workshop lean startup (Open workshop)
Workshop lean startup (Open workshop)
 
Lean Startup Basics - Evidence Based Entrepreneurship
Lean Startup Basics - Evidence Based EntrepreneurshipLean Startup Basics - Evidence Based Entrepreneurship
Lean Startup Basics - Evidence Based Entrepreneurship
 
Qualtrics-Salesforce
Qualtrics-SalesforceQualtrics-Salesforce
Qualtrics-Salesforce
 
Introducing-the-Scaled-Agile-Framework-6.0.pptx
Introducing-the-Scaled-Agile-Framework-6.0.pptxIntroducing-the-Scaled-Agile-Framework-6.0.pptx
Introducing-the-Scaled-Agile-Framework-6.0.pptx
 
How Enterprise SaaS Companies Justify Investment in Customer Success
How Enterprise SaaS Companies Justify Investment in Customer SuccessHow Enterprise SaaS Companies Justify Investment in Customer Success
How Enterprise SaaS Companies Justify Investment in Customer Success
 
Pursuing Customer Inspired Growth
Pursuing Customer Inspired GrowthPursuing Customer Inspired Growth
Pursuing Customer Inspired Growth
 
Tech Talk: Measuring Innovation
Tech Talk: Measuring InnovationTech Talk: Measuring Innovation
Tech Talk: Measuring Innovation
 
How to Thrive in a Post-AOR World
How to Thrive in a Post-AOR WorldHow to Thrive in a Post-AOR World
How to Thrive in a Post-AOR World
 
User Research: The Superpower Behind Experimentation Programs | VWO Webinars
User Research: The Superpower Behind Experimentation Programs | VWO WebinarsUser Research: The Superpower Behind Experimentation Programs | VWO Webinars
User Research: The Superpower Behind Experimentation Programs | VWO Webinars
 
Differentiating your professional services in a flat economy
Differentiating your professional services in a flat economyDifferentiating your professional services in a flat economy
Differentiating your professional services in a flat economy
 
9 Steps to a World-Class VoC Program
9 Steps to a World-Class VoC Program9 Steps to a World-Class VoC Program
9 Steps to a World-Class VoC Program
 
Empired Convergence 2017 - Transforming you customer experience
Empired Convergence 2017 - Transforming you customer experienceEmpired Convergence 2017 - Transforming you customer experience
Empired Convergence 2017 - Transforming you customer experience
 
Cloudslate Berkeley Final Presentation
Cloudslate Berkeley Final PresentationCloudslate Berkeley Final Presentation
Cloudslate Berkeley Final Presentation
 
CloudSlate Lean LaunchPad Berkeley Haas School of Business
CloudSlate Lean LaunchPad Berkeley Haas School of BusinessCloudSlate Lean LaunchPad Berkeley Haas School of Business
CloudSlate Lean LaunchPad Berkeley Haas School of Business
 

Mehr von Optimizely

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationOptimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing RightOptimizely
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleOptimizely
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Optimizely
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsOptimizely
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Optimizely
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingOptimizely
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideOptimizely
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOptimizely
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...Optimizely
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueOptimizely
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubOptimizely
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely
 
The Future of Software Development
The Future of Software DevelopmentThe Future of Software Development
The Future of Software DevelopmentOptimizely
 
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...Optimizely
 
Using Empathy to Build Custom Solutions at Scale
Using Empathy to Build Custom Solutions at ScaleUsing Empathy to Build Custom Solutions at Scale
Using Empathy to Build Custom Solutions at ScaleOptimizely
 
How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact Optimizely
 
Targeted Rollouts: How to Release Features to Multiple Audiences
Targeted Rollouts: How to Release Features to Multiple AudiencesTargeted Rollouts: How to Release Features to Multiple Audiences
Targeted Rollouts: How to Release Features to Multiple AudiencesOptimizely
 
Deploying Fearlessly in a Continuous World
Deploying Fearlessly in a Continuous WorldDeploying Fearlessly in a Continuous World
Deploying Fearlessly in a Continuous WorldOptimizely
 
Detecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsDetecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsOptimizely
 

Mehr von Optimizely (20)

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
 
The Future of Software Development
The Future of Software DevelopmentThe Future of Software Development
The Future of Software Development
 
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
 
Using Empathy to Build Custom Solutions at Scale
Using Empathy to Build Custom Solutions at ScaleUsing Empathy to Build Custom Solutions at Scale
Using Empathy to Build Custom Solutions at Scale
 
How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact
 
Targeted Rollouts: How to Release Features to Multiple Audiences
Targeted Rollouts: How to Release Features to Multiple AudiencesTargeted Rollouts: How to Release Features to Multiple Audiences
Targeted Rollouts: How to Release Features to Multiple Audiences
 
Deploying Fearlessly in a Continuous World
Deploying Fearlessly in a Continuous WorldDeploying Fearlessly in a Continuous World
Deploying Fearlessly in a Continuous World
 
Detecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsDetecting incorrectly implemented experiments
Detecting incorrectly implemented experiments
 

Kürzlich hochgeladen

5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdfWave PLM
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️anilsa9823
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AIABDERRAOUF MEHENNI
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerThousandEyes
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxComplianceQuest1
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfjoe51371421
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...OnePlan Solutions
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...MyIntelliSource, Inc.
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy
 
Active Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfActive Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfCionsystems
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Modelsaagamshah0812
 

Kürzlich hochgeladen (20)

5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdf
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Active Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfActive Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdf
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Exploring iOS App Development: Simplifying the Process
Exploring iOS App Development: Simplifying the ProcessExploring iOS App Development: Simplifying the Process
Exploring iOS App Development: Simplifying the Process
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 

Experimentation through Clients' Eyes

  • 1. 1 Sara Tresch SVP, Digital Services Charles Schwab Experimentation through Client Eyes
  • 2. Charles SchwabInformation classification here (Public for events content)2 “There’s always another new idea, another convention to challenge, a million ways to make investing better. We just need to do it” Charles Schwab, Invested 2019
  • 3. Charles Schwab Enablers Proof Points Opportunities Information classification here (Public for events content)3 Today’s Discussion
  • 4. Charles Schwab Enablers Information classification here (Public for events content)4
  • 5. Charles Schwab Start with a Holistic Experience End to End Clients come to you with a job to do. They experience your brand thru many different touchpoints, and an experience design should start with this in mind. Front to Back Front to back experience design can be a win-win-win. Save time for clients, higher value rep interactions, and operational scale.
  • 6. Charles Schwab Get it right for the Client Information classification here (Public for events content)6 Help & Guidance Minutes Saved Client Easy Score Get Invested A simple, focused approach creates clarity
  • 7. Learn Fast to Act Fast Continuous Discovery Openness to change Cross functional ideation Client-centric goals Continuous Delivery Understand the hypothesis Radical Collaboration Ongoing Experimentation Continuous Measurement Deliver a Minimal Viable Solution Fast response to client needs Iterations based on client data
  • 8. Charles Schwab Proof Points Information classification here (Public for events content)8
  • 9. Charles Schwab Accelerate Quality and Time 9 MVP Launch 70% Client Easy 94% 2 Design sprints 5 8 Dev sprints 2 Old Way New Way Highly volatile, lots of rework Better design that clients LOVE Client frustration
  • 10. Charles Schwab10 Unlock Cross Channel Feedback Fridays Multi-year build for B2B Experience Recurring front line and user feedback => Ongoing delivery to clients and service team => Opportunity backlog => Feeds launched software tests
  • 11. Charles Schwab11 Explore Big Questions… How do we serve clients better in digital? “Our Digital Transformation simply means serving clients better! That’s it. No Spin. No Complexities.” - Walt Bettinger, President and CEO, Charles Schwab
  • 12. Charles Schwab …And Answer themFidelity&TestingValue Storyboards Medium # of variations Hand Drawn Flows Very high # of variations Refined Screen Flows High # of variations Low-Fidelity Mockups Very high # of variations Medium-Fidelity Screens High # of variations Design Prototypes Medium # of variations Coded Prototype Low # of variations A/B testing Minor Variations Prototype Value Curve Team ‘1’ Continuous Discovery
  • 13. Charles Schwab Opportunities Information classification here (Public for events content)13
  • 14. 14 Opportunities We are early in this journey End to end Experimentation 1 Turn insights into Action 2 Improve speed on every team 3 Empathy at Scale 4