SlideShare ist ein Scribd-Unternehmen logo
1 von 27
+
+
Delivering high-quality apps 6 times every week
Tariq Patel
Mobile Lead
@taxomania
enhance the transactional experience
Who is my customer?
How can I engage my customer more?
How can I sell more to my customer?
App Core
App SDK
Yoyo Wallet App Retailer BrandedCaffè Nero App
yoyo API
a single platform and code base powering multiple apps
separate concerns using mvvm
View ViewModel Model
update
notify
data binding
All else being equal, the fastest company in any market
will win.
optimise the feedback loop
kanban development process
Automate the deployment pipeline
bleeding edge internal alpha
nightly external beta
biweekly releases
release trains always ship on time
• 1800+ unit and integration tests
• 300+ feature based end-to-end tests
(consisting of over 5000 scenarios)
• 200+ mobile client and SDK tests
Automated tests throughout our tech stack are executed on
every single code change
automated testing
• Bounty-based manual testing
• Helps with Android fragmentation problem
• Engineers still responsible for quality
before releases but Applause can catch
unknowns
Applause performs crowdsourced testing but is not a
gatekeeper for deployments
continuous testing
feature flags
We use feature flagging to decouple feature releases from
deployments and therefore minimise risk
The goal
Improve link a card conversion
- Include the option to scan a debit/credit
card with one’s camera with the aim of
increasing the % of users that link a card
The result?
ITWORKED!
- Of users that saw Variant 1, there was a
positive +13.8% improvement
Baseline Variant 1
A/B test performed using a Bayesian approach
to determine statistical significance
split-test
The goal
Improve in-app purchase conversion
- Show consumers the rewards they would
earn by purchasing items before
reaching the point of sale
The result?
It didn’t work…
- Of users that saw Variant 1, there was a
1.6% decline in conversion
Baseline Variant 1
split-test
A/B test performed using a Bayesian approach
to determine statistical significance
anomaly detection
Crashlytics alerts when
crash rates spike
anomaly detection
Crashlytics alerts when
crash rates spike
Small spike in crashes
found in Mixpanel data
anomaly detection
Crashlytics alerts when
crash rates spike
Small spike in crashes
found in Mixpanel data
post-mortems
‣ Issue summary
‣ Timeline
‣ Root cause
‣ Impact
‣ Resolution
‣ Lessons learned
‣ What went wrong
‣ What went well
‣ Where did we get lucky
‣ Corrective and preventative measures
‣ Short-term actions
‣ Long-term actions
(Engineer pulls task until delivered to consumers in production)
mobile cycle time
2.5days
216projected 2017
(vs. 75 in 2016 & 36 in 2015)
consumer app releases
99.9%
crash-free users
support
600+ consumer support tickets per week
1 complaint about frequency of updates
Users don’t want to update
their app every week
4.7
415 reviews
5.0
393 reviews
4.0
379 reviews
4.0
111 reviews
Apple, the Apple logo, iPhone are trademarks of Apple Inc., registered in the U.S. and other countries. App Store is a service mark of Apple Inc., registered in the U.S. and other countries.
Google Play and the Google Play logo are trademarks of Google Inc.
As of 26 April 2017
consumer apps
retention
About time too - but excellent
This is a great 1.0. Certainly
much slicker than Costa’s effort
and I think it’ll be displacing my
Starbucks app on the front
page! - Stu531
reviews
Way ahead of competitors
Love this app - so easy to use and I agree with
many other reviews that it is far superior to its
competitors apps. - Dainty101
Quick and easy
Another reason to use
Nero. The best 😊 -
FieldofPoppies
Tariq Patel
Mobile Lead
@taxomania

Weitere ähnliche Inhalte

Was ist angesagt?

How to Test on the Right Mobile Platforms
How to Test on the Right Mobile PlatformsHow to Test on the Right Mobile Platforms
How to Test on the Right Mobile PlatformsPerfecto by Perforce
 
Zado Success Story - Mobile Automation using Selenium Robotium
Zado Success Story - Mobile Automation using Selenium RobotiumZado Success Story - Mobile Automation using Selenium Robotium
Zado Success Story - Mobile Automation using Selenium RobotiumZado Technologies
 
Automated testing of software applications using machine learning edited
Automated testing of software applications using machine learning   editedAutomated testing of software applications using machine learning   edited
Automated testing of software applications using machine learning editedMilind Kelkar
 
How Digital Changed the Game... and how to cross platform test for it
How Digital Changed the Game... and how to cross platform test for itHow Digital Changed the Game... and how to cross platform test for it
How Digital Changed the Game... and how to cross platform test for itLizzy Guido (she/her)
 
A Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End TestingA Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End TestingSmartBear
 
Sauce Labs Webinar: Rising Importance of Software Testing
Sauce Labs Webinar: Rising Importance of Software TestingSauce Labs Webinar: Rising Importance of Software Testing
Sauce Labs Webinar: Rising Importance of Software TestingSauce Labs
 
Making the Transition from Manual to Automated Testing
Making the Transition from Manual to Automated TestingMaking the Transition from Manual to Automated Testing
Making the Transition from Manual to Automated TestingSauce Labs
 
Automated software testing complete guide
Automated software testing complete guideAutomated software testing complete guide
Automated software testing complete guideTestingXperts
 
Accelerate Your Regional Tests with Sauce
Accelerate Your Regional Tests with SauceAccelerate Your Regional Tests with Sauce
Accelerate Your Regional Tests with SauceSauce Labs
 
Testing Your Software Testers
Testing Your Software TestersTesting Your Software Testers
Testing Your Software TestersOri Bendet
 
Mobile test automation perfecto star east
Mobile test automation perfecto star eastMobile test automation perfecto star east
Mobile test automation perfecto star eastPerfecto Mobile
 
Quality Assurance Guidelines
Quality Assurance GuidelinesQuality Assurance Guidelines
Quality Assurance GuidelinesTim Stribos
 
Software supply chain management: Gaining velocity without losing control
Software supply chain management: Gaining velocity without losing controlSoftware supply chain management: Gaining velocity without losing control
Software supply chain management: Gaining velocity without losing controlmatthewabq
 
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...Sauce Labs
 
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
3 Free Tools That Will Help You Create the Right Mobile & Web Test StrategyPerfecto by Perforce
 

Was ist angesagt? (20)

How to Test on the Right Mobile Platforms
How to Test on the Right Mobile PlatformsHow to Test on the Right Mobile Platforms
How to Test on the Right Mobile Platforms
 
Zado Success Story - Mobile Automation using Selenium Robotium
Zado Success Story - Mobile Automation using Selenium RobotiumZado Success Story - Mobile Automation using Selenium Robotium
Zado Success Story - Mobile Automation using Selenium Robotium
 
Automated testing of software applications using machine learning edited
Automated testing of software applications using machine learning   editedAutomated testing of software applications using machine learning   edited
Automated testing of software applications using machine learning edited
 
Common Web UI Problems Transforming Manual to Automation
Common Web UI Problems Transforming Manual to Automation Common Web UI Problems Transforming Manual to Automation
Common Web UI Problems Transforming Manual to Automation
 
How Digital Changed the Game... and how to cross platform test for it
How Digital Changed the Game... and how to cross platform test for itHow Digital Changed the Game... and how to cross platform test for it
How Digital Changed the Game... and how to cross platform test for it
 
A Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End TestingA Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End Testing
 
Building an effective mobile testing strategy
Building an effective mobile testing strategyBuilding an effective mobile testing strategy
Building an effective mobile testing strategy
 
Sauce Labs Webinar: Rising Importance of Software Testing
Sauce Labs Webinar: Rising Importance of Software TestingSauce Labs Webinar: Rising Importance of Software Testing
Sauce Labs Webinar: Rising Importance of Software Testing
 
Juc oct 2014 final
Juc oct 2014 finalJuc oct 2014 final
Juc oct 2014 final
 
Making the Transition from Manual to Automated Testing
Making the Transition from Manual to Automated TestingMaking the Transition from Manual to Automated Testing
Making the Transition from Manual to Automated Testing
 
Automated software testing complete guide
Automated software testing complete guideAutomated software testing complete guide
Automated software testing complete guide
 
Testing
TestingTesting
Testing
 
Accelerate Your Regional Tests with Sauce
Accelerate Your Regional Tests with SauceAccelerate Your Regional Tests with Sauce
Accelerate Your Regional Tests with Sauce
 
Testing Your Software Testers
Testing Your Software TestersTesting Your Software Testers
Testing Your Software Testers
 
Mobile test automation perfecto star east
Mobile test automation perfecto star eastMobile test automation perfecto star east
Mobile test automation perfecto star east
 
Quality Assurance Guidelines
Quality Assurance GuidelinesQuality Assurance Guidelines
Quality Assurance Guidelines
 
Software supply chain management: Gaining velocity without losing control
Software supply chain management: Gaining velocity without losing controlSoftware supply chain management: Gaining velocity without losing control
Software supply chain management: Gaining velocity without losing control
 
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
Compatibility Testing of Your Web Apps - Tips and Tricks for Debugging Locall...
 
Mobile DevTest Dictionary
Mobile DevTest DictionaryMobile DevTest Dictionary
Mobile DevTest Dictionary
 
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
 

Ähnlich wie Delivering high-quality apps 6 times, every week

Step by-step mobile testing approaches and strategies
Step by-step mobile testing approaches and strategiesStep by-step mobile testing approaches and strategies
Step by-step mobile testing approaches and strategiesAlisha Henderson
 
A 5 minute guide to delivering Flawless Mobile Apps
A 5 minute guide to delivering Flawless Mobile AppsA 5 minute guide to delivering Flawless Mobile Apps
A 5 minute guide to delivering Flawless Mobile AppsCygnet Infotech
 
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest
 
Quality Assurance and mobile applications!
Quality Assurance and mobile applications!Quality Assurance and mobile applications!
Quality Assurance and mobile applications!Bagaria Swati
 
Automated Regression Testing that Ensures Continuous Performance.pptx
Automated Regression Testing that Ensures Continuous Performance.pptxAutomated Regression Testing that Ensures Continuous Performance.pptx
Automated Regression Testing that Ensures Continuous Performance.pptxCalidad Infotech
 
Software Testing Interview Questions For Experienced
Software Testing Interview Questions For ExperiencedSoftware Testing Interview Questions For Experienced
Software Testing Interview Questions For Experiencedzynofustechnology
 
DevOps evolution architecting the modern software factory - cloud expo east 2017
DevOps evolution architecting the modern software factory - cloud expo east 2017DevOps evolution architecting the modern software factory - cloud expo east 2017
DevOps evolution architecting the modern software factory - cloud expo east 2017Anand Akela
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfsarah david
 
Amalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automationAmalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automationAgile Testing Alliance
 
Mobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue SolutionsMobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue SolutionsRapidValue
 
Samal biswa manual tester-functional-accessibility
Samal biswa manual tester-functional-accessibilitySamal biswa manual tester-functional-accessibility
Samal biswa manual tester-functional-accessibilitysamal biswa
 
Can you trust your APIs - White Paper on API Testing
Can you trust your APIs - White Paper on API TestingCan you trust your APIs - White Paper on API Testing
Can you trust your APIs - White Paper on API TestingSwetha Sridharan
 
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"Applitools
 
Regression testing framework
Regression testing frameworkRegression testing framework
Regression testing frameworkChristinaPerri4
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software QualityAnand Prabhala
 

Ähnlich wie Delivering high-quality apps 6 times, every week (20)

Step by-step mobile testing approaches and strategies
Step by-step mobile testing approaches and strategiesStep by-step mobile testing approaches and strategies
Step by-step mobile testing approaches and strategies
 
6 Ways to Speed Up App Testing
6 Ways to Speed Up App Testing6 Ways to Speed Up App Testing
6 Ways to Speed Up App Testing
 
A 5 minute guide to delivering Flawless Mobile Apps
A 5 minute guide to delivering Flawless Mobile AppsA 5 minute guide to delivering Flawless Mobile Apps
A 5 minute guide to delivering Flawless Mobile Apps
 
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
 
Quality Assurance and mobile applications!
Quality Assurance and mobile applications!Quality Assurance and mobile applications!
Quality Assurance and mobile applications!
 
Automated Regression Testing that Ensures Continuous Performance.pptx
Automated Regression Testing that Ensures Continuous Performance.pptxAutomated Regression Testing that Ensures Continuous Performance.pptx
Automated Regression Testing that Ensures Continuous Performance.pptx
 
Software Testing Interview Questions For Experienced
Software Testing Interview Questions For ExperiencedSoftware Testing Interview Questions For Experienced
Software Testing Interview Questions For Experienced
 
DevOps evolution architecting the modern software factory - cloud expo east 2017
DevOps evolution architecting the modern software factory - cloud expo east 2017DevOps evolution architecting the modern software factory - cloud expo east 2017
DevOps evolution architecting the modern software factory - cloud expo east 2017
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
 
Future of QA
Future of QAFuture of QA
Future of QA
 
Futureofqa
FutureofqaFutureofqa
Futureofqa
 
Mobile Testing in the Cloud
Mobile Testing in the CloudMobile Testing in the Cloud
Mobile Testing in the Cloud
 
Amalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automationAmalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automation
 
Mobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue SolutionsMobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue Solutions
 
Samal biswa manual tester-functional-accessibility
Samal biswa manual tester-functional-accessibilitySamal biswa manual tester-functional-accessibility
Samal biswa manual tester-functional-accessibility
 
Can you trust your APIs - White Paper on API Testing
Can you trust your APIs - White Paper on API TestingCan you trust your APIs - White Paper on API Testing
Can you trust your APIs - White Paper on API Testing
 
OMSOFTWARE NEW Service
OMSOFTWARE NEW ServiceOMSOFTWARE NEW Service
OMSOFTWARE NEW Service
 
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
 
Regression testing framework
Regression testing frameworkRegression testing framework
Regression testing framework
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
 

Kürzlich hochgeladen

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024SynarionITSolutions
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 

Kürzlich hochgeladen (20)

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 

Delivering high-quality apps 6 times, every week

  • 1. + + Delivering high-quality apps 6 times every week Tariq Patel Mobile Lead @taxomania
  • 2. enhance the transactional experience Who is my customer? How can I engage my customer more? How can I sell more to my customer?
  • 3. App Core App SDK Yoyo Wallet App Retailer BrandedCaffè Nero App yoyo API a single platform and code base powering multiple apps
  • 4. separate concerns using mvvm View ViewModel Model update notify data binding
  • 5. All else being equal, the fastest company in any market will win. optimise the feedback loop
  • 7. Automate the deployment pipeline bleeding edge internal alpha
  • 10. release trains always ship on time
  • 11. • 1800+ unit and integration tests • 300+ feature based end-to-end tests (consisting of over 5000 scenarios) • 200+ mobile client and SDK tests Automated tests throughout our tech stack are executed on every single code change automated testing
  • 12. • Bounty-based manual testing • Helps with Android fragmentation problem • Engineers still responsible for quality before releases but Applause can catch unknowns Applause performs crowdsourced testing but is not a gatekeeper for deployments continuous testing
  • 13. feature flags We use feature flagging to decouple feature releases from deployments and therefore minimise risk
  • 14. The goal Improve link a card conversion - Include the option to scan a debit/credit card with one’s camera with the aim of increasing the % of users that link a card The result? ITWORKED! - Of users that saw Variant 1, there was a positive +13.8% improvement Baseline Variant 1 A/B test performed using a Bayesian approach to determine statistical significance split-test
  • 15. The goal Improve in-app purchase conversion - Show consumers the rewards they would earn by purchasing items before reaching the point of sale The result? It didn’t work… - Of users that saw Variant 1, there was a 1.6% decline in conversion Baseline Variant 1 split-test A/B test performed using a Bayesian approach to determine statistical significance
  • 16. anomaly detection Crashlytics alerts when crash rates spike
  • 17. anomaly detection Crashlytics alerts when crash rates spike Small spike in crashes found in Mixpanel data
  • 18. anomaly detection Crashlytics alerts when crash rates spike Small spike in crashes found in Mixpanel data
  • 19. post-mortems ‣ Issue summary ‣ Timeline ‣ Root cause ‣ Impact ‣ Resolution ‣ Lessons learned ‣ What went wrong ‣ What went well ‣ Where did we get lucky ‣ Corrective and preventative measures ‣ Short-term actions ‣ Long-term actions
  • 20. (Engineer pulls task until delivered to consumers in production) mobile cycle time 2.5days
  • 21. 216projected 2017 (vs. 75 in 2016 & 36 in 2015) consumer app releases
  • 23. support 600+ consumer support tickets per week 1 complaint about frequency of updates Users don’t want to update their app every week
  • 24. 4.7 415 reviews 5.0 393 reviews 4.0 379 reviews 4.0 111 reviews Apple, the Apple logo, iPhone are trademarks of Apple Inc., registered in the U.S. and other countries. App Store is a service mark of Apple Inc., registered in the U.S. and other countries. Google Play and the Google Play logo are trademarks of Google Inc. As of 26 April 2017 consumer apps
  • 26. About time too - but excellent This is a great 1.0. Certainly much slicker than Costa’s effort and I think it’ll be displacing my Starbucks app on the front page! - Stu531 reviews Way ahead of competitors Love this app - so easy to use and I agree with many other reviews that it is far superior to its competitors apps. - Dainty101 Quick and easy Another reason to use Nero. The best 😊 - FieldofPoppies