SlideShare ist ein Scribd-Unternehmen logo
1 von 16
Downloaden Sie, um offline zu lesen
Mobile QA
How to deliver high quality apps to the App Store
What we do
QA in product company
QA in outsource company
• Responsible for a product overall
• No excuses to customers (they don't care why you've f*cked up )
• Can always speak with a developer directly
• Last stand between customer and a product
• Have an influence to a product
• Responsible for part of the a product
• Customers are not always the issue
• Usually more high update pace
• Can't see the big picture of a product
• Can't have direct feedback on his work
Kinds of testing we do
Test methods
Black box
White box
Test levels
Unit testing
Integration testing
UI testing
Test types
Smoke testing
Regression testing
Continuous testing
Software performance testing
Usability testing
Localization testing
Testing process
Waterfall
Kanban
Testing tools
Test Rail
Test management system, it can:
• create/import and manage test suites
• assigne test plans
• track test activity
• be integrated with Jira
Jira
Complex and agile bug tracking system, it can:
• document, assign, track an issue
• be used as project management system
• manage Agile boards
Additional tools
Slack - team communications
Trello - task manager
Dropbox Paper - task manager
Xcode (debug testing)
Jenkins (adhoc testing)
Hockey app Amplitude
Logs
Developer tools
Crash tracking system Event tracking system (analytics )
Help to diagnose an issue
Quick run
Full run
• Can quickly show current product state to QA
and development teams
• Includes test cases from the different suites
(incl. first start, update, on boarding etc)
• Required for minor updates
• Effective for smoke testing
• Guarantees product stability
• Effective to find regression issues
• Includes all test suites
• Required for major updates
Automation
Why it is necessary
When it is necessary
Balance between manual testing
Test data is as important as test case
Right test case
Make sure app works before validate test case
Automation tools
UIAutomation (JS legacy)
• JS
• Supports loads of framework helpers
• Inconsistent
• Deprecated
Xcode UI Tests (Swift)
• Swift
• Runs as independent process
• XCTest based
• More consistent
• Still improving
Jenkins CI formula = xcodebuild + xcrun + iOS sim + xcpretty + ruby script
QA at Readdle is more that software tester:
• engineer
• manager
• customer support adviser
Сollaboration with development team
Developers Types:
• Tests code before deployment to QA
• Does not test code before deployment to QA
• Cunning when explains why that issue can't be fixed
• Should be convinced why this issue should be fixed
• Fixes one issue but breaks other stuff
• Developer - project manager
Conflict situations
• Won't fix
• Wrong feature implementation
• Fix version
• Can't reproduce
Customer Support FTW
User cases: helps to QA team to expand and amplify test cases base
User feedback: helps to project manager and team lead to plan and
adjust development of a project
Customer support: direct source of feedback and user cases. It evaluates QA.
QA team should:
• read customer feedback
• react fast in critical situation (reproduce, document, make sure issue fixed, prepare h
update)
• amplify test case base
Customer support team should:
• analyze customer’s feedback
• filters important requests
• provide all others teams with the meaningful summary
• understand all the products well
Management inside the team
Every member of the team should:
• Know all products
• Should not has a development stoppers
• Be an independent working unit
• Should know how to plan and manage his time
• Has complete responsibility for the final version of the product he’s tested
• Share the knowledge between other members
• Not afraid to always ask a question
QA can influence on product development
• User experience feedback and suggestions
• UI and functionality correction
• Can give important feedback at the very start of a new product
• Can argue the PM and developer about helpful features
• Should be interested and involved in product development
QA knows product better than anyone
The Future

Weitere ähnliche Inhalte

Was ist angesagt?

Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
tharindakasun
 
Agile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroidsAgile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroids
Vipul Gupta
 
Agile Testing Process
Agile Testing ProcessAgile Testing Process
Agile Testing Process
Intetics
 

Was ist angesagt? (18)

Agile QA process
Agile QA processAgile QA process
Agile QA process
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
 
QA in Agile
QA in AgileQA in Agile
QA in Agile
 
Agile QA Process
Agile QA ProcessAgile QA Process
Agile QA Process
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
 
Continuous Delivery Presentation
Continuous Delivery PresentationContinuous Delivery Presentation
Continuous Delivery Presentation
 
Test automation in agile ecosystem
Test automation in agile ecosystemTest automation in agile ecosystem
Test automation in agile ecosystem
 
Qa process 2012
Qa process 2012Qa process 2012
Qa process 2012
 
Agile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroidsAgile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroids
 
Agile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeAgile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil Karade
 
Agile Testing Process
Agile Testing ProcessAgile Testing Process
Agile Testing Process
 
How to overcome agile methodology challenges
How to overcome agile methodology challengesHow to overcome agile methodology challenges
How to overcome agile methodology challenges
 
Testing Best Practices
Testing Best PracticesTesting Best Practices
Testing Best Practices
 
Integrate Test Activities in Agile
Integrate Test Activities in AgileIntegrate Test Activities in Agile
Integrate Test Activities in Agile
 
Alpha and beta testing
Alpha and beta testingAlpha and beta testing
Alpha and beta testing
 
Guide to Agile testing
Guide to Agile testingGuide to Agile testing
Guide to Agile testing
 
Agile testing MyBTEC
Agile testing MyBTECAgile testing MyBTEC
Agile testing MyBTEC
 
Agile testing
Agile  testingAgile  testing
Agile testing
 

Andere mochten auch

Andere mochten auch (9)

Oleksandr Yefremov Continuously delivering mobile project
Oleksandr Yefremov Continuously delivering mobile projectOleksandr Yefremov Continuously delivering mobile project
Oleksandr Yefremov Continuously delivering mobile project
 
Anton Ivinskyi Application level metrics and performance tests
Anton Ivinskyi	Application level metrics and performance testsAnton Ivinskyi	Application level metrics and performance tests
Anton Ivinskyi Application level metrics and performance tests
 
Макс Семенчук Дизайнер, которому доверяют
 Макс Семенчук Дизайнер, которому доверяют Макс Семенчук Дизайнер, которому доверяют
Макс Семенчук Дизайнер, которому доверяют
 
Миша Рыбачук Что такое дизайн?
Миша Рыбачук Что такое дизайн?Миша Рыбачук Что такое дизайн?
Миша Рыбачук Что такое дизайн?
 
Alexander Voronov Test driven development in real world
Alexander Voronov Test driven development in real worldAlexander Voronov Test driven development in real world
Alexander Voronov Test driven development in real world
 
Виталий Лаптенок Процессы в продуктовой компании
Виталий Лаптенок Процессы в продуктовой компанииВиталий Лаптенок Процессы в продуктовой компании
Виталий Лаптенок Процессы в продуктовой компании
 
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...
Vitalii Bondarenko HDinsight: spark. advanced in memory big-data analytics wi...
 
Новые рынки: делать медиа там, где это почти невозможно
Новые рынки: делать медиа там, где это почти невозможноНовые рынки: делать медиа там, где это почти невозможно
Новые рынки: делать медиа там, где это почти невозможно
 
Anton Parkhomenko Boost your design workflow or git rebase for designers
Anton Parkhomenko Boost your design workflow or git rebase for designersAnton Parkhomenko Boost your design workflow or git rebase for designers
Anton Parkhomenko Boost your design workflow or git rebase for designers
 

Ähnlich wie Vladimir Lozanov How to deliver high quality apps to the app store

Software Testing Fundamentals
Software Testing FundamentalsSoftware Testing Fundamentals
Software Testing Fundamentals
Chankey Pathak
 
Project management for qa manager
Project management for qa managerProject management for qa manager
Project management for qa manager
gaoliang641
 

Ähnlich wie Vladimir Lozanov How to deliver high quality apps to the app store (20)

Tune Agile Test Strategies to Project and Product Maturity
Tune Agile Test Strategies to Project and Product MaturityTune Agile Test Strategies to Project and Product Maturity
Tune Agile Test Strategies to Project and Product Maturity
 
Methodology: IT test
Methodology: IT testMethodology: IT test
Methodology: IT test
 
Test planning and software's engineering
Test planning and software's engineeringTest planning and software's engineering
Test planning and software's engineering
 
Software Testing Fundamentals
Software Testing FundamentalsSoftware Testing Fundamentals
Software Testing Fundamentals
 
Agile testing
Agile testingAgile testing
Agile testing
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
 
Project management for qa manager
Project management for qa managerProject management for qa manager
Project management for qa manager
 
Software Engineering (Testing Overview)
Software Engineering (Testing Overview)Software Engineering (Testing Overview)
Software Engineering (Testing Overview)
 
product Qa workflow
product Qa workflowproduct Qa workflow
product Qa workflow
 
QA Best Practices in Agile World_new
QA Best Practices in Agile World_newQA Best Practices in Agile World_new
QA Best Practices in Agile World_new
 
Software testing
Software testingSoftware testing
Software testing
 
DevOps Overview in my own words
DevOps Overview in my own wordsDevOps Overview in my own words
DevOps Overview in my own words
 
Software Quality Assurance
Software Quality AssuranceSoftware Quality Assurance
Software Quality Assurance
 
Sustainable agile testing
Sustainable agile testingSustainable agile testing
Sustainable agile testing
 
QA in an Agile Environment
QA in an Agile EnvironmentQA in an Agile Environment
QA in an Agile Environment
 
what-is-devops.ppt
what-is-devops.pptwhat-is-devops.ppt
what-is-devops.ppt
 
Quality assuarance bharath anche (1)
Quality assuarance bharath anche (1)Quality assuarance bharath anche (1)
Quality assuarance bharath anche (1)
 
Agile Acceptance testing with Fitnesse
Agile Acceptance testing with FitnesseAgile Acceptance testing with Fitnesse
Agile Acceptance testing with Fitnesse
 
Invite the tester to the party
Invite the tester to the partyInvite the tester to the party
Invite the tester to the party
 
A Roadmap to Enterprise Quality
A Roadmap to Enterprise QualityA Roadmap to Enterprise Quality
A Roadmap to Enterprise Quality
 

Mehr von Аліна Шепшелей

Mehr von Аліна Шепшелей (20)

Valerii Iakovenko Drones as the part of the present
Valerii Iakovenko	Drones as the part of the presentValerii Iakovenko	Drones as the part of the present
Valerii Iakovenko Drones as the part of the present
 
Valerii Moisieienko Apache hbase workshop
Valerii Moisieienko	Apache hbase workshopValerii Moisieienko	Apache hbase workshop
Valerii Moisieienko Apache hbase workshop
 
Dmitriy Kouperman Working with legacy systems. stabilization, monitoring, man...
Dmitriy Kouperman Working with legacy systems. stabilization, monitoring, man...Dmitriy Kouperman Working with legacy systems. stabilization, monitoring, man...
Dmitriy Kouperman Working with legacy systems. stabilization, monitoring, man...
 
Andrew Veles Product design is about the process
Andrew Veles Product design is about the processAndrew Veles Product design is about the process
Andrew Veles Product design is about the process
 
Kononenko Alina Designing for Apple Watch and Apple TV
Kononenko Alina Designing for Apple Watch and Apple TVKononenko Alina Designing for Apple Watch and Apple TV
Kononenko Alina Designing for Apple Watch and Apple TV
 
Mihail Patalaha Aso: how to start and how to finish?
Mihail Patalaha Aso: how to start and how to finish?Mihail Patalaha Aso: how to start and how to finish?
Mihail Patalaha Aso: how to start and how to finish?
 
Gregory Shehet Undefined' on prod, or how to test a react app
Gregory Shehet Undefined' on  prod, or how to test a react appGregory Shehet Undefined' on  prod, or how to test a react app
Gregory Shehet Undefined' on prod, or how to test a react app
 
Alexey Osipenko Basics of functional reactive programming
Alexey Osipenko Basics of functional reactive programmingAlexey Osipenko Basics of functional reactive programming
Alexey Osipenko Basics of functional reactive programming
 
Vladimir Mikhel Scrapping the web
Vladimir Mikhel Scrapping the web Vladimir Mikhel Scrapping the web
Vladimir Mikhel Scrapping the web
 
Roman Ugolnikov Migrationа and sourcecontrol for your db
Roman Ugolnikov Migrationа and sourcecontrol for your dbRoman Ugolnikov Migrationа and sourcecontrol for your db
Roman Ugolnikov Migrationа and sourcecontrol for your db
 
Dmutro Panin JHipster
Dmutro Panin JHipster Dmutro Panin JHipster
Dmutro Panin JHipster
 
Alex Theedom Java ee revisits design patterns
Alex Theedom	Java ee revisits design patternsAlex Theedom	Java ee revisits design patterns
Alex Theedom Java ee revisits design patterns
 
Alexey Tokar To find a needle in a haystack
Alexey Tokar To find a needle in a haystackAlexey Tokar To find a needle in a haystack
Alexey Tokar To find a needle in a haystack
 
Volodymyr Getmanskyi How to build a dynamic pricing model using big data
Volodymyr Getmanskyi How to build a dynamic pricing model using big dataVolodymyr Getmanskyi How to build a dynamic pricing model using big data
Volodymyr Getmanskyi How to build a dynamic pricing model using big data
 
Maksym Antipov Hardware development as a hobby and a job
Maksym Antipov Hardware development as a hobby and a jobMaksym Antipov Hardware development as a hobby and a job
Maksym Antipov Hardware development as a hobby and a job
 
Ievgen Vladimirov Only cloud
Ievgen Vladimirov Only cloudIevgen Vladimirov Only cloud
Ievgen Vladimirov Only cloud
 
Denis Reznik Data driven future
Denis Reznik Data driven futureDenis Reznik Data driven future
Denis Reznik Data driven future
 
Den Golotyuk Big data from 30 million daily users
Den Golotyuk Big data from 30 million daily usersDen Golotyuk Big data from 30 million daily users
Den Golotyuk Big data from 30 million daily users
 
Anton Fedorchenko Swift for server side development
Anton Fedorchenko Swift for server side developmentAnton Fedorchenko Swift for server side development
Anton Fedorchenko Swift for server side development
 
Valerii Vasylkov Erlang. measurements and benefits.
Valerii Vasylkov Erlang. measurements and benefits.Valerii Vasylkov Erlang. measurements and benefits.
Valerii Vasylkov Erlang. measurements and benefits.
 

Kürzlich hochgeladen

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 

Vladimir Lozanov How to deliver high quality apps to the app store

  • 1. Mobile QA How to deliver high quality apps to the App Store
  • 3. QA in product company QA in outsource company • Responsible for a product overall • No excuses to customers (they don't care why you've f*cked up ) • Can always speak with a developer directly • Last stand between customer and a product • Have an influence to a product • Responsible for part of the a product • Customers are not always the issue • Usually more high update pace • Can't see the big picture of a product • Can't have direct feedback on his work
  • 4. Kinds of testing we do Test methods Black box White box Test levels Unit testing Integration testing UI testing Test types Smoke testing Regression testing Continuous testing Software performance testing Usability testing Localization testing Testing process Waterfall Kanban
  • 5. Testing tools Test Rail Test management system, it can: • create/import and manage test suites • assigne test plans • track test activity • be integrated with Jira Jira Complex and agile bug tracking system, it can: • document, assign, track an issue • be used as project management system • manage Agile boards
  • 6. Additional tools Slack - team communications Trello - task manager Dropbox Paper - task manager Xcode (debug testing) Jenkins (adhoc testing)
  • 7. Hockey app Amplitude Logs Developer tools Crash tracking system Event tracking system (analytics ) Help to diagnose an issue
  • 8. Quick run Full run • Can quickly show current product state to QA and development teams • Includes test cases from the different suites (incl. first start, update, on boarding etc) • Required for minor updates • Effective for smoke testing • Guarantees product stability • Effective to find regression issues • Includes all test suites • Required for major updates
  • 9. Automation Why it is necessary When it is necessary Balance between manual testing Test data is as important as test case Right test case Make sure app works before validate test case
  • 10. Automation tools UIAutomation (JS legacy) • JS • Supports loads of framework helpers • Inconsistent • Deprecated Xcode UI Tests (Swift) • Swift • Runs as independent process • XCTest based • More consistent • Still improving Jenkins CI formula = xcodebuild + xcrun + iOS sim + xcpretty + ruby script
  • 11. QA at Readdle is more that software tester: • engineer • manager • customer support adviser
  • 12. Сollaboration with development team Developers Types: • Tests code before deployment to QA • Does not test code before deployment to QA • Cunning when explains why that issue can't be fixed • Should be convinced why this issue should be fixed • Fixes one issue but breaks other stuff • Developer - project manager Conflict situations • Won't fix • Wrong feature implementation • Fix version • Can't reproduce
  • 13. Customer Support FTW User cases: helps to QA team to expand and amplify test cases base User feedback: helps to project manager and team lead to plan and adjust development of a project Customer support: direct source of feedback and user cases. It evaluates QA. QA team should: • read customer feedback • react fast in critical situation (reproduce, document, make sure issue fixed, prepare h update) • amplify test case base Customer support team should: • analyze customer’s feedback • filters important requests • provide all others teams with the meaningful summary • understand all the products well
  • 14. Management inside the team Every member of the team should: • Know all products • Should not has a development stoppers • Be an independent working unit • Should know how to plan and manage his time • Has complete responsibility for the final version of the product he’s tested • Share the knowledge between other members • Not afraid to always ask a question
  • 15. QA can influence on product development • User experience feedback and suggestions • UI and functionality correction • Can give important feedback at the very start of a new product • Can argue the PM and developer about helpful features • Should be interested and involved in product development QA knows product better than anyone