Quality Assurance in fast paced DevOps projects using automation by Patrick Verpaalen & Ghislain Gabriëlse on QX Day 2019.

1. Quality Assurance in fast
paced DevOps projects using
automation

2. 2© 2018 Sogeti. All rights reserved.
Area Product Owner
Patrick Verpaalen
Introductie
DevTest Expert
Ghislain Gabriëlse

3. Inhoud
Alphabet
OASIS
Op weg naar CI/CD
Continuous Testing
Lessons learned & de toekomst

4. 4© 2018 Sogeti. All rights reserved.
Alphabet

5. 5© 2018 Sogeti. All rights reserved.
Alphabet
28
3700
80.000
700.000
AlphaRent
Operational Lease
Car Sharing
eMobility

6. 6© 2018 Sogeti. All rights reserved.
OASIS

7. 7© 2018 Sogeti. All rights reserved.
• Eigen IT landschap
• Monolitische applicaties
• Niet schaalbaar
• Dubbele Licentiekosten
Vergelijkbaar met een
Nokia 3310.
• 1 Applicatie landschap
• Apps & Microservices
• Flexibel, aanpasbaar
• Business transformatie
Vergelijkbaar met een
smartphone
OASIS

8. 8© 2018 Sogeti. All rights reserved.
Silo’s

9. 9© 2018 Sogeti. All rights reserved.
0
20
40
60
80
100
120
2015 2019
OASIS 2015 tot 2019
Requirement Area Teams Solution Delivery Employees

10. 10© 2018 Sogeti. All rights reserved.
Deployments
0
20
40
60
80
100
120
140
160
180
2014 2015 2016 2017 2018 2019 2020 2021
Amount of deployments for OASIS overall

11. 11© 2018 Sogeti. All rights reserved.
Op weg naar CI/CD

12. 12© 2018 Sogeti. All rights reserved.
03/10/2019 12
Op weg naar CI/CD; onze fabriek
Agile Tool
Chain
Delivery
Pipeline
Monitoring
and
logging
Integration
Integration
Spec
Dev
Operate
QX Day 2019

13. 13© 2018 Sogeti. All rights reserved.
Continuous Testing

14. 14© 2018 Sogeti. All rights reserved.
Test Pyramide Alphabet Implementatie
Test strategie
Unit tests
Component Tests
Systeemtesten

15. 16© 2018 Sogeti. All rights reserved.
Uitdagingen test aanpak
• Geen end 2 end visie op CI/CD en Testen
• Ontbreken van kennis en kunde
• Test pyramide meer een test rechthoek
• UI Testen onstabiel
• UI Testen opgeslagen in App repositories
• Klant verwacht handmatige acceptatie test
• Onze microservices zijn eigenlijk niet zo micro

16. 17© 2018 Sogeti. All rights reserved.
Test Rechthoek naar Test Pyramide
UI Test
Component
Test
Unittest
UI Test
Component
Test
Unittest
UI Test
Component
Test
Unittest
Component
Test
Unittest
Component
Test
Unittest
Component
Test
Unittest
Component
Test
Unittest
FrontendsBackends
UI Test
Component
Test
Unittest
ACC Test
ACC Test

17. 18© 2018 Sogeti. All rights reserved.
Quality Assurance

18. 20© 2018 Sogeti. All rights reserved.
Lessons learned & de toekomst

19. 21© 2018 Sogeti. All rights reserved.
Lessons learned
• Vereist visie over volledige keten
• CI/CD is noodzakelijk om snelheid te behouden en te versnellen
• Communicatie via code, standaardisatie!
• Testbaarheid moet een speerpunt zijn tijdens development
• Implementatie Test Pyramide of Test Honeycomb is noodzakelijk
• Business transformatie
• Mindset
• Minder rollen

20. 22© 2018 Sogeti. All rights reserved.
De toekomst
• Continuous Security Testing
• Continuous Performance Testing
• A/B Testing
• CI/CD as a service leveren aan de rest van Alphabet/BMW
• Public Cloud
• Zero-Touch deployments

21. 23© 2018 Sogeti. All rights reserved.
Vragen

22. Introductie

23. 25© 2018 Sogeti. All rights reserved.
Click to insert title
▪ Click to insert text
• Click to insert text
– Click to insert text
▪ Click to insert text

24. 26© 2018 Sogeti. All rights reserved.
Click to insert long text Click to insert long text
Click to insert title Click to insert title

25. 27© 2018 Sogeti. All rights reserved.
Click to insert title Click to insert titleClick to insert title
Click to insert title
Click to insert long text
Click to insert title
Click to insert long text Click to insert long text
Click to insert long text

26. 28© 2018 Sogeti. All rights reserved.
Click to insert title
Insert name
Insert Title/Role
▪ Insert bullet point
▪ Insert bullet point
▪ Insert bullet point
▪ Insert bullet point
Insert name
Insert Title/Role
▪ Insert bullet point
▪ Insert bullet point
▪ Insert bullet point
▪ Insert bullet point
Insert name
Insert Title/Role
▪ Insert bullet point
▪ Insert bullet point
▪ Insert bullet point
▪ Insert bullet point
Insert name
Insert Title/Role
▪ Insert bullet point
▪ Insert bullet point
▪ Insert bullet point
▪ Insert bullet point

27. 29© 2018 Sogeti. All rights reserved.
Click to insert text
Click to insert title
(Work for 1 or 2 lines of title)
TEXT TEXT TEXT TEXT TEXT TEXT TEXT
TEXT Example text Example text Example text Example text Example text Example text Example text
TEXT Example text Example text Example text Example text Example text Example text Example text
TEXT Example text Example text Example text Example text Example text Example text Example text
Example text Example text Example text Example text Example text Example text Example text

28. 30© 2018 Sogeti. All rights reserved.
10%
47%
20%
32%
36%
22%
14%
28%
25%
40%
60%
50%
2013 2014 2015 2016
Category 1 Category 2 Category 3
Click to insert text Click to insert text
Click to insert chart title Click to insert chart title
10%
47%
20%
32%
36%
22%
14%
28%
25%
40%
60%
50%
2013 2014 2015 2016
Category 1 Category 2 Category 3
Click to insert title
(Work for 1 or 2 lines of title)

29. 31© 2018 Sogeti. All rights reserved.
4,3
2,5
3,5
4,5
2,4
4,4
1,8
2,8
2014 2015 2016 2017
Series 1 Series 2
4,3
2,5
3,5
4,5
2,4
4,4
1,8
2,8
2014 2015 2016 2017
Series 1 Series 2
4,3
2,5
3,5
4,5
2,4
4,4
1,8
2,8
2014 2015 2016 2017
Series 1 Series 2
4,3
2,5
3,5
4,5
2,4
4,4
1,8
2,8
2014 2015 2016 2017
Series 1 Series 2
Click to insert chart title Click to insert chart title
Click to insert title
(Work for 1 or 2 lines of title)
Click to insert chart title Click to insert chart title

30. 32© 2018 Sogeti. All rights reserved.
Click to insert chart title
8,23,2
1,4
1,2
2014 2015
2016 2017
Click to insert text
(Work for 1 or 2 lines of title)
Click to insert chart title
8,23,2
1,4
1,2
2014 2015
2016 2017

31. 33© 2018 Sogeti. All rights reserved.
Group
Name
Click to insert text Click to insert text Click to insert text Click to insert text Click to insert text
Insert Group
Name
Insert Group
Name
Click to insert text
Click to insert text Click to insert text
Insert Group
Name
Click to insert title
(Work for 1 or 2 lines of title)

32. 34© 2018 Sogeti. All rights reserved.
World map
Texte
Texte
Texte
Texte
Texte
Texte
Texte
Texte
Texte
Texte

33. 35© 2018 Sogeti. All rights reserved.
Shapes
Shapes can also be flipped
horizontally or vertically
Please note, shapes can be
rotated to suit your layouts
Above three shapes can be
of five primary colors

34. 36© 2018 Sogeti. All rights reserved.
Color Palette
01 02 06 0703 04 05
Primary colors
08 09 10 11 12 13 14 15 16 17 18 20 21
Colors for Infographics