SlideShare ist ein Scribd-Unternehmen logo
1 von 39
Downloaden Sie, um offline zu lesen
Performance Testing




               “ Somebody that I used to know
                                         - Gotye
Tuesday, 19 February 13
10,000 hour rule

                          “The key to success in any field
                          is, to a large extent, a matter
                          of practicing a specific task for
                          a total of around 10,000 hours.




Tuesday, 19 February 13
My ‘time on the mainframe’

                                      about 34 projects
                                    multiplied by 3 months
                                     each by 20 days per
                                    month by 8 hours per
                                    day at 20% efficiency
                                            equals ...




Tuesday, 19 February 13
Knowledge vs. Time
                          K



                                   How much you think you know




                                   How much you actually know

                                                                 t




Tuesday, 19 February 13
                              3,264 hours
20% Efficiency?




Tuesday, 19 February 13
Mostly Effective
                          Most performance test efforts
                          are effective ...


                          “Testing was completed”
                          “NFRs were met”
                          “We survived go-live”




Tuesday, 19 February 13
Rarely Efficient
                          Performance test efforts are
                          rarely efficient ...




Tuesday, 19 February 13
Lossiness

                          (lossy) characterized by or
                          caused by dissipation of
                          energy.




Tuesday, 19 February 13
Tools

                                “We waste a LOT of energy on
                                tools and people to execute
                                the performance test effort.




                          1,000 VU license = enough to feed a village



Tuesday, 19 February 13
Why so Much?


                                        Tools are driving the process!
                                        We are suffering from market
                                        distortion ...




http://1.bp.blogspot.com/_T3Gqqkz9Mm0/TFEoMfpM6-I/AAAAAAAAB0o/8RslwtCum-4/s1600/tail.jpg
Tuesday, 19 February 13
Perfect Competition


                                        “Describes markets such that
                                        no participants are large
                                        enough to have the market
                                        power to set the price of a
                                        homogeneous product.




http://1.bp.blogspot.com/_T3Gqqkz9Mm0/TFEoMfpM6-I/AAAAAAAAB0o/8RslwtCum-4/s1600/tail.jpg
Tuesday, 19 February 13
Imperfectly Competitive

                          At first there were few sellers
                          and now there are many
                          sellers with highly
                          differentiated products ...




Tuesday, 19 February 13
At first there were few




Tuesday, 19 February 13
And now there are many




Tuesday, 19 February 13
Selenium vs. QTP




Tuesday, 19 February 13
JMeter vs. LoadRunner




Tuesday, 19 February 13
Cloud Impact?




                          Force Multiplier
Tuesday, 19 February 13
Biggest Drivers for Tools

                          Are costs, open and
                          ext endable languages,
                          integration with popular
                          test frameworks and
                          continuous delivery and or
                          deployment, access to high
                          level APIs, cross platform
                          and ease of use.



Tuesday, 19 February 13
How to select the right tool?




                                  Effective & Efficient
                          Almost as important as the job itself.
Tuesday, 19 February 13
Think about the price


                              and cost effectiveness




Tuesday, 19 February 13
Think about the support




Tuesday, 19 February 13
Think about the integration

                          Everything from source
                          control, monitoring,
                          communications, alerting,
                          deployment and beyond.




Tuesday, 19 February 13
Think about the protocol


                          HTTP      1999
                          XHR       2008
                          WebSocket 2011




Tuesday, 19 February 13
Environments

                              We spend a LOT of time
                              waiting for test environments
                              to be provisioned, patched,
                              restarted or deployed.


                          environments {start|stop|restart}




Tuesday, 19 February 13
Increased Burn Rate

                            The rate at which hours
                            (allocated to a project) are
                            being used ...




Tuesday, 19 February 13
Increased Complexity


                           Solving for simultaneous equations




Tuesday, 19 February 13
Analysis Paralysis



                                               “Are we writing scripts to
                                               launch a space shuttle?




http://www.flickr.com/photos/gsfc/6385412737/
Tuesday, 19 February 13
Extinct by Instinct




Tuesday, 19 February 13
Trending Now

                          “Let’s be *more* agile and
                          promote an iterative cycle that
                          emphasizes working products
                          over product specifications ...




Tuesday, 19 February 13
In the Future




Tuesday, 19 February 13
Future is Now




Tuesday, 19 February 13
Fire Fighting in Production




Tuesday, 19 February 13
Replicating in Stage




Tuesday, 19 February 13
A DSL for Test Plans




Tuesday, 19 February 13
Scaled out in 5 minutes




Tuesday, 19 February 13
Results Shared in Real Time




Tuesday, 19 February 13
Short & Sharp Tests




Tuesday, 19 February 13
In 2013

                          “We have significantly
                          reduced performance test
                          costs and increased efficiency
                          of performance test efforts.




Tuesday, 19 February 13
Questions?

                          contact:   Tim Koopmans
                           locate:   Melbourne, Australia
                            email:   tim@altentee.com
                             blog:   altentee.com
                           follow:   @90kts




                                                            Gridinit
Tuesday, 19 February 13

Weitere ähnliche Inhalte

Empfohlen

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Empfohlen (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Performance Testing [not] somebody I used to know

  • 1. Performance Testing “ Somebody that I used to know - Gotye Tuesday, 19 February 13
  • 2. 10,000 hour rule “The key to success in any field is, to a large extent, a matter of practicing a specific task for a total of around 10,000 hours. Tuesday, 19 February 13
  • 3. My ‘time on the mainframe’ about 34 projects multiplied by 3 months each by 20 days per month by 8 hours per day at 20% efficiency equals ... Tuesday, 19 February 13
  • 4. Knowledge vs. Time K How much you think you know How much you actually know t Tuesday, 19 February 13 3,264 hours
  • 6. Mostly Effective Most performance test efforts are effective ... “Testing was completed” “NFRs were met” “We survived go-live” Tuesday, 19 February 13
  • 7. Rarely Efficient Performance test efforts are rarely efficient ... Tuesday, 19 February 13
  • 8. Lossiness (lossy) characterized by or caused by dissipation of energy. Tuesday, 19 February 13
  • 9. Tools “We waste a LOT of energy on tools and people to execute the performance test effort. 1,000 VU license = enough to feed a village Tuesday, 19 February 13
  • 10. Why so Much? Tools are driving the process! We are suffering from market distortion ... http://1.bp.blogspot.com/_T3Gqqkz9Mm0/TFEoMfpM6-I/AAAAAAAAB0o/8RslwtCum-4/s1600/tail.jpg Tuesday, 19 February 13
  • 11. Perfect Competition “Describes markets such that no participants are large enough to have the market power to set the price of a homogeneous product. http://1.bp.blogspot.com/_T3Gqqkz9Mm0/TFEoMfpM6-I/AAAAAAAAB0o/8RslwtCum-4/s1600/tail.jpg Tuesday, 19 February 13
  • 12. Imperfectly Competitive At first there were few sellers and now there are many sellers with highly differentiated products ... Tuesday, 19 February 13
  • 13. At first there were few Tuesday, 19 February 13
  • 14. And now there are many Tuesday, 19 February 13
  • 15. Selenium vs. QTP Tuesday, 19 February 13
  • 17. Cloud Impact? Force Multiplier Tuesday, 19 February 13
  • 18. Biggest Drivers for Tools Are costs, open and ext endable languages, integration with popular test frameworks and continuous delivery and or deployment, access to high level APIs, cross platform and ease of use. Tuesday, 19 February 13
  • 19. How to select the right tool? Effective & Efficient Almost as important as the job itself. Tuesday, 19 February 13
  • 20. Think about the price and cost effectiveness Tuesday, 19 February 13
  • 21. Think about the support Tuesday, 19 February 13
  • 22. Think about the integration Everything from source control, monitoring, communications, alerting, deployment and beyond. Tuesday, 19 February 13
  • 23. Think about the protocol HTTP 1999 XHR 2008 WebSocket 2011 Tuesday, 19 February 13
  • 24. Environments We spend a LOT of time waiting for test environments to be provisioned, patched, restarted or deployed. environments {start|stop|restart} Tuesday, 19 February 13
  • 25. Increased Burn Rate The rate at which hours (allocated to a project) are being used ... Tuesday, 19 February 13
  • 26. Increased Complexity Solving for simultaneous equations Tuesday, 19 February 13
  • 27. Analysis Paralysis “Are we writing scripts to launch a space shuttle? http://www.flickr.com/photos/gsfc/6385412737/ Tuesday, 19 February 13
  • 29. Trending Now “Let’s be *more* agile and promote an iterative cycle that emphasizes working products over product specifications ... Tuesday, 19 February 13
  • 30. In the Future Tuesday, 19 February 13
  • 31. Future is Now Tuesday, 19 February 13
  • 32. Fire Fighting in Production Tuesday, 19 February 13
  • 34. A DSL for Test Plans Tuesday, 19 February 13
  • 35. Scaled out in 5 minutes Tuesday, 19 February 13
  • 36. Results Shared in Real Time Tuesday, 19 February 13
  • 37. Short & Sharp Tests Tuesday, 19 February 13
  • 38. In 2013 “We have significantly reduced performance test costs and increased efficiency of performance test efforts. Tuesday, 19 February 13
  • 39. Questions? contact: Tim Koopmans locate: Melbourne, Australia email: tim@altentee.com blog: altentee.com follow: @90kts Gridinit Tuesday, 19 February 13