The document discusses the flawed approach of "racing performance" without proper preparation. It argues that jumping straight into performance testing without checking components like tires, fuel levels, and ensuring the system is functioning properly leads to "fatal consequences" like crashes. Some reasons this approach still occurs include a lack of performance culture, confusion between performance and load testing, and viewing all problems as requiring load automation. The document promotes better approaches like verifying components, defining standards, stress testing parts individually and together before integration, using meters to monitor system functions, conducting lab tests, and test driving the system before attempting high-stakes races.
1. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
DON’T RACE PERFORMANCE
Leandro Melendez – Señor Performo
2. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Who am I?
• I am Leandro Melendez
• Performance tester, scripter, engineer and idealist. Perf Manager @QualiTest
• Lot’sa experience on several performance projects for 10 years.
• Found lots of vices, weird paths of action and plain ignorance.
• Decided to get a secret identity and wear the spandex moustache to fight against
bad practices, process inertia and plain ignorance as Señor Performo.
• All this through a blog (www.srperf.com), Social NW’s (@srperf), hosting the
Spanish version of the performance testing podcast PerfBytes en Español.
• Last, but not least, through public speaking, spreading the word of performance,
which we will do here today.
3. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Why this?
Motif
4. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are problems in this world
• Mi journey is to help to fix problems
5. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are problems in this world
• Mi journey is to help to fix problems
• Many simple topics are still confused
6. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are problems in this world
• Mi journey is to help to fix problems
• Many simple topics are still confused
• I will not talk complex tech stuff
7. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are problems in this world
• The mission is to defeat comon evils
WRONG
8. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are problems in this world
• The mission is to defeat comon evils
• Today we will try to defeat one
WRONG
9. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are problems in this world
• The mission is to defeat comon evils
• Today we will try to defeat one
• Orating and public speaking
10. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
What do you mean racing?
11. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
BUT FIRST
A question
12. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Will require your cooperation…
13. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Have you been asked to… ?
14. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Don’t be shy
15. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Have you been asked to… ?
16. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
17. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
THATS WHAT I MEANT
WITH RACING
18. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Just racing without preparation
FATAL CONSEQUENCES!
19. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
FLAWED APPROACH
Why just racing ends in crashes?
20. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Just jumping in…
• Many try it
• But it is like a stunt
21. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Just jumping in…
• Many try it
• But it is like a stunt
22. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Just jumping in…
• It is extremely difficult
• Requires lots of prep
• Generally bad outcomes
23. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
ISSUES on the approach
• Often they do not check tires
• Air pressure
• May even be flat
24. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
ISSUES on the approach
• Do ti without fuel
• Did not even check before!
25. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
ISSUES on the approach
• Do ti without fuel
• Did not even check before!
• MAY NOT EVEN HAVE
A FUEL METER!
26. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
NO idea of nothin’
• Often do not know what is going on with the rest of the car either
27. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Thinking it is safe
• Still, without knowing how the car is doing, let’s try to race it
28. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Thinking it is safe
• Still, without knowing how the car is doing, let’s try to race it
29. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Thinking it is the way
• By racing the car we will find out if it has gas, air in tires, oil, etc.
30. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Why is this STILL happening?
31. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
• None or not much performance culture
32. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
• Many still think it has to happen in the end
Perf UAT Functional
33. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
• It is the only way for response times
34. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
• Confusion of performance and load
PeRf LoAd
35. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
• All this time Performance Testing was only…
36. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
• All this time Performance Testing was only…
• LOAD TESTING!!!! 😱
37. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
• Man with a hammer fallacy
38. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
“To a man with a hammer,
everything looks like a nail.”
― Mark Twain
39. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
There are some reasons
• To a man with a load automation tool
everything must be load automated
40. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
BETTER WAYS
41. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Don’t just check it in
• The produced parts were just placed on the cars as they came out
42. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Don’t just check it in
• Verify each piece as soon as it is produced and measure the performance
with any transcendent metrics
43. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Don’t just check it in
• You must define standards of what is acceptable before you build
44. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Stress per piece
• Even before mounting pieces, put them to small tests.
• Stress, use, specs, etc.
• Separated!
45. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Put together
• As pieces are ready put them together and test them together.
• Not too much. Just shake ‘em.
• Do they fit together?
46. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Meters!
Speed meter
Distance meter
Fuel tank meter
Battery meter
Temperature meter
RPMs meter
Direction meter
Tire pressure meter
More stuff meter
47. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Lab test
Before a race check in controlled smaller environments.
48. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Just drive it
You have meters.
You can see how it does.
Drive it yourself, the testers or
anyon else before races.
49. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Fix any issue found
As soon as issues on your car are
detected. . . Fix them!
50. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
You are ready!!!!
After you applied all the previous steps, you can race!
51. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
Questions?
52. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
THANK YOU!