Find and Fix Performance Bottlenecks with New Relic and BlazeMeter
1. Find and Fix
Performance Bottlenecks
With New Relic & BlazeMeter
www.BlazeMeter.com
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
2. Speakers
Ophir Prusak
BlazeMeter
Alon Girmonsky
CEO of BlazeMeter
Performance Expert Extraordinaire
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
3. Today’s Session
•Quick Overview on BlazeMeter & New Relic
•The Development Life Cycle
•Solution Walkthrough
•Creating & Running a Load Test
•Identifying and Fixing the Bottleneck
•Re-testing after the Fix
•Q & A
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
4. BlazeMeter is a cloud based
load testing solution designed to
simplify the work for developers, performance
engineers and QA testers
www.BlazeMeter.com
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
5. BlazeMeter Overview
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
6. Create User Scenario
Direct
•JMeter Script Upload
•URL List
Plugins
• Google Analytics
• Drupal
• WordPress (beta)
• Magento (coming soon)
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
7. Any JMeter Script, Any Scenario
Comprehensive scripting at your fingertips
• HTTP / HTTPS
• Login / Signup / Authentication
• Forms / GET / POST
• Credit card transactions
• Web services / APIs
• Dynamic requests
• Mobile
• Databases - MySQL, MS-SQL, Oracle.
• Multiple user profiles
100% Apache JMeter Compatible
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
8. Define Parameters
•Users (up to 100k)
•Servers / IPs (up to 100)
•Duration
•Ramp Up Time
•Location
•Master / Slave
•Behind the Firewall
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
9. Run Test
Integration with Developer Tools
•On Demand Dedicated Secure Server Instances
•Automatic or Manual Server Allocation
•Run Manually, Scheduled or via REST API
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
12. Interactive Reporting Dashboard
Waterfall Report with Breakdown of Included Page Assets
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
13. All Tests and Reports are Saved Online
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
14. Real World Scenario
Testing a Facebook app with 30K concurrent users
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
15. New Relic
Application Performance Management
Pinpointing Precise Bottlenecks
www.NewRelic.com
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
16. ?What can you do with New Relic
What is New Relic?
• With New Relic, you can easily monitor
application performance and diagnose
problems.
• New Relic integrates with your back end
and provides easy ways to define and
select which applications and KPIs you
want to monitor.
• When using New Relic together with
BlazeMeter, developers can evaluate
the user load, end-user experience and
the application system KPIs using a
single dashboard.
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
17. BlazeMeter & New Relic
The Integration
BlazeMeter + New Relic = Best of Breed Partnership
www.NewRelic.com
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
18. The Development Life Cycle
Before BlazeMeter and New Relic
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
19. The Development Life Cycle
With BlazeMeter & New Relic
Troubleshooting Performance Problems
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
20. The Problem
There are always problems ..
Your site is slow under load
You don’t know what to fix
Your boss wants it fixed yesterday
Your boss asks you to find a solution
You can sit around until you are old and grey while you
wait for the problem to reproduce itself.
OR
Use BlazeMeter & New Relic to save the day!
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
21. The Problem – An Inefficient Use Case
The performance level is not what my boss expects
The Problem is in the DB
The code snippet causing the problem
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
22. Diagnose
New Relic New Relic .. Please help me ..
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
23. Fix
Thanks New Relic & BlazeMeter .. My boss is happy now
After
Before
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
24. Sign up to BlazeMeter’s BASIC plan and enter
code NEWRELIC213 at checkout to get your
free month of load testing (usually $199).
Also, New Relic is giving BlazeMeter users the
New Relic Standard Plan for free, forever.
Use the signup link on our promo page.
*BlazeMeter offer can be redeemed until February 28, 2013.
www.BlazeMeter.com/promo/newrelic
Questions? Contact us at info@blazemeter.com
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
25. Thanks for joining us today!
Contact us at info@blazemeter.com
www.BlazeMeter.com
BlazeMeter.com - 175 Varick Street NY, NY | 1-855-445-2285 | info@blazemeter.com
Hinweis der Redaktion
Hello and welcome to ‘Finding and Fixing Performance Bottlenecks with New Relic & BlazeMeter. Cloud Intelligence 02/18/13 Propriety Information
I’m Ophir Prusak, from BlazeMeter CEO and we have with us performance expert, Alon Girmonsky. Alon used to be a software developer so he created BlazeMeter with the needs of software developers in mind. Cloud Intelligence 02/18/13 Propriety Information
I know not everyone has had a chance to use BlazeMeter so during today’s session we’ll also provide a quick overview on both BlazeMeter and New Relic. We ’ll then review the old and new development cycles and then do a full walkthrough of creating a test, running it, finding performance issues(like bottlenecks), fixing and retesting as part of the advanced development life-cycle . If you have questions please do so in the chat window and we’ll address these at the end . Cloud Intelligence 02/18/13 Propriety Information
For those of you who are new to BlazeMeter, let me offer a brief overview. BlazeMeter is a load testing platform that is cloud based and fully compatible with Apache JMeter. The idea is to simplify load testing and make easy to use and integrate into the development life-cycle. Load testing isn’t just a tool – it’ s a process. Cloud Intelligence 02/18/13 Propriety Information
The steps are pretty straightforward, we create a scenario (what we want to test) – web page, form, checkout, etc . define parameters (how much load), then run the test and then analyze the results in real-time Cloud Intelligence 02/18/13 Propriety Information
BlazeMeter also supports a wealth of options to create the user scenario of what we want to test . You can upload a JMeter script which gives you unlimited flexibility, or for simple tests, a list of URLs will do the trick . We also have a series of plugins and modules to test specific systems automatically . Cloud Intelligence 02/18/13 Propriety Information
JMeter itself really can support any scenario and it’s a free download. BlazeMeter, of course, supports and is fully compatible with all things JMeter. Basically, anything you can do with JMeter, you can also do on BlazeMeter…and loads more. Cloud Intelligence 02/18/13 Propriety Information
The next step is to define the test parameters - how many users and servers we want for the test, the location of test servers and so on . BlazeMeter also supports testing behind the firewall for internal environments . Cloud Intelligence 02/18/13 Propriety Information
When running the test BM supports integrations with multiple developer tools and environments . If you’re running a test with 20,000 users you can have BM automatically allocate the required servers or you can define this yourself when setting up a test . Tests can also be run on a schedule (so you don’ t have to be awake when you want to test at 3:00 am) or even via a REST API Cloud Intelligence 02/18/13 Propriety Information
BlazeMeter reports include a load report with all transactions and key performance indicators . You can compare between transactions and KPIs in real time while the test is running Reports include load results, waterfall, error report, load server monitoring, real browser reports, page speed and logs . Cloud Intelligence 02/18/13 Propriety Information
BM also analyzes web pages and will provide recommendations for front end optimzations Cloud Intelligence 02/18/13 Propriety Information
You can further compare the real time results to the results of a test that ran in the past . Additional reports include the waterfall report, real browser report, error report and page speed report . Cloud Intelligence 02/18/13 Propriety Information
You can further compare the real time results to the results of a test that ran in the past . Additional reports include the waterfall report, real browser report, error report and page speed report . Cloud Intelligence 02/18/13 Propriety Information
This is one of my favorite case studies. As I ’m sure most of you know-it’s not easy testing high capacity, rich applications like gaming, particularly for Facebook and like platforms. But using BlazeMeter’s out of the box environment, iWIN Games was able to simulate 30 thousand concurrent users and find and fix bottlenecks before launching their game on Facebook-which they did with success . ( Next Slide ) Cloud Intelligence 02/18/13 Propriety Information
New Relic (Next slide) Cloud Intelligence 02/18/13 Propriety Information
What is New Relic? New Relic is the leading application performance monitoring tool and it ’s as easy a tool to use as BlazeMeter You can easily monitor application performance and diagnose performance related problems. New Relic provides easy ways to define and select which applications you want to monitor and what KPI you want to have monitored Through BlazeMeter ’s integration with New Relic, developers can easily monitor their application performance level while load testing it. You can evaluate the end-user experience and the application system KPIs using a single dashboard. You don ’t need to wait for the problem to occur, you can make it happen! And then, you better get it fixed! (Next Slide) Cloud Intelligence 02/18/13 Propriety Information
BlazeMeter ’s load testing platform+ New Relic’s application performance monitoring is the ideal solution for the agile continuous development life-cycle. (Next Slide) Cloud Intelligence 02/18/13 Propriety Information
This is what things looked like before solutions like BlazeMeter & New Relic . Cloud Intelligence 02/18/13 Propriety Information
The integration between BlazeMeter and New Relic allows for side-by-side analysis of simulated load performance and application performance related issues. Fixing bottlenecks and re-testing becomes a seamless part of development, making it easy to identify and fix application performance issues in test environments. New Relic data and analysis reveals what is happening inside the app environment through end-user performance and error analysis and overlays it on BlazeMeter load bearing results, all in a single dashboard . So all you developers can now analyze how much traffic your apps can really handle, fix the bottlenecks, retest and perfect your sites and apps on a regular basis . Cloud Intelligence 02/18/13 Propriety Information
1 - What is the problem ? 2 - You boss has asked you to find the solution . 3 - You can sit around until you are old and grey while you wait for the problem to reproduce itself . 4 - In this case, our code is less than efficient . 5 - We are using BlazeMeter to generate a gradual load . 6 - We can use JMeter to run a script or in more simple cases,just provide a list of URLs as we are in this case . 7 - We run the load . 8 - This report is the outcome . 9 - We can see there is a problem . 10 - The New Relic dashboard has indicated the problem right in the dashboard . 11 - Now we'll do a deep dive using the New Relic dashboard . 12 - We have identified the suspect to be a certain select statement . 13 - We fix the code . 14 - We now run the same test and compare the results . Cloud Intelligence 02/18/13 Propriety Information
1 - What is the problem ? 2 - You boss has asked you to find the solution . 3 - You can sit around until you are old and grey while you wait for the problem to reproduce itself . 4 - In this case, our code is less than efficient . 5 - We are using BlazeMeter to generate a gradual load . 6 - We can use JMeter to run a script or in more simple cases,just provide a list of URLs as we are in this case . 7 - We run the load . 8 - This report is the outcome . 9 - We can see there is a problem . 10 - The New Relic dashboard has indicated the problem right in the dashboard . 11 - Now we'll do a deep dive using the New Relic dashboard . 12 - We have identified the suspect to be a certain select statement . 13 - We fix the code . 14 - We now run the same test and compare the results . Cloud Intelligence 02/18/13 Propriety Information
1 - What is the problem ? 2 - You boss has asked you to find the solution . 3 - You can sit around until you are old and grey while you wait for the problem to reproduce itself . 4 - In this case, our code is less than efficient . 5 - We are using BlazeMeter to generate a gradual load . 6 - We can use JMeter to run a script or in more simple cases,just provide a list of URLs as we are in this case . 7 - We run the load . 8 - This report is the outcome . 9 - We can see there is a problem . 10 - The New Relic dashboard has indicated the problem right in the dashboard . 11 - Now we'll do a deep dive using the New Relic dashboard . 12 - We have identified the suspect to be a certain select statement . 13 - We fix the code . 14 - We now run the same test and compare the results . Cloud Intelligence 02/18/13 Propriety Information
1 - What is the problem ? 2 - You boss has asked you to find the solution . 3 - You can sit around until you are old and grey while you wait for the problem to reproduce itself . 4 - In this case, our code is less than efficient . 5 - We are using BlazeMeter to generate a gradual load . 6 - We can use JMeter to run a script or in more simple cases,just provide a list of URLs as we are in this case . 7 - We run the load . 8 - This report is the outcome . 9 - We can see there is a problem . 10 - The New Relic dashboard has indicated the problem right in the dashboard . 11 - Now we'll do a deep dive using the New Relic dashboard . 12 - We have identified the suspect to be a certain select statement . 13 - We fix the code . 14 - We now run the same test and compare the results . Cloud Intelligence 02/18/13 Propriety Information
So, if you are excited to try out BlazeMeter ’s integration with New Relic, just sign up if you haven’t already and enter code NEWRELIC213 to redeem your free month of load testing! Get one month of our BASIC plan, which includes up to 20 tests of up to 1000 concurrent users for free. Q & A Cloud Intelligence 02/18/13 Propriety Information
Thanks for joining us today Cloud Intelligence 02/18/13 Propriety Information