With live video usage increasing to watch sporting events, popular TV shows, etc., load and performance testing live streaming applications has become a must to ensure they can withstand heavy traffic. Our Sep 6, 2017 webinar looked at using Apache JMeter™ for testing streaming applications. Until now, JMeter supported the load testing of HTTP Live Streaming (HLS) applications, the leading protocol, with a few different elements. But now, a new HLS plugin for JMeter makes the process much simpler and efficient than before. An overview of the HLS protocol including its key components An introduction to the new JMeter HLS plugin How to learn more and get involved with this open-source project

1. Using JMeter for Performance Testing
Live Streaming Applications
Presented by BlazeMeter
a CA Technologies Company
Sep 6, 2017

2. AGENDA
• Intro
• HLS Overview
• HLS & JMeter Old Style
• HLS & JMeter New Style
• Q&A

3. What a long strange trip it’s been...
Dave Karow { Developer Advocate } @davekarow
Keynote Systems (7 years)
- Load Testing
- Synthetic Monitoring
dynatrace
SOASTA
BlazeMeter
CA Technologies Continuous Delivery

4. HLS Overview
HLS = HTTP Live Streaming
• Uses only http/https (remember real media?)
– Proxy/firewall friendly
– Served from any http server/CDN
• Adaptive Bitrate: Degrades instead of stalling
– Multiple stream variants (by bandwidth/resolution)
– Client chooses/re-chooses best stream

5. HLS Components
1. Encoding/Encapsulation: Transcoder
a. The “heavy lifting” (CPU intensive)
b. Outputs:
i. .m3u8 master index (list of variants)
ii. .m3u8 variant index (list of segments)
iii. .ts file containing each segment

6. HLS Components
1. Encoding/Encapsulation: Transcoder
2. Distribution: Web Server/CDN/Proxy
3. Client: Mobile Device, js in Browser, etc...
Our Focus Today

7. 1. Get master playlist for “about_demo” video
GET http://hls.demoblaze.com/index.m3u8
2. Parse master playlist for list of variants, choose one
(let’s assume low bandwidth environment, so lowest resolution to start)
3. Get variant playlist matching bandwidth/resolution
GET http://hls.demoblaze.com/about_demo_hls_600k.m3u8
4. Get and play fragment from variant playlist
GET http://hls.demoblaze.com/about_demo_hls_600k00000.ts
5. If live: Go back to #1 to get new master playlist
HLS Playback Flow @ High Level

8. GET http://hls.demoblaze.com/index.m3u8
#EXTM3U
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=8674000,RESOLUTION=1024x576,CODECS="avc1.4d001f,mp4a.40.2"
about_demo_hls_2M.m3u8
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=7633000,RESOLUTION=960x540,CODECS="avc1.4d001f,mp4a.40.2"
about_demo_hls_1-5M.m3u8
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=3733000,RESOLUTION=640x360,CODECS="avc1.4d001f,mp4a.40.2"
about_demo_hls_1M.m3u8
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=2624000,RESOLUTION=480x270,CODECS="avc1.42001e,mp4a.40.2"
about_demo_hls_600k.m3u8
list of variants by bandwidth/resolution
The Master Playlist

9. GET http://hls.demoblaze.com/about_demo_hls_600k.m3u8
#EXTM3U
#EXT-X-VERSION:3
#EXT-X-MEDIA-SEQUENCE:0
#EXT-X-ALLOW-CACHE:YES
#EXT-X-TARGETDURATION:13
#EXTINF:12.066667,
about_demo_hls_2M00000.ts
#EXTINF:9.000000,
about_demo_hls_2M00001.ts
#EXTINF:9.000000,
about_demo_hls_2M00002.ts
list of fragments for that variant
Variant Playlist

10. GET http://hls.demoblaze.com/about_demo_hls_600k00000.ts
(ts = transport stream fragment)
Fragment

11. As Seen By BlazeMeter Chrome Extension
Master Playlist (m3u8)
Variant Playlist (m3u8)
Fragments (.ts)
Faster Variant Playlist
Fragments (.ts)

12. Let’s Do A Live Demo

13. Many Pieces...
Scripting in JMeter: Old Style

14. HLS Sampler Plug-In
Scripting in JMeter: New Style

15. HLS Sampler Plug-In
Scripting in JMeter: New Style

16. Adding Assertions
Assertions can be raised against:
• Master Playlist
• Variant Playlist
Example Assertions:
• Response Assertion
• Duration Assertion

17. Adding Assertions

18. Wrapping Up
The HLS Sampler plugin is open-source.
Pull requests are welcomed!
1. Go to jmeter-plugins.org
2. Search “hls”and click on “HLS Sampler”
3. That puts you in Git-Hub: jump right in!

19. Q&A Time

20. Next Steps
● Add the HLS Sampler via Plugins Manager or by
visiting jmeter-plugins.org
● Create your free account at blazemeter.com
● Performance Testing Blog – blazemeter.com/blog
● Learning Resources – blazemeter.com/resources
● Quick Survey @ Webinar Exit – Thanks!