Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

•

36 gefällt mir•8,970 views

A high-performance proxy server is less than a hundred lines of Ruby code and it is an indispensable tool for anyone who knows how to use it. In this session we will first walk through the basics of event-driven architectures and high-performance network programming in Ruby using the EventMachine framework.

Technologie

Ruby Proxies for Scale, Performance and Monitoring Ilya Grigorik CTO / AideRSS Event-Driven Architectures @igrigorik #meshu #eda http://bit.ly/eda

postrank.com/topic/ruby The slides… Twitter My blog

[object Object],“ Rails, Django, Seaside, Scala…” cant scale.

Proxies for Monitoring, Performance and Scale welcome to the wonderful world of intercepting, caching, … , proxy servers

Problem: Staging Environment Production Simulated User

“ Representative Load / Staging” Duplication Simulating traffic?

Replay log data, rinse, repeat github.com/igrigorik/autoperf

[object Object],[object Object],Real (production) traffic Duplex Ruby Proxy, FTW!

Same response, different turnaround time Different response body!

[object Object],1. Accept connection - Connect & Forward to Production - Connect & Forward to Staging 2. Stream response to client from Production - Buffer response from Staging 3. Run “Processor / Analyzer” once both return

Ruby EventMachine crash course EM::Connection #receive_data - new data ready for processing #unbind - connection terminated #connection_completed - connected

Forward Production Response Analyze Results

Pass response to Duplex Notify when done

%w[ <Transparent> Intercepting Caching … ] solution for every problem

Validating Proxy easy, real-time diagnostics Woops!

Who said you’re not allowed to touch the data? Intercepting Proxy for those hard-to-reach spots

SMTP / Mail: inject SPAM detection De(encrypt): stream data MySQL: inject sharding logic Intercepting Proxy for those hard-to-reach spots

@PostRank: Beanstalkd + Ruby Proxy because RAM is still expensive

[object Object],~ 93 Bytes of overhead per job ~300 Bytes of data / job x 80,000,000 jobs in memory ~ 30 GB of RAM = 2 X-Large EC2 instances Oi, expensive!

[object Object],Observations: 1. Each job is rescheduled several times 2. > 95% are scheduled for > 3 hours into the future 3. Beanstalkd does not have overflow page-to-disk Memory is wasted… We’ll add it ourselves!

@PostRank: “Chronos Scheduler” 1 “Medium” EC2 Instance Intercepting Proxy

Extend the protocol Chronos Scheduler Beanstalkd persistence Process incoming data Buffer “SCHEDULE” requests, otherwise forward

Archive to MySQL Chronos Scheduler Beanstalkd persistence Buffer “SCHEDULE”

@PostRank: “Chronos Scheduler” Extend the protocol ARCHIVE RESERVE, … 10 line patch to client: queue.archive(job)

@PostRank: “Chronos Scheduler” ~79,000,000 jobs, 4GB RAM ARCHIVE RESERVE, … Upcoming jobs: ~ 1M 400% cheaper + extensible! 1 Proxy, 1 Beanstalkd, 1 MySQL = 200 req/s

%w[ Transparent <Intercepting> Auth Cache … ] easy to make & a powerful hammer

Cheers. Questions? The slides… Twitter My blog

Empfohlen

Ruby Proxies for Scale, Performance, and MonitoringIlya Grigorik

Event Driven Architecture - MeshU - Ilya GrigorikIlya Grigorik

Servers with Event Machine - David Troy - RailsConf 2011David Troy

0-60 with Goliath: Building High Performance Ruby Web-ServicesIlya Grigorik

0-60 with Goliath: High performance web servicesIlya Grigorik

No callbacks, No Threads - Cooperative web servers in Ruby 1.9Ilya Grigorik

Building WebSocket and Server Side Events Applications using Atmospherejfarcand

Ruby 1.9 FibersKevin Ball

Empfohlen

Ruby Proxies for Scale, Performance, and MonitoringIlya Grigorik

Event Driven Architecture - MeshU - Ilya GrigorikIlya Grigorik

Servers with Event Machine - David Troy - RailsConf 2011David Troy

0-60 with Goliath: Building High Performance Ruby Web-ServicesIlya Grigorik

0-60 with Goliath: High performance web servicesIlya Grigorik

No callbacks, No Threads - Cooperative web servers in Ruby 1.9Ilya Grigorik

Building WebSocket and Server Side Events Applications using Atmospherejfarcand

Ruby 1.9 FibersKevin Ball

The Atmosphere Frameworkjfarcand

GWT Web Socket and data serializationGWTcon

WebSockets with Spring 4Sergi Almar i Graupera

Concurrent Ruby Application ServersLin Jen-Shin

Communication in Python and the C10k problemJose Galarza

Writing highly scalable WebSocket using the Atmosphere Framework and Scalajfarcand

Websockets on the JVM: Atmosphere to the rescue!jfarcand

The HTML5 WebSocket APIDavid Lindkvist

Asynchronous Web Programming with HTML5 WebSockets and JavaJames Falkner

Web sockets in JavaPance Cavkovski

Reverse ajax in 2014Nenad Pecanac

Writing Portable WebSockets in Javajfarcand

Realtime web application with javaJeongHun Byeon

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocketsametmax

Dancing with websocketDamien Krotkine

Introduction to performance tuning perl web applicationsPerrin Harkins

Building Real-Time Applications with Android and WebSocketsSergi Almar i Graupera

Beyond Breakpoints: A Tour of Dynamic AnalysisFastly

WebSockets wiith Scala and Play! FrameworkFabio Tiriticco

Going Live! with CometSimon Willison

Degrading Performance? You Might be Suffering From the Small Files SyndromeDatabricks

Making it fast: Zotonic & PerformanceArjan

Weitere ähnliche Inhalte

Was ist angesagt?

The Atmosphere Frameworkjfarcand

GWT Web Socket and data serializationGWTcon

WebSockets with Spring 4Sergi Almar i Graupera

Concurrent Ruby Application ServersLin Jen-Shin

Communication in Python and the C10k problemJose Galarza

Writing highly scalable WebSocket using the Atmosphere Framework and Scalajfarcand

Websockets on the JVM: Atmosphere to the rescue!jfarcand

The HTML5 WebSocket APIDavid Lindkvist

Asynchronous Web Programming with HTML5 WebSockets and JavaJames Falkner

Web sockets in JavaPance Cavkovski

Reverse ajax in 2014Nenad Pecanac

Writing Portable WebSockets in Javajfarcand

Realtime web application with javaJeongHun Byeon

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocketsametmax

Dancing with websocketDamien Krotkine

Introduction to performance tuning perl web applicationsPerrin Harkins

Building Real-Time Applications with Android and WebSocketsSergi Almar i Graupera

Beyond Breakpoints: A Tour of Dynamic AnalysisFastly

WebSockets wiith Scala and Play! FrameworkFabio Tiriticco

Going Live! with CometSimon Willison

Was ist angesagt? (20)

The Atmosphere Framework

GWT Web Socket and data serialization

WebSockets with Spring 4

Concurrent Ruby Application Servers

Communication in Python and the C10k problem

Writing highly scalable WebSocket using the Atmosphere Framework and Scala

Websockets on the JVM: Atmosphere to the rescue!

The HTML5 WebSocket API

Asynchronous Web Programming with HTML5 WebSockets and Java

Web sockets in Java

Reverse ajax in 2014

Writing Portable WebSockets in Java

Realtime web application with java

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocket

Dancing with websocket

Introduction to performance tuning perl web applications

Building Real-Time Applications with Android and WebSockets

Beyond Breakpoints: A Tour of Dynamic Analysis

WebSockets wiith Scala and Play! Framework

Going Live! with Comet

Ähnlich wie Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

Degrading Performance? You Might be Suffering From the Small Files SyndromeDatabricks

Making it fast: Zotonic & PerformanceArjan

Mysql Latencysrubinstein

(BDT318) How Netflix Handles Up To 8 Million Events Per SecondAmazon Web Services

Data Streaming Technology OverviewDan Lynn

Toster - Understanding the Rails Web Model and Scalability OptionsFabio Akita

Understanding the Rails web model and scalability options.toster

High Performance Cloud ComputingAmazon Web Services

node.js, javascript and the futureJeff Miccolis

Low latency in java 8 by Peter Lawrey J On The Beach

Systems Bioinformatics Workshop KeynoteDeepak Singh

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...Flink Forward

Deploying On EC2Steve Loughran

PuppetDB: Sneaking Clojure into Operationsgrim_radical

Scalable Apache for Beginnerswebhostingguy

Netflix Global Applications - NoSQL Search RoadshowAdrian Cockcroft

The Real World - Plugging the Enterprise Into It (nodejs)Aman Kohli

Perfomance tuning on Go 2.0Yogi Kulkarni

Shootout at the PAAS CorralPostgreSQL Experts, Inc.

Ähnlich wie Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com (20)

Degrading Performance? You Might be Suffering From the Small Files Syndrome

Making it fast: Zotonic & Performance

Mysql Latency

(BDT318) How Netflix Handles Up To 8 Million Events Per Second

Data Streaming Technology Overview

Toster - Understanding the Rails Web Model and Scalability Options

Understanding the Rails web model and scalability options

High Performance Cloud Computing

node.js, javascript and the future

Low latency in java 8 by Peter Lawrey

Systems Bioinformatics Workshop Keynote

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...

Deploying On EC2

PuppetDB: Sneaking Clojure into Operations

Scalable Apache for Beginners

Netflix Global Applications - NoSQL Search Roadshow

The Real World - Plugging the Enterprise Into It (nodejs)

Perfomance tuning on Go 2.0

Shootout at the PAAS Corral

Mehr von Ilya Grigorik

Pagespeed what, why, and how it worksIlya Grigorik

Making the web fast(er) - RailsConf 2012Ilya Grigorik

Ruby in the Browser - RubyConf 2011Ilya Grigorik

Intelligent Ruby + Machine LearningIlya Grigorik

No Callbacks, No Threads - RailsConf 2010Ilya Grigorik

Real-time Ruby for the Real-time WebIlya Grigorik

Ruby C10K: High Performance Networking - RubyKaigi '09Ilya Grigorik

Lean & Mean Tokyo Cabinet Recipes (with Lua) - FutureRuby '09Ilya Grigorik

Leveraging Social Media - Strategies & Tactics - PostRankIlya Grigorik

Building Mini Google in RubyIlya Grigorik

Taming The RSS BeastIlya Grigorik

Mehr von Ilya Grigorik (11)

Pagespeed what, why, and how it works

Making the web fast(er) - RailsConf 2012

Ruby in the Browser - RubyConf 2011

Intelligent Ruby + Machine Learning

No Callbacks, No Threads - RailsConf 2010

Real-time Ruby for the Real-time Web

Ruby C10K: High Performance Networking - RubyKaigi '09

Lean & Mean Tokyo Cabinet Recipes (with Lua) - FutureRuby '09

Leveraging Social Media - Strategies & Tactics - PostRank

Building Mini Google in Ruby

Taming The RSS Beast

Kürzlich hochgeladen

Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University

Take control of your SAP testing with UiPath Test SuiteDianaGray10

Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely

What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett

Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar

DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy

SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero

"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays

Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm

Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays

Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada

How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe

TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey

Story boards and shot lists for my a level piececharlottematthew16

Artificial intelligence in cctv survelliance.pptxhariprasad279825

Powerpoint exploring the locations used in television show Time Clashcharlottematthew16

The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech

"ML in Production",Oleksandr BaganFwdays

TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc

Kürzlich hochgeladen (20)

Nell’iperspazio con Rocket: il Framework Web di Rust!

Take control of your SAP testing with UiPath Test Suite

Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf

What's New in Teams Calling, Meetings and Devices March 2024

Unleash Your Potential - Namagunga Girls Coding Club

DevoxxFR 2024 Reproducible Builds with Apache Maven

SIP trunking in Janus @ Kamailio World 2024

"Debugging python applications inside k8s environment", Andrii Soldatenko

Streamlining Python Development: A Guide to a Modern Project Setup

Vertex AI Gemini Prompt Engineering Tips

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack

Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024

How AI, OpenAI, and ChatGPT impact business and software.

TeamStation AI System Report LATAM IT Salaries 2024

Story boards and shot lists for my a level piece

Artificial intelligence in cctv survelliance.pptx

Powerpoint exploring the locations used in television show Time Clash

The Ultimate Guide to Choosing WordPress Pros and Cons

"ML in Production",Oleksandr Bagan

TrustArc Webinar - How to Build Consumer Trust Through Data Privacy

Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

1. Ruby Proxies for Scale, Performance and Monitoring Ilya Grigorik CTO / AideRSS Event-Driven Architectures @igrigorik #meshu #eda http://bit.ly/eda

2. postrank.com/topic/ruby The slides… Twitter My blog

9. Proxies for Monitoring, Performance and Scale welcome to the wonderful world of intercepting, caching, … , proxy servers

10. Problem: Staging Environment Production Simulated User

11. “ Representative Load / Staging” Duplication Simulating traffic?

12. Staging fail. Profile of queries has changed Fail Load on production has changed Fail Parallel environment Fail Slower release cycle Fail

13. Replay log data, rinse, repeat github.com/igrigorik/autoperf

14.

15. Transparent Duplex Proxy, FTW

16. Same response, different turnaround time Different response body!

17.

18.

19. Ruby EventMachine crash course EM::Connection #receive_data - new data ready for processing #unbind - connection terminated #connection_completed - connected

20. Duplex incoming data

21. Forward Production Response Analyze Results

22. Open connection to application server

23. Buffer until connected

24. Pass response to Duplex Notify when done

25. Analyze Time, Response…

26. Analyze Time, Response… Response Time

27. Cute, right? but so what…

28. %w[ <Transparent> Intercepting Caching … ] solution for every problem

29. Validating Proxy easy, real-time diagnostics Woops!

30. Who said you’re not allowed to touch the data? Intercepting Proxy for those hard-to-reach spots

31. SMTP / Mail: inject SPAM detection De(encrypt): stream data MySQL: inject sharding logic Intercepting Proxy for those hard-to-reach spots

32. @PostRank: Beanstalkd + Ruby Proxy because RAM is still expensive

33.

34.

35. @PostRank: “Chronos Scheduler” 1 “Medium” EC2 Instance Intercepting Proxy

36. Extend the protocol Chronos Scheduler Beanstalkd persistence Process incoming data Buffer “SCHEDULE” requests, otherwise forward

37. Archive to MySQL Chronos Scheduler Beanstalkd persistence Buffer “SCHEDULE”

38. @PostRank: “Chronos Scheduler” Extend the protocol ARCHIVE RESERVE, … 10 line patch to client: queue.archive(job)

39. @PostRank: “Chronos Scheduler” ~79,000,000 jobs, 4GB RAM ARCHIVE RESERVE, … Upcoming jobs: ~ 1M 400% cheaper + extensible! 1 Proxy, 1 Beanstalkd, 1 MySQL = 200 req/s

40. %w[ Transparent <Intercepting> Auth Cache … ] easy to make & a powerful hammer

41. Cheers. Questions? The slides… Twitter My blog

Hinweis der Redaktion

Wonderful, wonderful world in the context of building and using Ruby proxy servers for scale, performance and monitoring.