RabbitMQ Plugins Talk
•Als PPTX, PDF herunterladen•
1 gefällt mir•2,278 views
Writing Erlang plugins for RabbitMQ.
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (17)
Andere mochten auch
Andere mochten auch (9)
Ähnlich wie RabbitMQ Plugins Talk
Ähnlich wie RabbitMQ Plugins Talk (20)
Mehr von Lecturer UC Davis & Northwestern
Mehr von Lecturer UC Davis & Northwestern (8)
RabbitMQ Plugins Talk
- 1. Writing Plugins With RabbitMQ Noah Gift and Michael Vierling
- 2. Noah’s Background Film Commercial Data Center Automation Software Los Angeles, Atlanta, New Zealand, San Francisco I like programming in ANY language that is innovative
- 3. How & Why Why AMQP? Why Erlang? Why OTP? Why RabbitMQ? How – Machinery
- 4. Why AMQP Industry Message Standard Cisco, Microsoft, Red Hat, VMWare, JPMorgan, Chase, Goldman Sachs Binary wire protocal
- 5. Why AMQP: Continued Key component in Distributed Architecture Enables Multi-OS, Multi-Language Reliable, Transactional, Flow-Control, Fault-tolerant
- 6. Downsides of AMQP AMQP 1.0 is almost final Support resources Upgrade glitches Monitoring issues Investment in the future
- 7. Why Erlang? Functional Language Immutable Data Scalable Reliable, Fault-tolerant
- 8. Why RabbitMQ Built with Erlang 10K messages per second – transient mode 3-5K messages per second – persistent mode
- 9. Why RabbitMQ Transactions Open Source Maintained by VMWare
- 11. Broker Infrastructure Repeatable Install Reliable storage Redundant hardware
- 12. Broker Infrastructure: Continued Cluster of nodes Disaster Recovery Logging (such as Splunk) and monitoring Operations & Support
- 13. Broker Infrastructure: Use Escript
- 14. Broker InfrastructureFuture? Integrate Rebar Continuous Integration Testing QuickCheck
- 15. RabbitMQ Clients Any AMQP Clients (Apache) Ruby Python C# F# (Wrap the C# dll)
- 16. Consume.py Part: A
- 17. Consume.py Part: B
- 18. Consume.py Part: C
- 19. Send.py Part: A
- 20. Send.py Part: B
- 21. Writing RabbitMQ Plugin: WHY Access internal RabbitMQ functionality Running in same Erlang VM as broker can increase performance Leverage your existing infrastructure
- 22. Writing RabbitMQ Plugin: WHY NOT Developers don’t know Erlang Poorly written plugin could crash broker You could lock yourself to internal API
- 23. StableRabbitMQ Plugin Rabbitmq-management (replaced Alice) Rabbitmq-shovel Rabbitmq-stomp Rabbitmq-erlang-client
- 24. ExperimentalRabbitMQ Plugin Ideas Rabbitmq-auth-backend-ldap Rabbitmq-auth-mechanism-ssl Rabbitmq-jsonrpc-channel Rabbitmq-xmpp
- 25. CrazyRabbitMQ Plugin Ideas Distributed Data Structure Artificial Intelligence Data Mining Create a protocol on top Event Processing
- 26. Michael Background Apple 5 Years Ascend/Lucent 4 Years Various Startups
- 27. Supervision Tree
- 30. Rabbit RSS Worker: Slide A
- 31. Rabbit RSS Worker: Slide B
- 32. Rabbit RSS Worker: Slide C
- 33. Rabbit RSS Worker: Slide D
- 34. Rabbit RSS Worker: Slide E
- 35. Rabbit RSS Worker: Slide F
- 36. XML Parsing
- 37. RSS.ERL: Slide A
- 38. RSS.ERL: Slide B
- 39. RSS.ERL: Slide C
- 40. RSS.ERL: Slide D
- 41. Checkout source: HG clone
- 42. Make: Be Patient….
- 43. Build
- 44. Skeleton
- 45. Symlink Plugin
- 46. Run Broker $ make run (rabbit@rabbit9)1> (rabbit@rabbit9)1>application:which_applications(). {rabbit_rss,"Embedded Rabbit RSS Reader","0.01"},
- 47. Test Broker $ mkdirtest $ vi test/rabbit_rss_tests.erl $ vi Makefile TEST_APPS=amqp_clientrabbit_rss TEST_COMMANDS=rabbit_rss_tests:test() START_RABBIT_IN_TESTS=true $ make test
- 48. Package Plugin
- 49. Plugin Supporting Machinery Unit Tests Source Code Logger Printf AMQP Clients
- 50. How To Build a Plugin RabbitMQ docs Source Examples
- 51. Use the Source! Documentation is hit/miss Google “erlang lists” http://www.erlang.org/doc/apps/stdlib/ Or skip the docs and go directly to source ./lib/stdlib/src/lists.erl
- 52. Lists.erl
- 53. Logger Plugin executes in its own process No plugin stdout No plugin execution debugger
- 54. Logger: Continued Solution: Erlang’s logger Output to /var/log/rabbitmq/<hostname Nothing to configure
- 55. RSS.erl
- 56. OTP Design Principles Supervision Tree Behaviors Applications Releases Release Handling
- 57. Machine Learning The next step for the RSS plugin. A potential use case for RabbitMQ plugins.
- 58. Fisher Classifier For RSS Feeds Data mining Classification
- 59. Fisher Classifier: Slide A
- 60. Fisher Classifier: Slide B
- 61. Fisher Classifier: Slide C
- 62. Fisher Classifier: Slide D
- 63. Fisher Classifier: Slide E
- 64. Fisher Classifier: Slide E
- 65. Fisher Classifier: Slide F
- 66. Fisher Classifier: Slide G
- 67. Conclusion AMQP Erlang Python RSS
- 68. Questions Code: https://github.com/mikev/rabbitmq_rss_plugin Contact: “Noah Gift” noah.gift@gmail.com, “Michael Vierling” mvierling@gmail.com