Collaborative Applications at Scale with RSocket
•
1 gefällt mir•273 views
SpringOne 2021 Session Title: Collaborative Applications at Scale with RSocket Speaker: Sergey Tselovalnikov, Software Engineer at Canva
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Ähnlich wie Collaborative Applications at Scale with RSocket
Ähnlich wie Collaborative Applications at Scale with RSocket (19)
Mehr von VMware Tanzu
Mehr von VMware Tanzu (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Collaborative Applications at Scale with RSocket
- 4. COLLABORATIVE APPLICATIONS AT SCALE WITH RSOCKET Sergey Tselovalnikov @SerCeMan Canva
- 5. SCALE Why should you care?
- 11. Architecture
- 12. Bob WebSocket
- 13. Bob
- 14. Bob
- 15. Bob
- 20. WebSocket Gateway Presenting Channel RSocket WebSocket connection
- 21. WebSocket Gateway Editing Channel Presenting Channel RSocket WebSocket connection
- 27. Application
- 28. RSocket-Java Transport - how to send & receive Acceptor - how to handle
- 30. public interface DuplexConnection { Mono<Void> send(Publisher<ByteBuf> frames); Flux<ByteBuf> receive(); }
- 31. public interface DuplexConnection { Mono<Void> send(Publisher<ByteBuf> frames); Flux<ByteBuf> receive(); } RSocket Frame RSocket Frame
- 32. class RsInterceptor implements DuplexConnectionInterceptor { @Override public DuplexConnection apply(Type type, DuplexConnection connection) { return new InstrumentedRsConnection(type, connection); } static class InstrumentedRsConnection implements DuplexConnection { @Override public Mono<Void> send(Publisher<ByteBuf> frames) { return connection.send(Flux.from(frames) // .doOnNext(frame -> recordFrame("out", frame, connectionType))); } ... } wraps the connection record each frame
- 35. Transport metrics NEXT NEXT NEXT COMPLETE ERROR
- 36. Transport metrics NEXT NEXT NEXT NEXT COMPLETE ERROR + CANCEL frame
- 37. Transport metrics NEXT NEXT NEXT NEXT COMPLETE ERROR + cancellation + in/out
- 40. Acceptor public interface RSocket { Flux<Payload> requestChannel(Flux<Payload> incoming) { ... } } incoming messages outgoing messages
- 41. Intercepting Acceptor class ForwardingRSocket implements RSocket { private final RSocket delegate; public ForwardingRSocket(RSocket delegate) { this.delegate = delegate; } @Override public Flux<Payload> requestChannel(Publisher<Payload> payloads) { return delegate.requestChannel(payloads); } ...
- 42. What's the latency for establishing a channel? Intercepting Acceptor
- 43. What's the latency for establishing a channel? For how long do the channels stay alive? Flux<Payload> recordSignal(Supplier<Flux<Payload>> signalProvider) { var time = Timer.start("RSOCKET_STREAM_TIMER"); return signalProvider.get().doFinally(signal -> { time.stop(); }); } Intercepting Acceptor
- 44. Logging @Override public Flux<Payload> requestChannel(Publisher<Payload> payloads) { var incoming = Flux.from(payloads) .doOnSubscribe(s -> logger.info("subscribed to incoming")) .doOnCancel(() -> logger.info("unsubscribed from incoming")) .doOnComplete(() -> logger.info("complete incoming")) .doOnError(e -> logger.info("error incoming")); var outgoing = delegate().requestChannel(incoming); return outgoing // .doOnSubscribe(s -> logger.info("subscribed to outgoing")) .doOnCancel(() -> logger.info("unsubscribed from outgoing")) .doOnComplete(() -> logger.info("complete outgoing")) .doOnError(e -> logger.info("error outgoing")); } }
- 45. Logging Caveats Sep 3, 2021 @ 18:42:42.042 socket connected Sep 3, 2021 @ 18:42:42.042 socket connected Sep 3, 2021 @ 18:42:42.042 subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 unsubscribed from outgoing Sep 3, 2021 @ 18:42:42.042 unsubscribed from incoming Sep 3, 2021 @ 18:42:42.042 socket closed Sep 3, 2021 @ 18:42:42.042 subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 subscribed to incoming Sep 3, 2021 @ 18:42:42.042 subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 socket connected Sep 3, 2021 @ 18:42:42.042 unsubscribed from incoming Sep 3, 2021 @ 18:42:42.042 socket closed Sep 3, 2021 @ 18:42:42.042 socket connected Sep 3, 2021 @ 18:42:42.042 subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 unsubscribed from outgoing Sep 3, 2021 @ 18:42:42.042 socket connected Sep 3, 2021 @ 18:42:42.042 subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 socket closed Sep 3, 2021 @ 18:42:42.042 socket closed Sep 3, 2021 @ 18:42:42.042 unsubscribed from incoming
- 46. Logging Caveats Sep 3, 2021 @ 18:42:42.042 685424232abc socket connected Sep 3, 2021 @ 18:42:42.042 685424232def socket connected Sep 3, 2021 @ 18:42:42.042 685424232abc subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 685424232def unsubscribed from outgoing Sep 3, 2021 @ 18:42:42.042 685424232abc unsubscribed from incoming Sep 3, 2021 @ 18:42:42.042 685424232ghi socket closed Sep 3, 2021 @ 18:42:42.042 685424232abc subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 685424232def subscribed to incoming Sep 3, 2021 @ 18:42:42.042 685424232abc subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 685424232ghi socket connected Sep 3, 2021 @ 18:42:42.042 685424232abc unsubscribed from incoming Sep 3, 2021 @ 18:42:42.042 685424232def socket closed Sep 3, 2021 @ 18:42:42.042 685424232ghi socket connected Sep 3, 2021 @ 18:42:42.042 685424232abc subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 685424232ghi unsubscribed from outgoing Sep 3, 2021 @ 18:42:42.042 685424232def socket connected Sep 3, 2021 @ 18:42:42.042 685424232ghi subscribed to outgoing Sep 3, 2021 @ 18:42:42.042 685424232abc socket closed Sep 3, 2021 @ 18:42:42.042 685424232ghi socket closed Sep 3, 2021 @ 18:42:42.042 685424232abc unsubscribed from incoming
- 47. Logging Caveats if (Random.nextInt(0, 1_000_000) < flags.get(SAMPLING_RATE)) { setAttribute("sampled", true) }
- 48. Service Definition service FooService { rpc connect (stream IncomingMsg) returns (stream OutgoingMsg) { option (connectMessage) = "ConnectMsg" } } Flux<Payload> => Flux<IncomingMsg>
- 52. Reconnection /** * Returns a Flowable that immediately publishes the current connection * status and thereafter updates as it changes. Once a connection is in * the CLOSED or ERROR state, it may not be connected again. * Implementations must publish values per the comments on ConnectionStatus. */ connectionStatus(): Flowable<ConnectionStatus>;
- 53. Exponential backoff function backoff(): () => number { let i = 0; return () => Math.pow(2, i++); } ... const next = backoff(); ... await Math.round(next() * 1000);
- 54. Jitter function backoff(): () => number { let i = 0; return () => Math.pow(1.5, Math.random() + i++); } ... const next = backoff(); ... await Math.round(next() * 1000);
- 59. Instance configuration Number of open files Low latency GC (ShenandoahGC for memory)
- 60. Infrastructure
- 61. Load Balancing
- 76. Healthy Healthy Healthy 50000 50000 1 var socket = healthy.stream() .filter(s -> s.availability() > 0) .min(s -> s.openChannels());
- 77. Availability /** * @return a positive number representing the availability of the entity. * Higher is better, 0.0 means not available */ double availability(); 0 1 warm up
- 78. Healthy Healthy Healthy 50000 50000 1 var socket = healthy.stream() .filter(s -> s.availability() > 0) .min(s -> { var active = s.activeChannels(); var availability = s.availability(); return active / availability; });
- 79. Autoscaling
- 80. Autoscaling target Primary: the number of connections
- 81. Autoscaling target Primary: the number of connections
- 82. Autoscaling target Primary: the number of connections Secondary: CPU
- 83. Redeployments
- 84. Redeployments
- 88. Conclusion