Infrastructure Patterns
- Circuit Breaker – One of the big differences between in-memory calls and remote calls is that remote calls can fail, or hang without a response until some timeout limit is reached. What’s worse if you have many callers on a unresponsive supplier, then you can run out of critical resources leading to cascading failures across multiple systems. The basic idea behind the circuit breaker is very simple. You wrap a protected function call in a circuit breaker object, which monitors for failures. Once the failures reach a certain threshold, the circuit breaker trips, and all further calls to the circuit breaker return with an error, without the protected call being made at all. Usually you’ll also want some kind of monitor alert if the circuit breaker trips.
List of top frameworks
Netflix Hystrix
Netfilx Hystrix – Hystrix is a library that helps us control the interactions between the distributed services by adding latency tolerance and fault tolerance logic. It does this by isolating points of access between the services, stopping cascading failures across them, and providing fallback options, all of which improve our system’s overall resiliency.
Aeron
Aeron – Do we need another messaging system – Open source messaging library designed to deliver millions of messages per second, with microsecond latencies between machines. There are challenges of dealing with reliable message delivery over UDP and the data structures necessary to support transmission and retransmission in in a lock-free and wait-free manner. It is created by Todd Montgomery, a multicast and reliable protocol expert, Richard Warburton, an expert on compiler optimizations, and Martin Thompson, the pasty faced performance gangster.
LMAX Disruptor
LMAX Disruptor – High Performance Inter-Thread Messaging Library
Chronicle Engine
Chronicle Engine – A high performance, low latency, reactive processing framework
Connect with us