From Shared Memory to Kafka: My Journey Through Messaging Technologies


A look back at occasion messaging I have made use of

Distributing messages (created image)

After two decades of building dispersed systems, I have actually carried out message passing throughout 8 various innovations. From the bare-metal simpleness of shared memory to the cloud-native elegance of Amazon Kinesis, each taught me something different about the tradeoffs in between performance, complexity, and functional expenses.

The capability to reply to changes in real-time is essential. Event-Driven Design (EDA) functions as a means to allow systems that can respond to occasions as they take place, rather than relying upon simultaneous demands and responses. This shift in the direction of asynchronous interaction enables applications to scale, resulting in even more resistant and receptive systems.

An idea that is core to EDA are messaging systems that assist in the transmission of events between decoupled elements. Technologies such as Google’s PubSub, Amazon’s Straightforward Notification Service (SNS) + Simple Line Service (SQS), RabbitMQ, Apache Kafka, Amazon EventBridge, Amazon Kinesis, Redis, and also shared memory (Shmem) have actually each taken a specific niche in this ecological community.

In this short article, I look back to each one of these innovations that I have actually used expertly. I define what I believe the staminas …

Source web link

Leave a Reply

Your email address will not be published. Required fields are marked *