Apache Kafka is an open-source, publisher-subscriber messaging platform.

Kafka is created by LinkedIn in 2011 and later open-sourced to the apache community.

[{"selector":"#anim-db9e32d0-f9fb-45ef-912f-e7835e0693ca","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ab6b9aa1-1740-4380-958e-83cd73af72a0","keyframes":{"transform":["translate3d(0px, 169.70491%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Kafka quickly evolved from messaging queue to a full-fledged streaming platform capable of handling millions of messages/second.

[{"selector":"#anim-18f95dda-6056-46eb-b446-44930c3ba1d3","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-bcf4bd76-3d05-481e-b775-5aae5f295e7a","keyframes":{"transform":["translate3d(0px, 130.01145%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Apache Kafka is built to handle real-time streaming data.

[{"selector":"#anim-73b154b9-9e88-4612-8bdb-77aad27282a3","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-54d8d1a7-db4b-427c-b652-598868aa527b","keyframes":{"transform":["translate3d(0px, 222.10650%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Apache Kafka is used to build high-performance data pipelines, streaming analytics, and mission-critical applications.

[{"selector":"#anim-a3d21d1d-c65e-4c37-b1a1-dc5402d5a420","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d4ad7faf-f088-4b4d-8143-63035f4433af","keyframes":{"transform":["translate3d(0px, 149.82746%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

In Kafka, messages are partitioned, distributed, and replicated to achieve fault tolerance.

[{"selector":"#anim-b0f0c59b-0f52-4d6d-b5ed-bc0d440cf2de","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-3c38a0b8-ccf4-45a3-9ebd-f6c2ad450676","keyframes":{"transform":["translate3d(0px, 180.64240%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Kafka needs ZooKeeper for metadata information and for synchronisation service.

[{"selector":"#anim-2b585c0f-19de-4795-a72b-55135adb0801","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-22ae2b87-6070-47c7-abf7-d807a0ef3f34","keyframes":{"transform":["translate3d(0px, 180.64240%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]