Apache flink is an open-source, distributed query engine that can process batch as well as streaming data.

Apache-spark is used for batch processing whereas flink is used for real-time stream processing

[{"selector":"#anim-a0896064-eea4-47ca-a57b-c82fbbf8e975 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}]

Flink can be deployed on VMS, docker and Kubernetes

In flink, a user can write code in java, scala, and python.

Flink consists of two data abstractions DataStream and DataSet. DataSet is used for a bounded stream whereas DataStream is used for a continuous stream.

Flink is very fast and it can process TBs of data in a few minutes.

[{"selector":"#anim-3f8822c3-1146-4a54-bc9b-d039db71f1ae [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}]

Flink provides libraries for machine learning(Flink ML), graph(Gelly), and SQL(Tables)

[{"selector":"#anim-3d3b0dc1-d92a-4b6d-ae80-6ad7c33e4107 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}]

Click to learn more

[{"selector":"#anim-7505437b-2527-4829-97f2-9dba3df37647 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}]