Spark has many advantages, but it has certain
as well, some of them are:-
In apache, the spark developer needs to
their code manually since there is no automatic optimisation.
No automatic optimization
Spark does not have any
, and it relies on Hadoop or object storage for storing the data.
No file system
Similar to Hadoop, spark also has
. Spark performance degrades when it has to process many small files.
Small file issue
Since spark is an in-memory computation engine, it requires
for the processing ,which adds cost.
Apache spark has high
as compared to apache spark.
Click to learn more