images/2020/04/Apache-Beam.png}}

Apache Beam

Apache Beam provides an advanced unified programming model to implement batch and streaming data processing jobs.

21 Alternatives To Apache Beam

Airflow

Airflow is a platform to programmaticaly author, schedule and monitor data pipelines.
images/2020/04/Amazon-EMR.png}}

Amazon EMR

Amazon Elastic MapReduce is a web service that makes it easy to quickly process vast amounts of data.

Amazon SQS

Amazon Simple Queue Service is a fully managed message queuing service.

Apache Kafka

Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala.

Apache NiFi

An easy to use, powerful, and reliable system to process and distribute data.

Apache Spark

Apache Spark is an engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing.
images/2020/04/Apache-Spark-for-Azure-HDInsight.png}}

Apache Spark for Azure HDInsight

This article provides an introduction to Spark in HDInsight and the different scenarios in which you can use Spark cluster in HDInsight.
images/2020/04/Azure-Data-Lake-Store.png}}

Azure Data Lake Store

Azure Data Lake Storage Gen2 is highly scalable and secure storage for big data analytics. Maximize costs and efficiency through full integrations with other Azure products.
images/2020/04/Azure-HDInsight.png}}

Azure HDInsight

Azure HDInsight is a managed Apache Hadoop cloud service that lets you run Apache Spark, Apache Hive, Apache Kafka, Apache HBase, and more.

Confluent

Confluent offers a real-time data platform built around Apache Kafka.
images/2020/04/Databricks.png}}

Databricks

Databricks provides a Unified Analytics Platform that accelerates innovation by unifying data science, engineering and business.‎What is Apache Spark?
images/2020/04/Gearman.png}}

Gearman

Gearman provides a generic application framework to farm out work to other machines or processes that are better suited to do the work.

Google Cloud Dataflow

Google Cloud Dataflow is a fully-managed cloud service and programming model for batch and streaming big data processing.

Google Cloud Dataproc

Managed Apache Spark and Apache Hadoop service which is fast, easy to use, and low cost
images/2020/04/Hadoop-HDFS.png}}

Hadoop HDFS

The Apache HDFS is a distributed file system that makes it possible to scale a single Apache Hadoop cluster to hundreds (and even thousands) of nodes.

HortonWorks Data Platform

The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly…

Qubole

Qubole delivers a self-service platform for big aata analytics built on Amazon, Microsoft and Google Clouds.
images/2020/04/Zenaton.png}}

Zenaton

Powerful & Easy Automation for Developers

ZeroMQ

ZeroMQ is a high-performance asynchronous messaging library.