Spark Question
Standalone Mode : By default, applications submitted to the standalone mode cluster will run in FIFO order, and each application will try to use all available nodes. You can launch a standalone cluster either manually, by starting a master and workers by hand, or use our provided launch scripts. It is also possible to run these daemons on a single machine for testing.
Apache Mesos : Apache Mesos is an open-source project to manage computer clusters, and can also run Hadoop applications. The advantages of deploying Spark with Mesos include dynamic partitioning between Spark and other frameworks as well as scalable partitioning between multiple instances of Spark.
Hadoop YARN : Apache YARN is the cluster resource manager of Hadoop 2. Spark can be run on YARN as well.
Kubernetes : Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications.
Apache Mesos : Apache Mesos is an open-source project to manage computer clusters, and can also run Hadoop applications. The advantages of deploying Spark with Mesos include dynamic partitioning between Spark and other frameworks as well as scalable partitioning between multiple instances of Spark.
Hadoop YARN : Apache YARN is the cluster resource manager of Hadoop 2. Spark can be run on YARN as well.
Kubernetes : Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications.
