Package

org.apache.spark

deploy

Permalink

package deploy

Visibility
  1. Public
  2. All

Type Members

  1. class SparkHadoopUtil extends internal.Logging

    Permalink

    :: DeveloperApi :: Contains util methods to interact with Hadoop from Spark.

    :: DeveloperApi :: Contains util methods to interact with Hadoop from Spark.

    Annotations
    @DeveloperApi()

Value Members

  1. object Client

    Permalink

    Executable utility for starting and terminating drivers inside of a standalone cluster.

  2. object ExternalShuffleService extends internal.Logging

    Permalink

    A main class for running the external shuffle service.

  3. object GetJarsAndDependencies

    Permalink
  4. object PackageAndDepUtils

    Permalink
  5. object PythonRunner

    Permalink

    A main class used to launch Python applications.

    A main class used to launch Python applications. It executes python as a subprocess and then has it connect back to the JVM to access system properties, etc.

  6. object RRunner

    Permalink

    Main class used to launch SparkR applications using spark-submit.

    Main class used to launch SparkR applications using spark-submit. It executes R as a subprocess and then has it connect back to the JVM to access system properties etc.

  7. object SparkHadoopUtil

    Permalink
  8. object SparkSubmit

    Permalink

    Main gateway of launching a Spark application.

    Main gateway of launching a Spark application.

    This program handles setting up the classpath with relevant Spark dependencies and provides a layer over the different cluster managers and deploy modes that Spark supports.

  9. package history

    Permalink
  10. package master

    Permalink
  11. package worker

    Permalink
  12. package yarn

    Permalink

Ungrouped