Class

org.apache.spark.scheduler.cluster

SnappyEmbeddedModeClusterManager

Related Doc: package cluster

Permalink

class SnappyEmbeddedModeClusterManager extends ExternalClusterManager

Snappy's cluster manager that is responsible for creating scheduler and scheduler backend.

Linear Supertypes
ExternalClusterManager, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SnappyEmbeddedModeClusterManager
  2. ExternalClusterManager
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SnappyEmbeddedModeClusterManager()

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def canCreate(masterURL: String): Boolean

    Permalink

    Check if this cluster manager instance can create scheduler components for a certain master URL.

    Check if this cluster manager instance can create scheduler components for a certain master URL.

    masterURL

    the master URL

    returns

    True if the cluster manager can create scheduler backend/

    Definition Classes
    SnappyEmbeddedModeClusterManager → ExternalClusterManager
  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def createSchedulerBackend(sc: SparkContext, masterURL: String, scheduler: TaskScheduler): SchedulerBackend

    Permalink

    Create a scheduler backend for the given SparkContext and scheduler.

    Create a scheduler backend for the given SparkContext and scheduler. This is called after task scheduler is created using ExternalClusterManager.createTaskScheduler().

    sc

    SparkContext

    masterURL

    the master URL

    scheduler

    TaskScheduler that will be used with the scheduler backend.

    returns

    SchedulerBackend that works with a TaskScheduler

    Definition Classes
    SnappyEmbeddedModeClusterManager → ExternalClusterManager
  8. def createTaskScheduler(sc: SparkContext, masterURL: String): TaskScheduler

    Permalink

    Create a task scheduler instance for the given SparkContext

    Create a task scheduler instance for the given SparkContext

    sc

    SparkContext

    masterURL

    the master URL

    returns

    TaskScheduler that will be responsible for task handling

    Definition Classes
    SnappyEmbeddedModeClusterManager → ExternalClusterManager
  9. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  13. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  14. def initialize(scheduler: TaskScheduler, backend: SchedulerBackend): Unit

    Permalink

    Initialize task scheduler and backend scheduler.

    Initialize task scheduler and backend scheduler. This is called after the scheduler components are created

    scheduler

    TaskScheduler that will be responsible for task handling

    backend

    SchedulerBackend that works with a TaskScheduler

    Definition Classes
    SnappyEmbeddedModeClusterManager → ExternalClusterManager
  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  17. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  19. var schedulerBackend: SnappyCoarseGrainedSchedulerBackend

    Permalink
  20. def stopLead(): Unit

    Permalink
  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  22. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  23. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from ExternalClusterManager

Inherited from AnyRef

Inherited from Any

Ungrouped