Class

org.apache.spark.executor

ShuffleWriteMetrics

Related Doc: package executor

Permalink

class ShuffleWriteMetrics extends Serializable with KryoSerializable

:: DeveloperApi :: A collection of accumulators that represent metrics about writing shuffle data. Operations are not thread-safe.

Annotations
@DeveloperApi()
Linear Supertypes
KryoSerializable, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ShuffleWriteMetrics
  2. KryoSerializable
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def bytesWritten: Long

    Permalink

    Number of bytes written for the shuffle by this task.

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  11. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  12. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  13. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  14. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  15. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  16. def read(kryo: Kryo, input: Input, context: TaskContext): Unit

    Permalink

  17. def read(kryo: Kryo, input: Input): Unit

    Permalink
    Definition Classes
    ShuffleWriteMetrics → KryoSerializable

  18. def recordsWritten: Long

    Permalink

    Total number of records written to the shuffle by this task.

  19. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  20. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  21. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  22. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  23. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  24. def write(kryo: Kryo, output: Output): Unit

    Permalink
    Definition Classes
    ShuffleWriteMetrics → KryoSerializable

  25. def writeTime: Long

    Permalink

    Time the task spent blocking on writes to disk or buffer cache, in nanoseconds.

Deprecated Value Members

  1. def shuffleBytesWritten: Long

    Permalink
    Annotations
    @deprecated
    Deprecated

    (Since version 2.0.0) use bytesWritten instead

  2. def shuffleRecordsWritten: Long

    Permalink
    Annotations
    @deprecated
    Deprecated

    (Since version 2.0.0) use recordsWritten instead

  3. def shuffleWriteTime: Long

    Permalink
    Annotations
    @deprecated
    Deprecated

    (Since version 2.0.0) use writeTime instead

Inherited from KryoSerializable

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped