Class

org.apache.spark.sql.execution

QueryExecution

Related Doc: package execution

Permalink

class QueryExecution extends AnyRef

The primary workflow for executing relational queries using Spark. Designed to allow easy access to the intermediate phases of query execution for developers.

While this is not a public class, we should avoid changing the function names for the sake of changing them, because a lot of developers use the feature for debugging.

Linear Supertypes
AnyRef, Any
Known Subclasses
IncrementalExecution
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. QueryExecution
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new QueryExecution(sparkSession: SparkSession, logical: LogicalPlan)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. lazy val analyzed: LogicalPlan

    Permalink

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. def assertAnalyzed(): Unit

    Permalink

  7. def assertSupported(): Unit

    Permalink

  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  9. object debug

    Permalink

    A special namespace for commands that can be used to debug query execution.

  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  12. lazy val executedPlan: SparkPlan

    Permalink

  13. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  14. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  15. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  16. def hiveResultString(): Seq[String]

    Permalink

    Returns the result as a hive compatible sequence of strings.

    Returns the result as a hive compatible sequence of strings. For native commands, the execution is simply passed back to Hive.

  17. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  18. val logical: LogicalPlan

    Permalink

  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. lazy val optimizedPlan: LogicalPlan

    Permalink

  23. def planner: SparkPlanner

    Permalink
    Attributes
    protected

  24. def preparations: Seq[Rule[SparkPlan]]

    Permalink

    A sequence of rules that will be applied in order to the physical plan before execution.

    A sequence of rules that will be applied in order to the physical plan before execution.

    Attributes
    protected

  25. def prepareForExecution(plan: SparkPlan): SparkPlan

    Permalink

    Prepares a planned SparkPlan for execution by inserting shuffle operations and internal row format conversions as needed.

    Prepares a planned SparkPlan for execution by inserting shuffle operations and internal row format conversions as needed.

    Attributes
    protected

  26. def simpleString: String

    Permalink

  27. lazy val sparkPlan: SparkPlan

    Permalink

  28. val sparkSession: SparkSession

    Permalink

  29. def stringOrError[A](f: ⇒ A): String

    Permalink
    Attributes
    protected

  30. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  31. lazy val toRdd: RDD[InternalRow]

    Permalink

    Internal version of the RDD.

    Internal version of the RDD. Avoids copies and has no schema

  32. def toString(): String

    Permalink
    Definition Classes
    QueryExecution → AnyRef → Any

  33. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  34. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  35. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  36. lazy val withCachedData: LogicalPlan

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped