Class

org.apache.spark.sql.execution.columnar.impl

ColumnFormatIterator

Related Doc: package impl

Permalink

final class ColumnFormatIterator extends ClusteredColumnIterator with DiskRegionIterator

A customized iterator for column store tables that projects out the required columns and returns those column batches first that have all their columns in the memory. Further this will make use of DiskBlockSortManager to allow for concurrent partition iterators to do cross-partition disk block sorting and fault-in for best disk read performance (SNAP-2012).

Linear Supertypes
DiskRegionIterator, ClusteredColumnIterator, CloseableIterator[RegionEntry], Iterator[RegionEntry], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ColumnFormatIterator
  2. DiskRegionIterator
  3. ClusteredColumnIterator
  4. CloseableIterator
  5. Iterator
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ColumnFormatIterator(baseRegion: LocalRegion, projection: Array[Int], fullScan: Boolean, txState: TXState)

    Permalink

    baseRegion

    usually the first bucket region being iterated

    projection

    array of projected columns (1-based, excluding delta or meta-columns)

Type Members

  1. type MapValueIterator = ValueIterator

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. def advanceToNextBatchSet(): Boolean

    Permalink

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. def close(): Unit

    Permalink
    Definition Classes
    ColumnFormatIterator → CloseableIterator

  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  11. def forEachRemaining(arg0: Consumer[_ >: RegionEntry]): Unit

    Permalink
    Definition Classes
    Iterator

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. def getColumnValue(columnIndex: Int): AnyRef

    Permalink

    Get the column value (1-based) for current iterator position.

    Get the column value (1-based) for current iterator position. Requires the hasNext and next of iterator to have been invoked first else can throw an NullPointerException.

    Definition Classes
    ColumnFormatIterator → ClusteredColumnIterator

  14. def hasNext(): Boolean

    Permalink
    Definition Classes
    ColumnFormatIterator → Iterator

  15. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  16. def initDiskIterator(): Boolean

    Permalink
    Definition Classes
    ColumnFormatIterator → DiskRegionIterator

  17. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  18. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  19. def next(): RegionEntry

    Permalink
    Definition Classes
    ColumnFormatIterator → Iterator

  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. def remove(): Unit

    Permalink
    Definition Classes
    Iterator

  23. def setRegion(region: LocalRegion): Unit

    Permalink
    Definition Classes
    ColumnFormatIterator → DiskRegionIterator

  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  25. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from DiskRegionIterator

Inherited from ClusteredColumnIterator

Inherited from CloseableIterator[RegionEntry]

Inherited from Iterator[RegionEntry]

Inherited from AnyRef

Inherited from Any

Ungrouped