codegen

Type Members

abstract class BaseMutableProjection extends MutableProjection
class BaseOrdering extends Ordering[InternalRow]

Inherits some default implementation for Java from Ordering[Row]
abstract class BaseProjection extends Projection

Java can not access Projection (in package object)
class BufferHolder extends AnyRef
class CodeAndComment extends Serializable

A wrapper for the source code to be compiled by CodeGenerator.
abstract class CodeGenerator[InType <: AnyRef, OutType <: AnyRef] extends internal.Logging

A base class for generators of byte code to perform expression evaluation.
A base class for generators of byte code to perform expression evaluation. Includes a set of helpers for referring to Catalyst types and building trees that perform evaluation of individual expressions.
class CodegenContext extends AnyRef

A context for codegen, tracking a list of objects that could be passed into generated Java function.
trait CodegenFallback extends Expression

A trait that can be used to provide a fallback mode for expression code generation.
case class ExprCode(code: String, isNull: String, value: String) extends Product with Serializable

Java source for evaluating an Expression given a InternalRow of input.
Java source for evaluating an Expression given a InternalRow of input.
code
The sequence of statements required to evaluate the expression. It should be empty string, if isNull and value are already existed, or no code needed to evaluate them (literals).
isNull
A term that holds a boolean value representing whether the expression evaluated to null.
value
A term for a (possibly primitive) value of the result of the evaluation. Not valid if isNull is set to true.
abstract class GeneratedClass extends AnyRef

A wrapper for generated class, defines a generate method so that we can pass extra objects into generated class.
class LazilyGeneratedOrdering extends Ordering[InternalRow] with KryoSerializable

A lazily generated row ordering comparator.
abstract class Predicate extends AnyRef

Interface for generated predicate
case class SubExprCodes(codes: Seq[String], states: Map[Expression, SubExprEliminationState]) extends Product with Serializable

Codes and common subexpressions mapping used for subexpression elimination.
Codes and common subexpressions mapping used for subexpression elimination.
codes
Strings representing the codes that evaluate common subexpressions.
states
Foreach expression that is participating in subexpression elimination, the state to use.
case class SubExprEliminationState(isNull: String, value: String) extends Product with Serializable

State used for subexpression elimination.
State used for subexpression elimination.
isNull
A term that holds a boolean value representing whether the expression evaluated to null.
value
A term for a value of a common sub-expression. Not valid if isNull is set to true.
class UnsafeArrayWriter extends AnyRef
abstract class UnsafeRowJoiner extends AnyRef
class UnsafeRowWriter extends AnyRef

Value Members

object CodeFormatter

An utility class that indents a block of code based on the curly braces and parentheses.
An utility class that indents a block of code based on the curly braces and parentheses. This is used to prettify generated code when in debug mode (or exceptions).
Written by Matei Zaharia.
object CodeGenerator extends internal.Logging
object DumpByteCode

Dumps the bytecode from a class to the screen using javap.
object ExpressionCanonicalizer extends RuleExecutor[Expression]

Canonicalizes an expression so those that differ only by names can reuse the same code.
object GenerateMutableProjection extends CodeGenerator[Seq[Expression], MutableProjection]

Generates byte code that produces a InternalRow object that can update itself based on a new input InternalRow for a fixed set of Expressions.
Generates byte code that produces a InternalRow object that can update itself based on a new input InternalRow for a fixed set of Expressions. It exposes a target method, which is used to set the row that will be updated. The internal InternalRow object created internally is used only when target is not used.
object GenerateOrdering extends CodeGenerator[Seq[SortOrder], Ordering[InternalRow]] with internal.Logging

Generates bytecode for an Ordering of rows for a given set of expressions.
object GeneratePredicate extends CodeGenerator[Expression, Predicate]

Generates bytecode that evaluates a boolean Expression on a given input InternalRow.
object GenerateSafeProjection extends CodeGenerator[Seq[Expression], Projection]

Generates byte code that produces a InternalRow object (not an UnsafeRow) that can update itself based on a new input InternalRow for a fixed set of Expressions.
object GenerateUnsafeProjection extends CodeGenerator[Seq[Expression], UnsafeProjection]

Generates a Projection that returns an UnsafeRow.
Generates a Projection that returns an UnsafeRow.
It generates the code for all the expressions, compute the total length for all the columns (can be accessed via variables), and then copy the data into a scratch buffer space in the form of UnsafeRow (the scratch buffer will grow as needed).
Note: The returned UnsafeRow will be pointed to a scratch buffer inside the projection.
object GenerateUnsafeRowJoiner extends CodeGenerator[(StructType, StructType), UnsafeRowJoiner]

A code generator for concatenating two UnsafeRows into a single UnsafeRow.
A code generator for concatenating two UnsafeRows into a single UnsafeRow.
The high level algorithm is:
1. Concatenate the two bitsets together into a single one, taking padding into account. 2. Move fixed-length data. 3. Move variable-length data. 4. Update the offset position (i.e. the upper 32 bits in the fixed length part) for all variable-length data.
object LazilyGeneratedOrdering extends Serializable

package codegen

Type Members

abstract class BaseMutableProjection extends MutableProjection

class BaseOrdering extends Ordering[InternalRow]

abstract class BaseProjection extends Projection

class BufferHolder extends AnyRef

class CodeAndComment extends Serializable

abstract class CodeGenerator[InType <: AnyRef, OutType <: AnyRef] extends internal.Logging

class CodegenContext extends AnyRef

trait CodegenFallback extends Expression

case class ExprCode(code: String, isNull: String, value: String) extends Product with Serializable

abstract class GeneratedClass extends AnyRef

class LazilyGeneratedOrdering extends Ordering[InternalRow] with KryoSerializable

abstract class Predicate extends AnyRef

case class SubExprCodes(codes: Seq[String], states: Map[Expression, SubExprEliminationState]) extends Product with Serializable

case class SubExprEliminationState(isNull: String, value: String) extends Product with Serializable

class UnsafeArrayWriter extends AnyRef

abstract class UnsafeRowJoiner extends AnyRef

class UnsafeRowWriter extends AnyRef

Value Members

object CodeFormatter

object CodeGenerator extends internal.Logging

object DumpByteCode

object ExpressionCanonicalizer extends RuleExecutor[Expression]

object GenerateMutableProjection extends CodeGenerator[Seq[Expression], MutableProjection]

object GenerateOrdering extends CodeGenerator[Seq[SortOrder], Ordering[InternalRow]] with internal.Logging

object GeneratePredicate extends CodeGenerator[Expression, Predicate]

object GenerateSafeProjection extends CodeGenerator[Seq[Expression], Projection]

object GenerateUnsafeProjection extends CodeGenerator[Seq[Expression], UnsafeProjection]

object GenerateUnsafeRowJoiner extends CodeGenerator[(StructType, StructType), UnsafeRowJoiner]

object LazilyGeneratedOrdering extends Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped