An iterator that will keep generating iterators by invoking a given function and return a flattened iterator.
As the name suggests, the underlying iterator will be materialized on the first call to hasNext() or next().
A fast hash map implementation for nullable keys.
A fast hash map implementation for nullable keys. This hash map supports insertions and updates, but not deletions. This map is about as fast as any other hashmap, while using much less space overhead.
Under the hood, it uses the MultiColumnOpenHashSet implementation.
A simple, fast hash set optimized for non-null insertion-only use case, where keys are never removed.
A simple, fast hash set optimized for non-null insertion-only use case, where keys are never removed.
The underlying implementation uses Scala compiler's specialization to generate optimized storage for two primitive types (Long and Int). It is much faster than Java's standard HashSet while incurring much less memory overhead. This can serve as building blocks for higher level data structures such as an optimized HashMap.
This MultiColumnOpenHashSet is designed to serve as building blocks for higher level data structures such as an optimized hash map. Compared with standard hash set implementations, this class provides its various callbacks interfaces (e.g. allocateFunc, moveFunc) and interfaces to retrieve the position of a key in the underlying array.
It uses quadratic probing with a power-of-2 hash table size, which is guaranteed to explore all spaces for each key (see http://en.wikipedia.org/wiki/Quadratic_probing).
A Row
implementation that can be reused
(much like SpecificMutableRow
for InternalRow
)
Wraps an InternalRow
to expose a Row
An iterator that will keep generating iterators by invoking a given function and return a flattened iterator. Typically useful to generate an iterator on top of an arbitrary source where source size or structure is not pre-determined (e.g. source may not have flatMap/fold or such methods).
Use the GenerateFlatIterator.TERMINATE token to indicate end of iteration.