Base trait for a versioned key-value store used for streaming aggregations
Reference to a StateStoreCoordinator that can be used to coordinate instances of StateStores across all the executors, and get their locations for job scheduling.
Unique identifier for a StateStore
Trait representing a provider of a specific version of a StateStore.
An RDD that allows computations to be executed against StateStores.
An RDD that allows computations to be executed against StateStores. It uses the StateStoreCoordinator to get the locations of loaded state stores and use that as the preferred locations.
Trait representing updates made to a StateStore.
Companion object to StateStore that provides helper methods to create and retrieve stores by their unique ids.
Companion object to StateStore that provides helper methods to create and retrieve stores by their unique ids. In addition, when a SparkContext is active (i.e. SparkEnv.get is not null), it also runs a periodic background task to do maintenance on the loaded stores. For each store, it uses the StateStoreCoordinator to ensure whether the current loaded instance of the store is the active instance. Accordingly, it either keeps it loaded and performs maintenance, or unloads the store.
Helper object used to create reference to StateStoreCoordinator.