This method is called for each streaming batch after checking the possibility of batch
duplication which is indicated by possibleDuplicate
flag.
This method is called for each streaming batch after checking the possibility of batch
duplication which is indicated by possibleDuplicate
flag.
A duplicate batch might be picked up for processing in case of failure. In case of batch duplication, this method should handle batch in idempotent manner in order to avoid data inconsistency.
Should be implemented by clients who wants to override default behavior provided by DefaultSnappySinkCallback.
In order to override the default callback behavior the qualified name of the implementing class needs to be passed against
sinkCallback
option while defining stream query.