This method is called for each streaming batch after checking the possibility of batch
duplication which is indicated by possibleDuplicate
flag.
This method is called for each streaming batch after checking the possibility of batch
duplication which is indicated by possibleDuplicate
flag.
A duplicate batch might be picked up for processing in case of failure. In case of batch duplication, this method should handle batch in idempotent manner in order to avoid data inconsistency.