org.apache.spark.sql.execution.streaming.HDFSMetadataLog
Create path, or throw exception if it already exists
Recursively delete a path if it exists.
Recursively delete a path if it exists. Should not throw exception if file doesn't exist.
Whether path exists
Whether the file systme is a local FS.
List the files in a path that matches a filter.
Make directory at the give path and all its parent directories as needed.
Open a file for reading, or throw exception if it does not exist.
Atomically rename path, or throw exception if it cannot be done.
Atomically rename path, or throw exception if it cannot be done. Should throw FileNotFoundException if srcPath does not exist. Should throw FileAlreadyExistsException if destPath already exists.
A simple trait to abstract out the file management operations needed by HDFSMetadataLog.