org.apache.spark.sql.catalyst.catalog
Alter one or many table partitions whose specs that match those specified in parts
,
assuming the partitions exist.
Alter one or many table partitions whose specs that match those specified in parts
,
assuming the partitions exist.
If no database is specified, assume the table is in the current database.
Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.
Alter the metadata of an existing metastore table identified by tableDefinition
.
Alter the metadata of an existing metastore table identified by tableDefinition
.
If no database is specified in tableDefinition
, assume the table is in the
current database.
Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.
Alter the definition of a local/global temp view matching the given name, returns true if a temp view is matched and altered, false otherwise.
Drop all existing temporary tables.
Drop all existing temporary tables. For testing only.
Create a metastore function in the database specified in funcDefinition
.
Create a metastore function in the database specified in funcDefinition
.
If no such database is specified, create it in the current database.
Create a global temporary view.
Create partitions in an existing table, assuming it exists.
Create partitions in an existing table, assuming it exists. If no database is specified, assume the table is in the current database.
Create a metastore table in the database specified in tableDefinition
.
Create a metastore table in the database specified in tableDefinition
.
If no such database is specified, create it in the current database.
Create a temporary function.
Create a temporary function.
This assumes no database is specified in funcDefinition
.
Create a local temporary view.
Drop a metastore function.
Drop a metastore function. If no database is specified, assume the function is in the current database.
Drop a global temporary view.
Drop a global temporary view.
Returns true if this view is dropped successfully, false otherwise.
Drop partitions from a table, assuming they exist.
Drop partitions from a table, assuming they exist. If no database is specified, assume the table is in the current database.
Drop a table.
Drop a table.
If a database is specified in name
, this will drop the table from that database.
If no database is specified, this will first attempt to drop a temporary table with
the same name, then, if that does not exist, drop the table from the current database.
Drop a temporary function.
Drop a local temporary view.
Drop a local temporary view.
Returns true if this view is dropped successfully, false otherwise.
Format database name, taking into account case sensitivity.
Format database name, taking into account case sensitivity.
Format table name, taking into account case sensitivity.
Format table name, taking into account case sensitivity.
Check if the specified function exists.
Get the path for creating a non-default database when database location is not provided by users.
Retrieve the metadata of a metastore function.
Retrieve the metadata of a metastore function.
If a database is specified in name
, this will return the function in that database.
If no database is specified, this will return the function in the current database.
Return a global temporary view exactly as it was stored.
Retrieve the metadata of a table partition, assuming it exists.
Retrieve the metadata of a table partition, assuming it exists. If no database is specified, assume the table is in the current database.
Retrieve the metadata of an existing permanent table/view.
Retrieve the metadata of an existing permanent table/view. If no database is specified, assume the table/view is in the current database. If the specified table/view is not found in the database then a NoSuchTableException is thrown.
Retrieve the metadata of an existing metastore table.
Retrieve the metadata of an existing metastore table. If no database is specified, assume the table is in the current database. If the specified table is not found in the database then return None if it doesn't exist.
Return a local temporary view exactly as it was stored.
Retrieve the metadata of an existing temporary view or permanent table/view.
Retrieve the metadata of an existing temporary view or permanent table/view.
If a database is specified in name
, this will return the metadata of table/view in that
database.
If no database is specified, this will first attempt to get the metadata of a temporary view
with the same name, then, if that does not exist, return the metadata of table/view in the
current database.
Returns whether it is a temporary function.
Returns whether it is a temporary function. If not existed, returns false.
Return whether a table with the specified name is a temporary table.
Return whether a table with the specified name is a temporary table.
Note: The temporary table cache is checked only when database is not explicitly specified.
List all matching functions in the specified database, including temporary functions.
List all matching functions in the specified database, including temporary functions. This returns the function identifier and the scope in which it was defined (system or user defined).
List all functions in the specified database, including temporary functions.
List all functions in the specified database, including temporary functions. This returns the function identifier and the scope in which it was defined (system or user defined).
List the names of all partitions that belong to the specified table, assuming it exists.
List the names of all partitions that belong to the specified table, assuming it exists.
A partial partition spec may optionally be provided to filter the partitions returned. For instance, if there exist partitions (a='1', b='2'), (a='1', b='3') and (a='2', b='4'), then a partial spec of (a='1') will return the first two only.
List the metadata of all partitions that belong to the specified table, assuming it exists.
List the metadata of all partitions that belong to the specified table, assuming it exists.
A partial partition spec may optionally be provided to filter the partitions returned. For instance, if there exist partitions (a='1', b='2'), (a='1', b='3') and (a='2', b='4'), then a partial spec of (a='1') will return the first two only.
List the metadata of partitions that belong to the specified table, assuming it exists, that satisfy the given partition-pruning predicate expressions.
List all matching tables in the specified database, including local temporary tables.
List all matching tables in the specified database, including local temporary tables.
Note that, if the specified database is global temporary view database, we will list global temporary views.
List all tables in the specified database, including local temporary tables.
List all tables in the specified database, including local temporary tables.
Note that, if the specified database is global temporary view database, we will list global temporary views.
Loads resources such as JARs and Files for a function.
Loads resources such as JARs and Files for a function. Every resource is represented by a tuple (resource type, resource uri).
Load files stored in given path into the partition of an existing metastore table.
Load files stored in given path into the partition of an existing metastore table. If no database is specified, assume the table is in the current database. If the specified table is not found in the database then a NoSuchTableException is thrown.
Load files stored in given path into an existing metastore table.
Load files stored in given path into an existing metastore table. If no database is specified, assume the table is in the current database. If the specified table is not found in the database then a NoSuchTableException is thrown.
Return an Expression that represents the specified function, assuming it exists.
Return an Expression that represents the specified function, assuming it exists.
For a temporary function or a permanent function that has been loaded, this method will simply lookup the function through the FunctionRegistry and create an expression based on the builder.
For a permanent function that has not been loaded, we will first fetch its metadata
from the underlying external catalog. Then, we will load all resources associated
with this function (i.e. jars and files). Finally, we create a function builder
based on the function class and put the builder into the FunctionRegistry.
The name of this function in the FunctionRegistry will be databaseName.functionName
.
Look up the ExpressionInfo associated with the specified function, assuming it exists.
Return a LogicalPlan that represents the given table or view.
Return a LogicalPlan that represents the given table or view.
If a database is specified in name
, this will return the table/view from that database.
If no database is specified, this will first attempt to return a temporary table/view with
the same name, then, if that does not exist, return the table/view from the current database.
Note that, the global temp view database is also valid here, this will return the global temp view matching the given name.
If the relation is a view, the relation will be wrapped in a SubqueryAlias which will track the name of the view.
Construct a FunctionBuilder based on the provided class that represents a function.
Construct a FunctionBuilder based on the provided class that represents a function.
This performs reflection to decide what type of Expression to return in the builder.
Refresh the cache entry for a metastore table, if any.
Override the specs of one or many existing table partitions, assuming they exist.
Override the specs of one or many existing table partitions, assuming they exist.
This assumes index i of specs
corresponds to index i of newSpecs
.
If no database is specified, assume the table is in the current database.
Rename a table.
Rename a table.
If a database is specified in oldName
, this will rename the table in that database.
If no database is specified, this will first attempt to rename a temporary table with
the same name, then, if that does not exist, rename the table in the current database.
This assumes the database specified in newName
matches the one in oldName
.
Drop all existing databases (except "default"), tables, partitions and functions, and set the current database to "default".
Drop all existing databases (except "default"), tables, partitions and functions, and set the current database to "default".
This is mainly used for tests.
Return whether a table/view with the specified name exists.
Return whether a table/view with the specified name exists. If no database is specified, check with current database.
List of temporary tables, mapping from table name to their logical plan.
List of temporary tables, mapping from table name to their logical plan.
An internal catalog that is used by a Spark Session. This internal catalog serves as a proxy to the underlying metastore (e.g. Hive Metastore) and it also manages temporary tables and functions of the Spark Session that it belongs to.
This class must be thread-safe.