SnappyHiveExternalCatalog

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. def alterDatabase(schemaDefinition: CatalogDatabase): Unit

   

   Alter a database whose name matches the one specified in dbDefinition, assuming the database exists.

   Alter a database whose name matches the one specified in dbDefinition, assuming the database exists.

   Note: As of now, this only supports altering database properties!

   Definition Classes

   SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

5. def alterPartitions(schema: String, table: String, parts: Seq[CatalogTablePartition]): Unit

   

   Alter one or many table partitions whose specs that match those specified in parts, assuming the partitions exist.

   Alter one or many table partitions whose specs that match those specified in parts, assuming the partitions exist.

   Note: If the underlying implementation does not support altering a certain field, this becomes a no-op.

   Definition Classes

   SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

6. def alterTable(tableDefinition: CatalogTable): Unit

   

   Alter a table whose name that matches the one specified in tableDefinition, assuming the table exists.

   Alter a table whose name that matches the one specified in tableDefinition, assuming the table exists.

   Note: As of now, this doesn't support altering table schema, partition column names and bucket specification. We will ignore them even if users do specify different values for these fields.

   Definition Classes

   SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

7. def alterTableSchema(schemaName: String, table: String, schema: StructType): Unit

   

   Alter the schema of a table identified by the provided database and table name.

   Alter the schema of a table identified by the provided database and table name. The new schema should still contain the existing bucket columns and partition columns used by the table. This method will also update any Spark SQL-related parameters stored as Hive table properties (such as the schema itself).

   table

   Name of table to alter schema for

   schema

   Updated schema to be used for the table (must contain existing partition and bucket columns)

   Definition Classes

   SnappyExternalCatalog → ExternalCatalog

8. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

9. val cachedCatalogTables: LoadingCache[(String, String), CatalogTable]

   

   A cache of Spark SQL data source tables that have been accessed.

   A cache of Spark SQL data source tables that have been accessed.

   Attributes

   protected

10. def client(): HiveClient

    

    A Hive client used to interact with the metastore.

    A Hive client used to interact with the metastore.

    Definition Classes

    SnappyHiveCatalogBase → HiveExternalCatalog

11. def clone(): AnyRef

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

12. def close(): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → SnappyExternalCatalog

13. val conf: SparkConf

    

14. def createDatabase(schemaDefinition: CatalogDatabase, ignoreIfExists: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

15. def createFunction(schema: String, funcDefinition: CatalogFunction): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

16. def createPartitions(schema: String, table: String, parts: Seq[CatalogTablePartition], ignoreIfExists: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

17. def createPolicy(schemaName: String, policyName: String, targetTable: String, policyFor: String, policyApplyTo: Seq[String], expandedPolicyApplyTo: Seq[String], owner: String, filterString: String): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → SnappyExternalCatalog

18. def createTable(tableDefinition: CatalogTable, ignoreIfExists: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

19. val createTime: Long

    

20. def databaseExists(schema: String): Boolean

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

21. def dropDatabase(schema: String, ignoreIfNotExists: Boolean, cascade: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

22. def dropFunction(schema: String, name: String): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

23. def dropPartitions(schema: String, table: String, parts: Seq[TablePartitionSpec], ignoreIfNotExists: Boolean, purge: Boolean, retainData: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

24. def dropTable(schema: String, table: String, ignoreIfNotExists: Boolean, purge: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

25. def dropTableUnsafe(schema: String, table: String, forceDrop: Boolean): Unit

    

26. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

27. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

28. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

29. def finalizeCatalogTable(table: CatalogTable): CatalogTable

    

    Transform given CatalogTable to final form filling in viewText and other fields using the properties if required.

    Transform given CatalogTable to final form filling in viewText and other fields using the properties if required.

    Attributes

    protected

30. def functionExists(schema: String, funcName: String): Boolean

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

31. def getAllTables(skipSchemas: Seq[String] = SYS_SCHEMA :: Nil): Seq[CatalogTable]

    

    Get all the tables in the catalog skipping given schema names.

    Get all the tables in the catalog skipping given schema names. By default the inbuilt SYS schema is skipped.

    Definition Classes

    SnappyExternalCatalog

32. def getBaseTable(tableDefinition: CatalogTable): Option[String]

    

    Check for baseTable in both properties and storage.properties (older releases used a mix).

    Check for baseTable in both properties and storage.properties (older releases used a mix).

    Definition Classes

    SnappyExternalCatalog

33. def getCachedCatalogTable(schema: String, table: String): CatalogTable

    

    Attributes

    protected

    Definition Classes

    SnappyHiveExternalCatalog → SnappyExternalCatalog

34. def getCatalogSchemaVersion: Long

    

35. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

36. def getDatabase(schema: String): CatalogDatabase

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

37. def getDependents(schema: String, table: String, catalogTable: CatalogTable, includeTypes: Seq[Type], excludeTypes: Seq[Type]): Seq[CatalogTable]

    

    Get all the dependent objects for a given catalog object.

    Get all the dependent objects for a given catalog object.

    Definition Classes

    SnappyExternalCatalog

38. def getDependentsFromProperties(schema: String, properties: Map[String, String], includeTypes: Seq[Type], excludeTypes: Seq[Type]): Seq[CatalogTable]

    

    Attributes

    protected

    Definition Classes

    SnappyExternalCatalog

39. def getDependentsFromProperties(schema: String, table: String, includeTypes: Seq[Type] = Nil, excludeTypes: Seq[Type] = Nil): Seq[CatalogTable]

    

    Get all the dependent objects for a given catalog object.

    Get all the dependent objects for a given catalog object. Note that this does not check for older releases that may lack appropriate catalog entries for dependent relations. Use getDependents for cases where that might be possible.

    Definition Classes

    SnappyExternalCatalog

40. def getFunction(schema: String, funcName: String): CatalogFunction

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

41. def getPartition(schema: String, table: String, spec: TablePartitionSpec): CatalogTablePartition

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

42. def getPartitionOption(schema: String, table: String, spec: TablePartitionSpec): Option[CatalogTablePartition]

    

    Returns the specified partition or None if it does not exist.

    Returns the specified partition or None if it does not exist.

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

43. def getPolicies(schema: String, table: String, properties: Map[String, String]): Seq[CatalogTable]

    

    Get the list of policies defined for a given table

    Get the list of policies defined for a given table

    schema

    schema name of the table

    table

    name of the table

    properties

    CatalogTable.properties for the table

    returns

    list of policy CatalogTables

    Definition Classes

    SnappyExternalCatalog

44. def getRelationInfo(schema: String, table: String, rowTable: Boolean): (RelationInfo, Option[LocalRegion])

    

    Get RelationInfo for given table with underlying region in embedded mode.

    Get RelationInfo for given table with underlying region in embedded mode.

    Definition Classes

    SnappyHiveExternalCatalog → SnappyExternalCatalog

45. def getTable(schema: String, table: String): CatalogTable

    

    Definition Classes

    SnappyExternalCatalog → ExternalCatalog

46. def getTableOption(schema: String, table: String): Option[CatalogTable]

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

47. def getTableWithBaseTable(table: CatalogTable): Seq[(String, String)]

    

    Attributes

    protected

    Definition Classes

    SnappyExternalCatalog

48. val hadoopConf: Configuration

    

49. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

50. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean = false): Boolean

    

    Attributes

    protected

    Definition Classes

    Logging

51. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

52. def invalidate(name: (String, String)): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → SnappyExternalCatalog

53. def invalidateAll(): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → SnappyExternalCatalog

54. def invalidateCaches(relations: Seq[(String, String)]): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → SnappyExternalCatalog

55. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

56. def isTraceEnabled(): Boolean

    

    Attributes

    protected

    Definition Classes

    Logging

57. def listDatabases(pattern: String): Seq[String]

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

58. def listDatabases(): Seq[String]

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

59. def listFunctions(schema: String, pattern: String): Seq[String]

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

60. def listPartitionNames(schema: String, table: String, partialSpec: Option[TablePartitionSpec]): Seq[String]

    

    Returns the partition names from hive metastore for a given table in a database.

    Returns the partition names from hive metastore for a given table in a database.

    table

    table name

    partialSpec

    partition spec

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

61. def listPartitions(schema: String, table: String, partialSpec: Option[TablePartitionSpec] = None): Seq[CatalogTablePartition]

    

    Returns the partitions from hive metastore for a given table in a database.

    Returns the partitions from hive metastore for a given table in a database.

    table

    table name

    partialSpec

    partition spec

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

62. def listPartitionsByFilter(schema: String, table: String, predicates: Seq[Expression]): Seq[CatalogTablePartition]

    

    List the metadata of partitions that belong to the specified table, assuming it exists, that satisfy the given partition-pruning predicate expressions.

    List the metadata of partitions that belong to the specified table, assuming it exists, that satisfy the given partition-pruning predicate expressions.

    table

    table name

    predicates

    partition-pruning predicates

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

63. def listTables(schema: String, pattern: String): Seq[String]

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

64. def listTables(schema: String): Seq[String]

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

65. def loadDynamicPartitions(schema: String, table: String, loadPath: String, partition: TablePartitionSpec, replace: Boolean, numDP: Int, holdDDLTime: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

66. def loadPartition(schema: String, table: String, loadPath: String, partition: TablePartitionSpec, isOverwrite: Boolean, holdDDLTime: Boolean, inheritTableSpecs: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

67. def loadTable(schema: String, table: String, loadPath: String, isOverwrite: Boolean, holdDDLTime: Boolean): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

68. def log: Logger

    

    Attributes

    protected

    Definition Classes

    Logging

69. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

70. def logDebug(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

71. def logError(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

72. def logError(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

73. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

74. def logInfo(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

75. def logName: String

    

    Attributes

    protected

    Definition Classes

    Logging

76. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

77. def logTrace(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

78. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

79. def logWarning(msg: ⇒ String): Unit

    

    Attributes

    protected

    Definition Classes

    Logging

80. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

81. val nonExistentTables: Cache[(String, String), Boolean]

    

    A cache of SQL data source tables that are missing in catalog.

    A cache of SQL data source tables that are missing in catalog.

    Attributes

    protected

82. final def notify(): Unit

    

    Definition Classes

    AnyRef

83. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

84. def refreshPolicies(ldapGroup: String): Unit

    

85. def registerCatalogSchemaChange(relations: Seq[(String, String)]): Unit

    

86. def renameFunction(schema: String, oldName: String, newName: String): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

87. def renamePartitions(schema: String, table: String, specs: Seq[TablePartitionSpec], newSpecs: Seq[TablePartitionSpec]): Unit

    

    Override the specs of one or many existing table partitions, assuming they exist.

    Override the specs of one or many existing table partitions, assuming they exist. This assumes index i of specs corresponds to index i of newSpecs.

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

88. def renameTable(schemaName: String, oldName: String, newName: String): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

89. def requireDbExists(schema: String): Unit

    

    Definition Classes

    SnappyExternalCatalog → ExternalCatalog

90. def requireFunctionExists(schema: String, funcName: String): Unit

    

    Attributes

    protected

    Definition Classes

    SnappyExternalCatalog → ExternalCatalog

91. def requireFunctionNotExists(schema: String, funcName: String): Unit

    

    Attributes

    protected

    Definition Classes

    SnappyExternalCatalog → ExternalCatalog

92. def requireTableExists(schema: String, table: String): Unit

    

    Definition Classes

    SnappyExternalCatalog → ExternalCatalog

93. def setCurrentDatabase(schema: String): Unit

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

94. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

95. def systemSchemaDefinition: CatalogDatabase

    

    Definition Classes

    SnappyExternalCatalog

96. def tableExists(schema: String, table: String): Boolean

    

    Definition Classes

    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog

97. def toString(): String

    

    Definition Classes

    AnyRef → Any

98. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

99. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

100. final def wait(arg0: Long): Unit

     

     Definition Classes

     AnyRef

     Annotations

     @throws( ... )