aligned.sources.databricks.DatabricksConnectionConfig

class documentation

class DatabricksConnectionConfig: (source)

Constructors: DatabricksConnectionConfig.databricks_or_serverless(host, token), DatabricksConnectionConfig.serverless(host, token), DatabricksConnectionConfig.with_cluster_id(cluster_id, host), DatabricksConnectionConfig(host, cluster_id, token, azure_client_id, ...)

View In Hierarchy

Undocumented

Static Method databricks_or_serverless Undocumented
Static Method serverless Undocumented
Static Method with_cluster_id Undocumented
Method __init__ Undocumented
Method catalog Undocumented
Method connection Undocumented
Method sql Creates a SQL query source by running the defined query.
Method sql_file Creates a SQL query source by reading the file.
Method storage_provider Undocumented
Method with_auth Undocumented
Instance Variable azure_client_id Undocumented
Instance Variable azure_client_secret Undocumented
Instance Variable azure_tenant_id Undocumented
Instance Variable cluster_id Undocumented
Instance Variable host Undocumented
Instance Variable token Undocumented
def databricks_or_serverless(host: str | ConfigValue | None = None, token: str | ConfigValue | None = None) -> DatabricksConnectionConfig: (source)

Undocumented

def serverless(host: str | ConfigValue | None = None, token: str | ConfigValue | None = None) -> DatabricksConnectionConfig: (source)

Undocumented

def with_cluster_id(cluster_id: str | ConfigValue, host: str | ConfigValue) -> DatabricksConnectionConfig: (source)

Undocumented

def __init__(self, host: str | ConfigValue, cluster_id: str | ConfigValue | None, token: str | ConfigValue | None, azure_client_id: ConfigValue | None = None, azure_client_secret: ConfigValue | None = None, azure_tenant_id: ConfigValue | None = None): (source)

Undocumented

def catalog(self, catalog: str | ConfigValue) -> UnityCatalog: (source)

Undocumented

def connection(self) -> SparkSession: (source)

Undocumented

def sql(self, query: str) -> UCSqlSource: (source)

Creates a SQL query source by running the defined query.

def sql_file(self, file: str | Path, format_values: dict[str, str] | None = None) -> UCSqlSource: (source)

Creates a SQL query source by reading the file.

def storage_provider(self) -> pl.CredentialProvider | None: (source)

Undocumented

def with_auth(self, token: str | ConfigValue, host: str | ConfigValue) -> DatabricksConnectionConfig: (source)

Undocumented

azure_client_id: ConfigValue | None = (source)

Undocumented

azure_client_secret: ConfigValue | None = (source)

Undocumented

azure_tenant_id: ConfigValue | None = (source)

Undocumented

cluster_id: ConfigValue | None = (source)

Undocumented

host: ConfigValue = (source)

Undocumented

token: ConfigValue | None = (source)

Undocumented