Skip to main content

Databricks

Connect to Databricks.

Configuration​

The following values are needed to connect to BigQuery:

  • Access Token: Access token for Databricks.
  • Server Host Name The server host name for your Databricks cluster.
  • Http Path: The path to your dataset.
  • Schema Name: Schema name (optional, "default" if not provided).

Details about generating the Databricks access token can be found here.

Datasets​

By default, each table in the schema will be automatically indexed as a dataset within Predibase.

Connection Query Template​

CREATE CONNECTION IF NOT EXISTS databricks_connection
    connection_type = DATABRICKS
    access_token = '<my-token>'
    server_host_name = '<instance-name>.cloud.databricks.com'
    http_path = '/<path-to-dataset>'