dbt Core

Euno's dbt Core integration supports auto-discovery of:

• Transformation layer resources:

  • dbt sources

  • dbt seeds

  • dbt models

  • dbt columns

• Semantic layer resources:

  • dbt metrics

  • dbt measures

  • dbt dimensions

  • dbt entities

Setting up Euno's dbt Core Integration

Step 1: Configure New dbt Core Source in Euno

Step 1: Access the Sources Page

1. Navigate to the Sources page in the Euno application.

2. Click on the Add New Source button.

Step 2: General Configuration

1. Name: Enter a name for your dbt Core source (e.g., "dbt - Marketing Models").

2. Configuration Details:

   1. Build target: The default build target to use when observing dbt resources. Consult the table below depending on the warehouse technology your dbt is run against.

Snowflake

The build target should follow the pattern: <account_id>.<region>.<cloud provide>.snowflakecomputing.com

For example:

• foo-1234.us-east-1.aws.snowflakecomputing.com

• bar-5678.us-west-2.gcp.snowflakecomputing.com

Trino

The build target should follow the pattern trino.<region>.<gcloud provider>

For example:

• trino.us-west-2.aws

• trino.us-east-2.gcp

Databricks

The build target should be the hostname of the databrick workspace

For example:

• 4200747832468935.5.gcp.databricks.com

• dbc-50e7cad0-c2f9.cloud.databricks.com

• adb-5555555555555555.19.azuredatabricks.net

Bigquery

The build target should just say bigquery

Step 3: Advanced Settings (Optional)

Click on the 'Advanced' section to display these additional configurations.

1. Source Repository URL: The URL of the git repository where the dbt project is stored.

2. Source Repository branch: The branch of the git repository where the dbt project is stored.

3. Relative directory of the dbt project: The subdirectory within the git repository where the dbt project is stored.

4. Mapping - Used to map your schema aliases:

   1. Source

   2. Target

Step 4: Save Configuration

Click the Save button, and Euno will generate an integration key. Please copy the integration key and save it somewhere, as the key will disappear after copying.

Step 5: Add the Integration Key

Take the copied integration key and add it to the configuration of the application or webhook that will send the dbt artifacts to Euno. This ensures that the application or webhook can authenticate and securely transmit the artifacts to Euno. Step 6: Upload dbt artifacts to euno

Click "run", and euno will provide an endpoint to upload the artifacts into, which you will use the secret key from Step 4, as a header, see code section below for the full upload script. Files to zip from your dbt build are:

• run_results.json

• manifest.json

• semantic_manifest.json

• catalog.json

The script assumes your zip is named "euno_dbt_artifacts.zip" is is under the current working directory, you can change that in the code itself if you choose to use a different name.

dbt Core Source: Click "Run"

dbt Core Source: Run URL

import requests
import os


base_url = "https://api.app.getdelphi.io"

# Endpoint URL - replace with endpoint link from the integration itself 
endpoint_url = base_url + "/accounts/{account_id}/integrations/{integration_id}/run"

# Headers with authorization token
token = "your_token_here"  # Replace this with your actual token
headers = {
    "authorization": f"Bearer {token}"
}

# Zip your 
# File path to upload (current working directory)
file_name = "euno_dbt_artifacts.zip"
file_path = os.path.join(os.getcwd(), file_name)

# Sending the POST request
try:
    files = [('files', ('euno_dbt_artifacts.zip', open(file_path, 'rb'), 'application/zip'))]

    response = requests.post(
        url=endpoint_url,
        headers=headers,
        files=files
    )


    # Checking the response
    if response.status_code == 200:
        print("File uploaded successfully!")
        print("Response:", response.json())
    else:
        print("Failed to upload file.")
        print("Status Code:", response.status_code)
        print("Response:", response.text)
except FileNotFoundError:
    print(f"Error: The file at {file_path} was not found.")
except Exception as e:
    print("An error occurred:", e)