This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from airflow import DAG | |
from config.current.agm import PARENT_DAG_NAME | |
from config.current.data_source import job_id_in_dbt_cloud | |
with DAG( | |
dag_id=PARENT_DAG_NAME, | |
... | |
) as dag: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from airflow.providers.dbt.cloud.operators.dbt import DbtCloudRunJobOperator | |
from airflow.hooks.base_hook import BaseHook | |
from config.current import DBT_CLOUD_CONNECTION_ID | |
class DBTCloudSensor: | |
def __init__(self): | |
self.dbt_cloud_connection = BaseHook.get_connection(DBT_CLOUD_CONNECTION_ID) | |
self.account_id = self.dbt_cloud_connection.extra_dejson.get('account_id') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
USE ROLE SYSADMIN; | |
CREATE DTABASE dp_governance; | |
CREATE SCHEMA dp_governance.tags; | |
CREATE SCHEMA dp_governance.masking_policies; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
USE ROLE TAG_ADMIN; | |
ALTER TAG dp_governance.tags.employee_sensitive | |
UNSET MASKING POLICY dp_governance.masking_policies.string_mask_employee, | |
MASKING POLICY dp_governance.masking_policies.float_mask_employee, | |
MASKING POLICY dp_governance.masking_policies.timestamp_mask_employee, | |
MASKING POLICY dp_governance.masking_policies.date_mask_employee, | |
MASKING POLICY dp_governance.masking_policies.number_mask_employee | |
; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
USE ROLE tag_admin; | |
ALTER TAG dp_governance.tags.customer_sensitive | |
UNSET MASKING POLICY dp_governance.masking_policies.string_mask_customer, | |
MASKING POLICY dp_governance.masking_policies.timestamp_mask_customer, | |
MASKING POLICY dp_governance.masking_policies.date_mask_customer | |
; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
USE ROLE TAG_ADMIN; | |
ALTER TAG dp_governance.tags.employee_sensitive | |
SET MASKING POLICY dp_governance.masking_policies.string_mask_employee, | |
MASKING POLICY dp_governance.masking_policies.float_mask_employee, | |
MASKING POLICY dp_governance.masking_policies.timestamp_mask_employee, | |
MASKING POLICY dp_governance.masking_policies.date_mask_employee, | |
MASKING POLICY dp_governance.masking_policies.number_mask_employee | |
; |
NewerOlder