The Definitive Guide to Building Data Products

https://www.synq.io/guide/

Admin

A practical guide for data professionals to design, build, deploy, and operate reliable analytical...

Tokens:72,079

Snippets:571

Trust Score:7.6

Update:8 months ago

Show doc for...

Tokens:

Raw

### Define dbt Group Ownership and Model Access

Source: https://www.synq.io/guide/2-setting-expectations

This example shows how to define dbt groups and assign owners to them, specifying contact information like email and Slack. It also illustrates how to assign models to specific groups and control their access, making them private to group members.

```yaml
models/marts/finance/finance.yml

groups:
  - name: finance
    owner:
      # 'name' or 'email' is required; additional properties allowed
      email: finance@acme.com
      slack: finance-data
      github: finance-data-team
models/schema.yml

models:
  - name: finance_private_model
    access: private
    config:
      group: finance

  # in a different group!
  - name: marketing_model
    config:
      group: marketing
```

--------------------------------

### Example dbt Model: stg_latest_issues

Source: https://www.synq.io/guide/2-setting-expectations

This dbt model selects the latest issue records from an upstream model, ordered by ingestion time. It demonstrates a common pattern in data transformation where specific records are filtered or selected based on certain criteria.

```sql
select
  id,
  workspace,
  ...
from
  {{ ref('stg_issues') }}
order by
  ingested_at
limit
  1 by id
```

--------------------------------

### Define a Data Product in dbt YAML

Source: https://www.synq.io/guide/2-setting-expectations

This YAML configuration defines a data product named 'marketing_attribution' within a dbt project. It includes a detailed description, owner information with a Slack channel, priority level, and a list of associated assets. This structure helps in organizing and managing data products effectively.

```yaml
version: 2

data_products:
  - name: marketing_attribution
    description: >
      This data product includes models for tracking marketing attribution 
      across various channels. It powers the Marketing Attribution Dashboard 
      and is critical for assessing campaign performance and optimizing 
      marketing spend.
    owner:
      name: marketing_data_team
      slack_channel: "#marketing-data-team"
    priority: P1
    assets:
      - name: dim_marketing_campaigns
      - name: fct_channel_performance
      - name: fct_attribution_model
```

Tokens:

Raw