Skip to content

Consolidate source + remove tests#41

Merged
fivetran-joemarkiewicz merged 9 commits into
mainfrom
MagicBot/consolidate-source-package
Aug 18, 2025
Merged

Consolidate source + remove tests#41
fivetran-joemarkiewicz merged 9 commits into
mainfrom
MagicBot/consolidate-source-package

Conversation

@fivetran-data-model-bot
Copy link
Copy Markdown
Contributor

@fivetran-data-model-bot fivetran-data-model-bot commented Aug 13, 2025

Summary

This PR is to combine the source and transform packages and remove tests not compatible with dbt Fusion 1.10.6+.

Please check the below automated updates were successful:

MANUAL UPDATES

  • If applicable, merge in the Q2 FY26 Automatic Package Updates PR.
  • If there are 2 docs.md files, consolidate the definitions the file in the main folder and remove the 2nd file.
  • Scan the README for non-standard references to the source package and remove or update.
  • Copy the passthrough vars or other non-standard vars from the source dbt_project.yml to the transform dbt_project.yml.
  • Check BK run logs for at least 2 warehouses
    • No further deprecation warnings
    • No union data "table not found" type warnings
  • Make sure below automatic updates were applied correctly.

Source + Transform Consolidation

  • Moved models/macros to models/staging/ and macros/staging/.
  • Updated all var('') references within models to use ref('stg_snapchat_ads__').
  • Updated vars in dbt_project.yml from refs to sources.
  • Removed the source package from packages.yml.
  • Major version bump to v1.0.0 (or higher if applicable)

dbt Fusion Compatibility

  • Removed dbt_utils.unique_combination_of_columns test
  • Accepted values tests were removed where applicable (Shopify, NetSuite, QuickBooks).

YAML & Config Updates

  • Moved loaded_at_field under config: in src.yml, grouped with freshness
  • Added +schema and +materialization for the staging models in dbt_project.yml.

README

  • Removed references to the source package in:
    • Overview
    • Installation instructions
    • Dependencies list
    • Schema override examples

@fivetran-data-model-bot fivetran-data-model-bot added the next-release Include in the next release. label Aug 13, 2025
* Q2 FY26: Apply automated update.

* Q2 FY26: Update auto-release workflow only.

* Update CHANGELOG.md

---------

Co-authored-by: fivetran-catfritz <111930712+fivetran-catfritz@users.noreply.github.com>
Co-authored-by: Joe Markiewicz <74217849+fivetran-joemarkiewicz@users.noreply.github.com>
@fivetran-joemarkiewicz fivetran-joemarkiewicz added the docs:ready Triggers the docs generator workflow. label Aug 13, 2025
Copy link
Copy Markdown
Contributor

@fivetran-avinash fivetran-avinash left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-joemarkiewicz Approved with a few requests (I think Buildkite was passing the staging models as tables already which was why I didn't hold off on approving, but the update should still be made).

Comment thread dbt_project.yml
Comment thread CHANGELOG.md Outdated
Comment thread README.md Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Comment thread models/staging/src_snapchat.yml Outdated
Co-authored-by: Avinash Kunnath <108772760+fivetran-avinash@users.noreply.github.com>
@fivetran-joemarkiewicz fivetran-joemarkiewicz added docs:ready Triggers the docs generator workflow. and removed docs:ready Triggers the docs generator workflow. labels Aug 14, 2025
@fivetran-joemarkiewicz fivetran-joemarkiewicz merged commit 36ed72e into main Aug 18, 2025
9 checks passed
@fivetran-joemarkiewicz fivetran-joemarkiewicz deleted the MagicBot/consolidate-source-package branch August 18, 2025 13:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs:ready Triggers the docs generator workflow. next-release Include in the next release.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Deprecation] Update package for dbt Fusion and dbt Core 1.10.6 compatibility

4 participants