All Questions
Tagged with snowflake-cloud-data-platform dbt
265
questions
0
votes
2
answers
51
views
DBT Duplicate row detected during DML action - Snowflake
Creating an incremental model using the MERGE strategy with a unique key. The unique key to merge on is a surrogate key of columns from the table.
When I run this incremental model I get the error: ...
- 21
1
vote
1
answer
61
views
Create a Sql Statement IN DBT macro and use the query in the dbt model
my_macro.sql
{macro my_macro(value)}
{% set query %}
select A from value
{{ return(query) }}
{% endset %}
{% endmacro %}
model.sql
select * from B
where A in ({{ my_macro(value) }}
when i ...
- 13
0
votes
0
answers
53
views
Snowflake Dynamic Tables dbt core
I am having trouble refreshing Dynamic Tables in Snowflake using dbt core .
My dbt core versions are as follows
Core:
installed: 1.8.3
snowflake: 1.8.3 - Up to date!
This is my dbt_project.yml
...
- 29
0
votes
0
answers
67
views
UDF in Snowpark + DBT gives ModuleNotFoundError with group_by().apply_in_pandas()
I am using snowpark and DBT to do some data transformations and creating some views/table in Snowflake. My models have a structure like this one:
import pandas as pd
from snowflake.snowpark import ...
0
votes
1
answer
49
views
"dbt constraints" package is not accepting conditional arguments
When running DBT, my configuration in dbt_project.yml doesn't work for "dbt_constraints" package correctly. Based on the documentation given by "dbt_constraints" package ...
- 33
0
votes
0
answers
35
views
Snowflake connection unstable for DBT jobs run on GH Action runners
I have a DBT installation(core) running on Github(GH) Action runners, triggered every 4 hours that refreshes about 100+ models.
Jobs used to complete successfully without any error. However, after ...
- 1,213
0
votes
1
answer
91
views
How to replace strings in a column if exist in a list with dbt jinja?
I'm new to writing sql with jinja in dbt. I have created this variable for example:
{% set html_tags = [
'<td>',
'</td>',
' ',
'<td style="background-color:...
- 3
2
votes
2
answers
71
views
Return specific column from Snowflake `show tables` command
I am trying to return column: cluster_by using a snowflake query as below with a dbt macro.
The macro will be used to infer if a model (and correct target relation) has a clustering property.
I have ...
- 23
0
votes
1
answer
77
views
Integrating AWS MWAA, dbt-core, astronomer-cosmos
I am trying to do the astronomer-cosmos package in AWS MWAA. The set up is fine and cosmos package is installed as mentioned in requirements.txt file.
I maintain the snowflake credentials in aWS ...
0
votes
0
answers
62
views
Snowflake Data Masking Issue. With view and table
So I have a table which have masking on its columns so I got my roles added to masking policy of that particular view.
I created a view and a table from dbt including data from that particular masked ...
0
votes
1
answer
71
views
can we use dynamic variable in DBT models
The requirement is to use a dynamic variable in posthook, I just don't know if its possible in dbt model
example :
- 21
0
votes
1
answer
183
views
DBT - Snowflake - Model trying to alter a column
I have an incremental model in dbt that uses the data of a stream (as a source) and tries to merge into a next table.
I'm facing the problem that one of the columns is defined in the 1st table (on ...
0
votes
1
answer
47
views
dbt source table named group - issue
Running dbt core version 1.6.10 and Snowflake
I have a source table named group.
When I execute dbt run... command I get "...unexpected group." error.
In the source yml file I was setting ...
- 439
0
votes
1
answer
63
views
How do we create a materialized view with dbt in snowflake
How can we create a materialized view in Snowflake using dbt?
How can we create materialized View using dbt in snowflake? As far as I know we have 3 transformations View, table, incremenatal. Is there ...
0
votes
1
answer
279
views
dbt - Using multiple 'models' folders in one dbt project? Is this a possibility?
For those with dbt experience, is it possible to have multiple 'models' folders in a single dbt project (all aliased as different folder names)?
We have a project where there are multiple clients and ...
- 19