Questions tagged [snowflake-cloud-data-platform]
Snowflake Cloud Data Platform has a multi-cluster, shared architecture that provides a single location for structured and semi-structured data that can be queried using ANSI SQL. Snowflake is a cloud-agnostic platform with very large scale that supports many different workloads: data warehousing and analytics, data lake, data engineering, secure data sharing, data applications, and data science.
snowflake-cloud-data-platform
4,428
questions with no upvoted or accepted answers
7
votes
1
answer
3k
views
Protocol buffer/JSON Schema to SQL DDL
We use protocol buffers(protobuf) to define our schemas internally and have translators to translate to various other internal representations such as JSON Schema(Protobuf to JSON schema converter) so ...
- 173
6
votes
2
answers
1k
views
snowflake pipe status numOutstandingMessagesOnChannel
I have a pipe that seems to be set up fine, but it just isn't working.
I ran
select system$pipe_status('"MY_DB"."MY_SCHEMA".MY_PIPE_NAME');
i'm getting back a growing number of ...
- 1,140
5
votes
1
answer
1k
views
Lambda Docker Image Not Running
I've had an absolute terrible time trying to get the Snowflake python connector to install. That is a side frustration in this, but i've finally managed to get it to install by using a full Ubuntu ...
- 321
5
votes
1
answer
2k
views
Not able to Connect to Snowflake through externalbrowser authenticator from Docker container
When i am trying to connect to Snowflake through python script inside an docker container getting below error.
snowflake.connector.errors.DatabaseError: Failed to connect to DB: cisco.us-east-1....
5
votes
0
answers
2k
views
nanodbc/nanodbc.cpp:1617: 00000: [Snowflake][Support] (40465) String data truncated while performing conversion
I am trying to insert a dataframe into a table in snowflake database, using DBI:: dbAppendTable() via R studio. The number of rows in datafarme are 5000. I get above error only when I am loading all ...
- 51
5
votes
2
answers
6k
views
Snowflake Integration Testing Implementation
I have a service(Java + Springboot) which uses PostgreSQL database, the service will be migrated to Snowflake (cloud-based data-warehousing) so I would like to know what is the best way to implement ...
- 447
4
votes
0
answers
958
views
The best way of creating a unit test case for Snowflake database operations. Mock or real?
I am actually new to writing unit test case and I have created one Mock unit test case like below which works fine.
class SnowflakeDbTest(TestCase):
@patch('services.SnowflakeAPI....
- 553
4
votes
0
answers
559
views
Multi-table insert in dbt (1 select -> several target tables)
Snowflake supports multi-table inserts:
https://docs.snowflake.com/en/sql-reference/sql/insert-multi-table.html
I'm wondering if there is a way to do that in dbt. Can be useful when you have 1 source ...
- 75
4
votes
1
answer
5k
views
net.snowflake.client.jdbc.SnowflakeChunkDownloader : Timeout waiting for the download of #chunk0
Getting timeout waiting for download of chunk error. Snowflake JDBC driver version: 3.13.18
error encountered:
*net.snowflake.client.jdbc.SnowflakeSQLException*: JDBC driver internal error: Timeout ...
4
votes
3
answers
4k
views
How can I add one more storage_allowed_location in Snowflake storage integration
I have created one Snowflake storage integration as follow:
create or replace storage integration s3_int
type = external_stage
storage_provider = s3
enabled = TRUE
storage_aws_role_arn ...
- 75
4
votes
1
answer
625
views
Kill Snowflake queries from Spark Connector
Is there a way to kill Snowflake queries using the Spark connector ? Alternatively is there a way to grab the last last query id or session id in Spark to kill it outside of Spark.
The use case is ...
- 877
4
votes
1
answer
3k
views
AWS GlueStudio to Snowflake JDBC: An error occurred while calling pyWriteDynamicFrame. No suitable driver
I'm trying to move data from a Data Catalog table (MySQL) through AWS Glue (in visual mode of GlueStudio) into a snowflake table.
For this, I'm following this guide Performing data transformations ...
- 332
4
votes
1
answer
7k
views
Using apache-airflow-providers-snowflake on airflow (no module named Snowflake)
I have installed package apache-airflow-providers-snowflake on airflow on docker and i am getting error
No module named Snowflake
Please refer attachment (check the error mentioned for the snowflake ...
- 77