All Questions
Tagged with snowflake-cloud-data-platform amazon-web-services
158
questions
0
votes
1
answer
77
views
Integrating AWS MWAA, dbt-core, astronomer-cosmos
I am trying to do the astronomer-cosmos package in AWS MWAA. The set up is fine and cosmos package is installed as mentioned in requirements.txt file.
I maintain the snowflake credentials in aWS ...
0
votes
0
answers
64
views
Snowflake MERGE queries getting BLOCKED
We ran a load test Snowflake as the database. This run was done on 2nd & 3rd May 2024. We benchmarked our system to 35 requests per minute due to MERGE statements blocking the tables. For numbers ...
- 11
1
vote
0
answers
55
views
Do I need to create an AWS VPC interface endpoint for loading from Amazon S3 on Snowsight?
In the following Snowflake doc for setting up AWS PrivateLink, it is stated that "The Snowflake clients (e.g. SnowSQL, JDBC driver) require access to Amazon S3 to perform various runtime ...
- 11
0
votes
0
answers
53
views
What's the recommended way to connect AWS Glue to Snowflake?
AWS Glue now provides Snowflake connector as outlined here - https://aws.amazon.com/about-aws/whats-new/2023/07/snowflake-connectivity-aws-glue-apache-spark/. How is this connector different from the ...
- 170
1
vote
1
answer
253
views
MWAA (2.8.1) Cannot install snowflake-connector-python
I am encountering difficulties installing the snowflake-connector-python package in my AWS Managed Workflows for Apache Airflow (MWAA) private web server environment. When attempting to install the ...
- 13
0
votes
0
answers
69
views
The private_key_file path points to an empty or invalid file. {snowflake connecting using private key }
I have provided private key file path which is internal bucket path but unable to connect with Snowflake while running DAG from airflow and unable to extract simple select query as connection failed.
...
0
votes
1
answer
107
views
Snowflake: AWS IAM Role for notification integration
I am trying to create multiple notification integrations in Snowflake. As per my knowledge, I will have to create a new role per notification integration as a different SF_AWS_EXTERNAL_ID is generated ...
0
votes
1
answer
369
views
load data from S3 to Snowflake, with lambda invocation in a sequential order 1 by 1
I'm trying to load data from my S3 bucket folder to snowflake table using lambda. I have setup an S3 trigger where my files are getting ingested and formed an integration between lambda and to ...
0
votes
1
answer
57
views
Why does grouping by blank strings ignore length in Snowflake/Redshift?
Imagine you have a query:
SELECT table.blank_names FROM table GROUP BY table.blank_names
In this case, blank_names is a column of blank strings of various lengths (' ' of length 1, ' ' of length 3, ...
- 21
0
votes
0
answers
108
views
Why is Snowflake attempting to use POST for an External Function to him my AWS API Gateway?
I followed a barebones example in Snowflake to setup an external function inside of Snowflake that can execute a API Gateway in my AWS Account.
Everything is 100% working outside the fact that ...
- 744
0
votes
0
answers
90
views
Read .Sql file stored in S3 containing a Select statements and excute the statement over Snowflake and generate a CSV file using a Glue Job
I have the following scenario as below, could kindly help me on this:
The S3 bucket has a test.Sql file containing for example: select 'Rony' as Name , '1000.45' as Salary, 'Manager' as Designation
...
0
votes
0
answers
145
views
AWS Glue shuffles columns when writing to Snowflake
When writing a dynamic frame from AWS Glue to an existing Snowflake table, my data gets shuffled into other columns.
For example:
Writing this dataframe with the code below...
A
B
C
a1
b1
c1
a2
b2
...
- 2,236
0
votes
2
answers
316
views
Should I allow direct connection from an application to data warehouse?
I am working on an application which needs to get data from a data warehouse. I was always under the impression that an application should not have direct access to a data warehouse. With the ...
- 1,615
0
votes
0
answers
129
views
how to change "–" these values to original in aws s3 bucket by using snowflake file format
Can you some one help me on the below mentioned issue from Snowflake file format to AWS S3 bucket.
I have requirement to unload data from Snowflake to AWS S3 bucket as a CSV format.
During this ...
0
votes
1
answer
36
views
Json data syntax error while fetching some column data | Snowflake
While working with json data found one below column contains scope resolution operator in its column name
Column name: "system::embeddable_last_seen"
how to access above column? when i was ...
