Questions tagged [snowflake-cloud-data-platform]
Snowflake Cloud Data Platform has a multi-cluster, shared architecture that provides a single location for structured and semi-structured data that can be queried using ANSI SQL. Snowflake is a cloud-agnostic platform with very large scale that supports many different workloads: data warehousing and analytics, data lake, data engineering, secure data sharing, data applications, and data science.
snowflake-cloud-data-platform
12,258
questions
44
votes
6
answers
56k
views
"Variables may not be used here" during terraform init
I am using Terraform snowflake plugins. I want to use ${terraform.workspace} variable in terraform scope.
terraform {
required_providers {
snowflake = {
source = "chanzuckerberg/...
- 1,446
26
votes
7
answers
99k
views
Split a large json file into multiple smaller files
I have a large JSON file, about 5 million records and a file size of about 32GB, that I need to get loaded into our Snowflake Data Warehouse. I need to get this file broken up into chunks of about ...
- 487
24
votes
7
answers
24k
views
Snowflake JDBC driver internal error: Fail to retrieve row count for first arrow chunk: null -- only occurs on SELECT statements
I have successfully established the JDBC connection and can successfully execute statements like "use warehouse ...". When I try to run any SELECT statement I get the following error:
net....
- 241
22
votes
11
answers
36k
views
Does Snowflake support indexes?
In the Snowflake documentation, I could not find a reference to using Indexes.
Does Snowflake support Indexes and, if not, what is the alternative approach to performance tuning when using Snowflake?
- 229
21
votes
3
answers
31k
views
How can I populate a pandas DataFrame with the result of a Snowflake sql query?
Using the Python Connector I can query Snowflake:
import snowflake.connector
# Gets the version
ctx = snowflake.connector.connect(
user=USER,
password=PASSWORD,
account=ACCOUNT,
...
- 23.6k
20
votes
3
answers
37k
views
NOT LIKE ANY query in Snowflake
I am trying to run the following query in Snowflake:
SELECT * FROM chapters
WHERE
title NOT LIKE ANY ('Summary%', 'Appendix%')
but it errors out. I know Snowflake support LIKE ANY query syntax. But ...
- 4,190
20
votes
3
answers
32k
views
SELECT INTO syntax for Snowflake Datawarehouse
I believe there's an SELECT INTO-like syntax in Snowflake, but I am unable to find documentation or examples to use it.
CREATE TABLE raw_data (
Timestamp TIMESTAMP NOT NULL,
Date DATE NOT ...
- 28.5k
18
votes
10
answers
44k
views
How to delete duplicate records in Snowflake database table
How can I delete the duplicate records from a Snowflake table?
ID Name
1 Apple
1 Apple
2 Apple
3 Orange
3 Orange
Result should be:
ID Name
1 Apple
2 Apple
3 Orange
- 191
18
votes
7
answers
22k
views
generate_series() equivalent in snowflake
I'm trying to find the snowflake equivalent of generate_series() (the PostgreSQL syntax).
SELECT generate_series(timestamp '2017-11-01', CURRENT_DATE, '1 day')
- 197
17
votes
6
answers
48k
views
NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:snowflake
I've installed all the necessary packages:
pip install --upgrade snowflake-sqlalchemy
I am running this test code from the snowflake docs:
from sqlalchemy import create_engine
engine = create_engine(...
- 1,420
16
votes
6
answers
21k
views
How to restrict duplicate record to insert into table in snowflake
I have created below table with primary key in snowflake and whenever i am trying to insert data into this table, it's allow duplicate records also.
How to restrict duplicate id ?
create table tab11(...
- 231
16
votes
2
answers
10k
views
Difference between LATERAL FLATTEN(...) and TABLE(FLATTEN(...)) in Snowflake
What is the difference between the use of LATERAL FLATTEN(...) and TABLE(FLATTEN(...)) in Snowflake? I checked the documentation on FLATTEN, LATERAL and TABLE and cannot make heads or tails of a ...
- 666
15
votes
4
answers
7k
views
AWS Redshift vs Snowflake use cases
I was wondering if anyone has used both AWS Redshift and Snowflake and use cases where one is better . I have used Redshift but recently someone suggested Snowflake as a good alternative . My use case ...
- 251
15
votes
2
answers
13k
views
Lateral flatten two columns without repetition in snowflake
I have a query that groups by a two variables to get a total of another. In order to maintain my table structure for later computations I listagg() two other variables to save for the next stage of ...
- 4,179
15
votes
3
answers
6k
views
Snowflake as backend for high demand API
My team and I have been using Snowflake daily for the past eight months to transform/enrich our data (with DBT) and make it available in other tools.
While the platform seems great for heavy/long ...
- 193