Questions tagged [amazon-athena]
Amazon Athena is a service for running SQL queries against data stored on Amazon S3. Amazon Athena is part of Amazon Web Services (AWS).
amazon-athena
3,595
questions
0
votes
0
answers
13
views
Delta table column mapping support in Athena/Glue
I'm confused by AWS documentation regarding compatibility with delta tables.
We need to delete a column that is the "column mapping" feature supported in delta-lake 1.2.0 and we do it ...
- 301
0
votes
1
answer
28
views
How to test Amazon Athena queries
I have a rather complicated Athena query, which I would like to test on a local machine without connecting to Athena. I specified some mock data for testing purposes, and I was hoping that I could use ...
- 714
0
votes
1
answer
41
views
How to efficiently store and query data with key-value pair in AWS S3 and Athena?
I have a dataset stored in AWS S3 and query using AWS Athena. The data is currently structured in two columns in S3 as follows:
Dataset
Customer_ID | Products_csv
C1 | P1, P2, P3
C2 |...
0
votes
2
answers
28
views
Compute a new column to increment/decrement by 1 per row, in respect to a certain row set with a condition
I would like to increment/decrement by 1 per row, when the starting point (0) is set by a condition in a specific row.
Example
Consider the following my_table:
WITH my_table AS (
SELECT *
FROM ...
- 4,077
0
votes
1
answer
26
views
Error while fetching data from mongo to QuickSight using Athena (COLUMN_NOT_FOUND Error)
We use Amazon QuickSight to analyze data from MongoDB.
The custom query in our dataset works perfect:
SELECT _id, label, structure, createdAt, deleted
FROM docdb.label_db.labels
We have added a ...
- 879
0
votes
0
answers
25
views
AWS Athena Error: Modifying Hive table rows is only supported for transactional tables
I am not able to perform delete operation on row in AWS Athena tables. It is throwing below error as:
NOT_SUPPORTED: Modifying Hive table rows is only supported for transactional tables
This query ran ...
- 594
-1
votes
0
answers
21
views
AWS Lamda event getting triggered multiple times
I am implementing a solution where whenever a new file is placed in S3 I am triggering an event in my lambda function which inserts the data further to AWS Athena.
But the issue is event is getting ...
- 594
1
vote
1
answer
33
views
Athena try_cast is not returning null
I have below query
SELECT * from table WHERE TRY_CAST(date as varchar) is null
as per my understanding ,TRY_CAST return null if it is not able to cast, it should return those rows having date column ...
- 4,538
0
votes
0
answers
18
views
AWS crawler creating Null values for partion columns
I am having some country level partitioned data in s3 and crawler is crawling the this root folder and creating a table. No Null value is there for country code. But when looked in the Athena, there ...
- 41
0
votes
1
answer
31
views
Athena extract value from nested json with dynamic key
I have following json
{"GrossORNet":"Net","Term":"Monthly","Tier":{"All":{"1":{"Max":"100000","Min":&...
- 4,538
0
votes
1
answer
26
views
How to update the set of values of an enum partition in Athena
Parquet files are stored in AWS S3 with prefixes like /fruit=.../year=.../month=.../day=.../.
Their data are queried via AWS Athena, with a table in which fruit is typed as an enum:
'projection.fruit....
- 13.2k
2
votes
1
answer
27
views
Amazon athena, presto sql :INVALID_FUNCTION_ARGUMENT: Cannot unnest type: varchar
Have some transaction data and the data looks like:
record_id labels
001 ['first_record','transfer']
002 ['withdraw', 'holiday']
003 ['direct','change_password','...
- 21
0
votes
1
answer
49
views
Find the node name of the JSON key from nested JSON
I have below JSON data:
{"GrossORNet":"Net","Term":"Monthly","Tier":{"All":{"1":{"Max":"100000","Min"...
- 4,538
0
votes
0
answers
18
views
Is it possible to partition an Athena table using a variable which is timestamp datatype
I am trying to partition an athena table by a timestamp variable called 'forecast_datetime'. To use this variable as a partition I have made it 'string', with following values:
'2007-12-10-11-00-00', '...
- 585
0
votes
1
answer
23
views
How to Restrict Users from Changing AWS Athena Query Result Location
We need to restrict users from changing the AWS Athena query result location. Our primary goal is to prevent users from downloading Athena query results. We have managed to restrict downloads by ...
- 1