Questions tagged [aws-dms]
AWS Database Migration Service (AWS DMS) can migrate your data to and from most widely used commercial and open-source databases such as Oracle, PostgreSQL, Microsoft SQL Server, Amazon Redshift, Amazon Aurora, MariaDB, and MySQL. The service supports homogeneous migrations such as Oracle to Oracle, and also heterogeneous migrations between different database platforms, such as Oracle to MySQL. The source or target database must be on an AWS service.
aws-dms
491
questions
0
votes
0
answers
18
views
How can I use "SchemaName.TableName" partition key in AWS DMS to migrate data to an Amazon Kinesis data stream?
I'm trying to set up DMS to push data to kinesis stream, with partition keys based on the schema and table name. The intent is to get all cdc events for a given table hitting a single shard, to better ...
- 151
0
votes
0
answers
63
views
AWS DMS migration Premigration assessment possible bug on "Validate if the timeout values are appropriate for a MySQL source or target"
So I have:
source: AWS Lightsail DB MySQL on version 8.0.35
target: AWS Aurora MySQL 3.07.0 (8.0.36)
And one Assessment is constantly failing "Validate if the timeout values are appropriate for ...
- 1
0
votes
0
answers
49
views
Data Validation error - Mismatched Records
We are doing PostgreSQL to Aurora PostgreSQL data migration using AWS DMS.
We are seeing the mismatched records error during the validation.
We are seeing some extra space at source.
[[{'user': 'xxxxx ...
0
votes
0
answers
24
views
DMS Source Data and Latency spike nightly
I'm using a SQL Server on-prem source for a DMS to replicate to a SQL Server RDS. Every night, at about midnight, I'm seeing a spike of ~1.6M CDC incoming changes on my DMS task, but nothing is making ...
0
votes
0
answers
24
views
Break dependency from DMS reload/restart
We use AWS DMS to replicate (initial load + cdc) AWS Aurora MySQL data into our Redshift (in the future we are going to use ICEBERG). In case there is any issue with DMS (RI break, Task break, MySQL ...
- 2,579
0
votes
0
answers
95
views
Last Error Failed in resolving configuration. Stop Reason FATAL_ERROR Error Level FATAL
When I tried in dms to load data from mysql to s3.
Then task fail and show this Error:
Last Error Failed in resolving configuration. Stop Reason FATAL_ERROR Error Level FATAL.
- 1
0
votes
1
answer
29
views
AWS Data Migration doesn't migrate any data
I have a DMS task to migrate full load and replication. The source is my RDS Mysql database and the target is my Open Search Domain. When I do either a full load migrate or replication, my tables are ...
0
votes
1
answer
77
views
AWS DMS S3 Target Validation Stuck in "Records Pending"
I'm using AWS Database Migration Service (DMS) to migrate data from a source database (SQL Server RDS) to an S3 bucket. The DMS and the RDS are deployed in the same account but in different regions, ...
- 112
1
vote
0
answers
37
views
Does AWS DMS has a 30 character limit on the length of Table and Column name to be replicated?
I am a data modeler and while modeling my tables in Postgres 14.7, I was told that the table and column names cannot exceed 30 characters, since AWS DMS replication will only allow maximum 30 ...
- 31
0
votes
0
answers
35
views
Getting only control record for some DMS Task TableMappings
AWS DMS
Source endpoint: Aurora Postgres
Target Endpoint: Kinesis Data stream
Task with these settings
MigrationType: cdc
TableMappings: |
{"rules":[{"rule-type":"selection&...
- 123
0
votes
0
answers
57
views
Amazon Redshift serializable isolation violation when there are only 1 writing process
I am continuously getting a 1023 error (Serializable isolation violation) on Redshift.
I have a stored procedure which reads several table and writes the query result to a destination table.
There is ...
0
votes
0
answers
44
views
AWS DMS / Redshift target - data validation returns false positives
We recently enabled data validation on the Redshift target for our DMS tasks with ongoing replication (released Nov 2024 AWS DMS added support for Redshift target data validation). Shortly after we ...
- 1
0
votes
2
answers
77
views
How to handle MySQL/MariaDB TIME columns in Amazon DMS
We're experiencing issues when using Amazon DMS for ongoing replication of a MySQL/MariaDB database.
The issue specifically happens with TIME columns, whose values get garbled like this:
13:22:31 ...
- 4,638
0
votes
2
answers
150
views
understanding DMS cloudwatch logs
I am trying to create a DMS replication task using Terraform. The credentials for the endpoint are correct. When I start the replication task, it Fails but the cloudwatch logs aren't that helpful. ...
- 3,198
0
votes
1
answer
87
views
DMS replication task fails due to a corrupt binlog event
I have a mariadb RDS database deployed as a multi-AZ in my AWS account, engine version 10.6.16. This DB serves as the main backend database serving ~100 connections per second. I also have a DMS ...
- 41