Questions tagged [data-consistency]
The data-consistency tag has no usage guidance.
data-consistency
126
questions
0
votes
0
answers
9
views
How to design data consistency check rules
Data Reconciliation Rule Generation
Background:
In the process of e-commerce shopping, when a user places an order, data information will be stored in different systems' tables such as order table, ...
0
votes
0
answers
56
views
Custom group data does not match the equally filtered data in Looker (also wrong compared to GA4)
this is no question on a programming level but if the issue can be solved by using programming, I would appreciate any input.
We recently created a dashboard that can be used by local employees. The ...
0
votes
0
answers
18
views
How to build a tightly consistent item assortment table with pagination, sort, filter and search?
I am building a item aggregator page. It is basically a webpage that shows a table with the items assortment of an e commerce sellers. This tables can contains thousand of rows. It should be paginated,...
- 71
0
votes
1
answer
45
views
Handling inconsistency in a highly normalized DB with long load times
I have a highly normalized database with many foreign keys, and my application performs calculations on this data.
First my application loads numerous entities of respective customer (let’s say by ...
- 368
0
votes
1
answer
590
views
How to check data integrity/consistency in asynchronous (event-driven) system
Let's say we have an asynchronous event-driven system where service A owns some data, publishes events and service B is consuming them and is storing the copy of the data in its local DB.
I'd like to ...
- 14.1k
2
votes
2
answers
75
views
How to avoid thread interference while updating database in multithreading
I have a java class ,which has two methods .These methods will be called one after the other. These methods are making rest calls to different services. After getting data from rest call ,i'm updating ...
0
votes
1
answer
247
views
How to manage Data consistency between two microservices?
I have two microservices, e.g M1 and M2. M1 is responsible for managing user transactions e.g orders. When an order is completed, the summary data is sent to M2 via Message bus. M2 is reponsible for ...
- 243
0
votes
1
answer
417
views
Spring Data: How to maintain cache consistency in transactional methods?
Let's assume we have a standard Spring Boot application with JPA. We have repositories, services and REST controllers. On the service layer, we have this:
@Service
public class UserService {
@...
- 7,114
1
vote
1
answer
398
views
The relationship between Paxos family and data consistency
Paxos, a kind of consensus algorithm, plays a vital role in distributed database systems. It can be used to make the distributed system chooses the same proposal. Data consistency is a big problem in ...
- 13
0
votes
1
answer
89
views
Data consistency in DAOs
Looking up "dao data consistency" or "data access layer data consistency" on Google returns nothing useful
Suppose I have to write DAOs that use a SQL db as datasource and let's ...
0
votes
1
answer
541
views
Data Consistency check in ADF Copy activity with Source as Query on Teradata Table and Sink as CSV in Azure Blob
Source: Query on a Teradata table
Sink: Csv file in Azure Blob Storage
Aim: I want the Copy activity to fail if the count in the source query and copied rows do not match.
Looking at the documentation ...
- 259
0
votes
1
answer
353
views
Flutter List after storing all data in a for-loop, when out of loop replace all stored records with the last record. Why's that?
I want to pass data from json to a list. I load the list with data into a for-loop, and it works as expected, loading 6 records into my list. But when I verify when for-loop is done, my list keep only ...
- 13
1
vote
1
answer
592
views
Data consistency around instances of same micro service
I have 5 instances of account microservice which transfers the money from account A to account B and then updates the data in the Postgres database.
My problem is
A user sent five requests to the ...
- 985
0
votes
2
answers
306
views
How to share data between microservices without sync RPC (use topics as changelogs) and deal with consistency?
I learned about using Kafka's topics as a changelog to avoid doing synchronous RPC, but I don't understand how we deal with consistency as topics are not persistent (retention policy).
i.e, I run an ...
- 161
1
vote
1
answer
105
views
How to ensure DNS records consistency between primary DNS servers?
Root DNS servers may be the most typical primary(not read-only) DNS servers. There are currently 13 IP addresses for root DNS servers; however, considering the IP anycast technology, more than 13 root ...
- 383