Questions tagged [wal]
WAL, or write-ahead log, is a form of journalling used as part of crash-safety and atomic commit support in databases like PostgreSQL and SQLite.
249
questions
0
votes
0
answers
42
views
What's the proper way to enable SQLite WAL mode with Kotlin's Exposed?
I tried this, using setupConnection, got it from a github issue:
import org.jetbrains.exposed.sql.Database
import org.sqlite.SQLiteConfig
Database.connect(
"jdbc:sqlite:$dbPath",
...
- 33
0
votes
0
answers
57
views
Postgres 15 in AWS RDS WAL disk space consumption > 200GB with Debezium 2.6 with Kafka connectors
we are using Debezium 2.6 with Kafka connectors and has a Spring boot microservice that consume messages from Kafka. We also have 10 databases (Postgres 15) with many schemas per tenant in the same ...
0
votes
0
answers
28
views
Sqlite-jdbc check if WAL mode is enabled
Is there a way to check if WAL mode is enabled for a database using sqlite-jdbc?
- 1,516
3
votes
1
answer
169
views
Are PostgreSQL data files only written to disk during checkpoint?
On every commit, PostgreSQL flushes WAL to disk synchronously (configurable via wal_sync_method) to guarantee durability. Data files only need to be in shared buffers, can be flushed to disk later.
My ...
- 35
0
votes
0
answers
68
views
AWS RDS PostgreSQL: How to adjust wal_level from 'replica' to 'minimal'?
Our AWS RDS PostgreSQL v.16 db uses wal_level=replica. This causes more data to be written to the transaction logs (for PITR recovery ++). We'd like to reduce logging in order to increase performance, ...
- 11
0
votes
0
answers
250
views
Postgres connection failed while Debezium connector streaming changes
On Our Spring boot Auditing service(used Debezium embedded engine) occurs error at different time intervals, I don't know the cause, please help me to understand and fix the problem.
Another ...
0
votes
0
answers
73
views
PostgreSQL writes several trancations into loop as one transaction with subtransactions
Sometimes, if database is big, PostgreSQL writes inserts in loop as a transaction with sub transactions into wal file.
For example,
begin
for i in 1..10000000 loop
INSERT INTO src.customers
(id, ...
- 157
0
votes
0
answers
311
views
PostgreSQL: How and Why does the WAL (Write-Ahead Log) Grow?
I have a problem with the growing number of WAL files, and they just keep increasing. How can I influence this? I have already deleted old transactions and unnecessary replication slots, which ...
0
votes
1
answer
59
views
How does Write Ahead Logs work in conjunction with inserting with STDIN CSV in Postgres?
I'm curious for how the WAL works when I load a CSV file with
COPY persons(first_name, last_name, dob, email)
FROM 'C:\sampledb\persons.csv' DELIMITER ',' CSV HEADER;
So if, for example, I'm ...
- 1,784
0
votes
0
answers
71
views
Postgresql 14 Logical Replication
I have set up a logical replication between Aurora Postgresql to AWS RDS Postgresql which was running fine to a certain point and got stuck.
I disabled and dropped the publication and subscriber slot. ...
1
vote
0
answers
40
views
Why flag "begin" in leveldb WAL is defined as ptr == slice.data()?
This code is in leveldb to get the type of fragment type in WAL
Status Writer::AddRecord(const Slice& slice) {
RecordType type;
// Why not defined as left == slice.size();
const bool ...
- 21
1
vote
1
answer
532
views
Why isn't it possible to disable archive mode in CloudNativePG PostgreSQL operator in kubernetes? [closed]
I'm configuring a CloudNativePG PostgreSQL operator in kubernetes. The data there is not very important and it is ok if we loose it. I want to disable WAL archiving because the archive files in the ...
- 1,652
1
vote
1
answer
1k
views
How to change wal_level to logical in postgresql database when configured via Helm charts
I deployed timescale-postgresql using helm:
Chart Name: timescalepostgres timescale/timescaledb-single --version 0.33.1
In the values.yaml file I kept the wal_level = logical, however after the ...
- 11
0
votes
1
answer
842
views
Is there a limit regarding the number of files that are stored in the pg_wal directory?
I am trying to find an explanation regarding the actual number of files that are being stored in my pg_wal directory.
I am using postgres v13 on a large DB with a lots of updates, inserts and deletes ...
0
votes
0
answers
201
views
WAL getting full on db using pg_restore in postgres
I'm trying to restore my database from a dump. I use the command pg_restore -Fc -j 8 mydumpfile -c and while in the process of restoring the tables the WAL keeps growing up to a point where the db ...
- 2,187