Questions tagged [google-cloud-pubsub]
For programming/API questions related to Google Cloud Pub/Sub, which provides asynchronous messaging and ingestion services for event-driven systems and streaming analytics on the Google Cloud Platform infrastructure.
google-cloud-pubsub
3,108
questions
0
votes
1
answer
36
views
AWS Lambda unable to work with \n as string
I have a private key from GCP Pub Sub.
It is stored like this
secret_manager_data = {'google_pubsub_private_key':'-----BEGIN PRIVATE KEY-----\nYourPrivateKeyHere\n-----END PRIVATE KEY-----\n'}
I'm ...
- 160
0
votes
0
answers
29
views
Schedule Firebase Cloud Function Doesn't Handle DST
exports.sendDailyNotification = functions.pubsub.schedule('0 12 * * *')
.timeZone('America/Chicago')
.onRun(async (context) => {
// Code Here
}
I would expect this cloud ...
0
votes
1
answer
43
views
How can I efficiently insert more than 1 million records into Firestore?
Description:
I am working on a project where I need to insert more than 1 million records into Google Firestore. Currently, my approach is not efficient enough and the process is extremely slow. I am ...
- 445
0
votes
0
answers
26
views
Error: Could not load the default credentials. Browse to https://cloud.google.com/docs/authentication/getting-started for more information
An error in the title was output in an application running on Google Kubernetes Engine.
Specifically, an error occurs because the application does not have permission to access Cloud Storage.
...
- 1
-1
votes
0
answers
28
views
JMS to PubSub to BigQuery (GCP)
I'm relatively new to GCP. I recently got access to a JMS topic/queue and I want to collect the JMS messages into GCP BigQuery. I figure the way to do it would be to go JMS topic -> Pub/Sub -> ...
- 1
1
vote
1
answer
39
views
Getting a 403 error when triggering a Cloud Function from a PubSub Topic
I created a cloud function that is triggered by a publish to a pubsub Topic. When I publish a message to the topic and read the funcition logs, I see this error:
"The request was not ...
1
vote
0
answers
32
views
google-cloud/pubsub: Total timeout of API google.pubsub.v1.Publisher exceeded 60000 milliseconds before any response was received
When I use the library: @google-cloud/pubsub method to get the topic created in gcloud pub/sub, I get the following error:
Total timeout of API google.pubsub.v1.Publisher exceeded 60000 milliseconds ...
- 11
1
vote
0
answers
53
views
Transfer/Stream data/CSV Files from POS (Point of sales) to GCS Buckets and then to Big query
I am working on a project where I have to transfer/Stream the data/CSV file from on prem POS to GCS buckets and then data will be first saved to Big Query external table and then moved to other ...
- 629
0
votes
1
answer
60
views
504 Deadline Exceeded in google pub/sub python
from google.cloud import pubsub_v1
if __name__ == '__main__':
publisher = pubsub_v1.PublisherClient(
credentials="/Users/quang/.config/gcloud/application_default_credentials.json&...
- 13
0
votes
2
answers
52
views
Pub/Sub benchmark: why the benchmark of killing connection each time is better than using single connection
I am a newbie of GCP Pub/Sub, and I try to test the benchmarh of publish message.
we have two scenario below:
both scenario will publish 6 messages.
Scenario 1: create pubsubClient, then publish 6 ...
- 11
0
votes
1
answer
41
views
How can I configure the Firebase Cloud function emulator so that my function receives messages from a real cloud topic
I want to be able to test my cloud function locally in the Firebase emulator with it receiving messages from an actual topic in the Firebase cloud environment (not from the Firebase PubSub emulator).
...
- 20.3k
0
votes
0
answers
58
views
Connect to pub/sub within vpc without nat
I want to use gcp pub/sub both push and pull subscription within vpc without nat , similar to aws vpc endpoint is there any way to achieve the same in gcp ? I went thorugh docs of private google ...
- 81
0
votes
0
answers
28
views
How to observe pubsub push window changing with failing requests?
I have a cloud run endpoint that gets triggered by a push type pubsub subscription and the cloudrun api is a composite api which does 2-3 operations and then it returns. I am observing at high load ...
1
vote
1
answer
41
views
Push Subscription with long-running tasks
I have tasks that can be completed in ~3 mins. Cloud Run offers 600 seconds as a maximum timeout, so this is not an issue. We decided to use Cloud Run + Pub/Sub with push subscription.
Workers (I have ...
- 7,763
0
votes
1
answer
34
views
How to add a subscription filter based on label ids
I'm integrating into the pub/sub capabilities in order to get copies of sent and received emails from users in my G-Suite. I'm quickly realizing that this can get chatty. It seems like every movement ...
- 3,156