Questions tagged [large-files]
Large files, whether binary or text, can sometimes be problematic even for an experienced programmer. This tag should be used if issues arise relating to opening and/or writing large files in a text editor, managing resources that run to gigabytes, or strategic decisions for large amounts of data.
large-files
1,717
questions
0
votes
0
answers
27
views
Trying to resize a large image of 91.6 MB [closed]
For an image processing project, where i'm working on image of size 91.6 MB.How to work with images of such large size?
I tried to open the image using PIL by setting its max limit to None.But when I ...
0
votes
0
answers
7
views
Having Problem in pushing large files in git [duplicate]
There is an error coming everytime i push my file on github.
I tried changing the version of https from 2 to 1.1 ,
I have also tried to track files using git lf,
I have also added these files to the ....
0
votes
1
answer
28
views
VBA read 1st line of large utf8 csv
I tried to use th ADODB to read only the first line of a large utf8 file.
for my purpose I need only the values of the first line in a csv (having the headers of a table)
Public Sub stream()
...
- 85
0
votes
2
answers
81
views
How to parse multiple Large XML files with good performance and memory usage balance?
I'm implementing a program which should get files from the user in Angular, send them to the node.js backend, where there those will be read and parsed into an array of object.
I went with javascript ...
0
votes
0
answers
23
views
HTTP 413 error uploading large file on apache
Using django-filer admin file manager to upload 2GB large file. On the same windows machine, works OK in vscode development environment, but return http 413 on apache ssl enabled http server. And ...
1
vote
0
answers
35
views
In PHP. 1GP file takes one-hour time to download from FTP connection. How to increase the download speed?
I PHP fpt connection, I am trying to download one large file minimum 1GP from client server to my server but the downloading time taking minimum one-hour. But the server configuration and bandwidth ...
- 21
0
votes
0
answers
23
views
Uploading Large WAV Sound Files into Github
I'm trying to upload large WAV files into a Github Repository that I have. They have music that will play in a game I'm designing. But Github won't let me upload them to the repository because they ...
0
votes
0
answers
30
views
Uploading Large files(>10MB) to s3 through API Gateway
I have a lambda function which uploads excel files to S3. Since there is limit of 10MB for API Gateway. How can i Upload larger files? Is there a way other than creating a lambda function which ...
- 1
2
votes
0
answers
50
views
Explain the benefit of streaming file data when savings to database in Microsoft example code?
I am looking for the best solution to upload large files to a MySQL database via an ASP.NET Core Web App using Entity Framework Core.
I am looking at the Microsoft documentation *here, but I am ...
- 41
0
votes
0
answers
28
views
Creating a precomputed cloudvolume from an HDF5 file
I have 3620 images in .tif format, totalling 1TB.
Here's their info:
Shape: (21796, 12876)
dtype: uint16
I'm looking to use Neuroglancer to visualize this dataset. To achieve this, I have converted ...
- 21
0
votes
1
answer
133
views
How to stream large .zip files from Azure Blob Storage directly to the browser?
Requirement
Support bulk download of files stored on Azure blob storage for the users either via .NET Core endpoint or through SAS URL from Azure
Specifications
Content Type? - application/zip
How ...
- 61
0
votes
0
answers
17
views
How to use the Dropbox API to upload a LARGE backup
I'm writing a script to copy a large website (29GB compressed) and I cannot seem to get it to upload via the Dropbox API.
curl -T 05-07-2024_11-01PM_files_backup.tar.gz -X POST https://content....
- 69
0
votes
0
answers
17
views
VSCode not opening large file
I need to open a file in VSCode the problem is that the files is 22,5GB and I am getting the oom error. It is always loading until it reaches 15GB RAM usages and than crashes. I have over 35GB free ...
- 1
0
votes
0
answers
38
views
How can I make sure AWS Glue Crawler reads all lines in a S3 csv file
I have multiple csv files in an S3 bucket coming in daily, and I process them with Glue crawlers, so they end up in Glue Data Catalog. But given the size of the files(>50 GB each) I wonder if all ...
0
votes
0
answers
58
views
Delete all the columns from a very large file which satisfy a specific condition
I have a very large file of size approx. 5-10 GB.
The file will have 2 types of lines:
Lines starting with "#define CHAR_DEF"
Lines starting with "% "
Format of "% " ...
