All Questions
10,969
questions
1
vote
1
answer
26
views
Reading .csv column with decimal commas and trailing percentage signs as floats using Pandas
I am faced with reading a .csv file with some columns like this:
Data1 [-]; Data2 [%]
9,46;94,2%
9,45;94,1%
9,42;93,8%
I want to read Data1 [%] column as a pandas DataFrame with values [94.2, 93.4, ...
- 1,984
-4
votes
0
answers
60
views
How to split CSV data with newline, commas, quotes in the column of data? [closed]
I want to split the data line by line, but I am receiving newline and quotes in the data which is not allowing me that to split it by either newline.
CSV Data Received:
ISSUE ID,FACTOR NAME,ISSUE TYPE ...
- 1
-1
votes
0
answers
23
views
Create a csv file from a list of objects and each row correspond three objects [duplicate]
I got a file that looks like this
Name
address
number
James
Avn philips 2
555 555 55
Peter
Colton 34 postmen
444 444 44
Claudia
Rainssaw 345 sq three
333 333 33
How can I convert in a csv like this:
...
- 507
0
votes
3
answers
54
views
Python Pandas extract csv column containing json
I want to learn Pandas framework, so I find free csv with Euro data from kaggle.com
https://www.kaggle.com/datasets/piterfm/football-soccer-uefa-euro-1960-2024/data
But there're plenty of columns ...
- 1
1
vote
2
answers
90
views
Is there a Pandas idiom for reading a CSV file with categorical data that has spelling variants?
I have a CSV file with multiple categorical columns, but most of these columns contain messy data due to typing mistakes (e.g., 'spciulated', 'SPICULATED', etc. for the category 'spiculated' of the ...
- 111
0
votes
1
answer
39
views
Optimal way to "rotate" contents of a datafile? [duplicate]
I have very large datafiles (csv files that are several GB a piece, roughly a 3059 by 40-80k long table) that are used for constructing images from spectroscopy data. They're standard tab delimited ...
0
votes
2
answers
26
views
Pandas csv_read interprets empty values as row headers
let's say I have a data like:
parameter1 parameter2 2010 2011 2012
A B foo foo foo
C foo foo foo
D foo foo foo
M N ...
- 303
0
votes
1
answer
20
views
Columns of Data missing on Google Sheet file after upload
I have this program that is supposed to take some csv files using pandas and convert them to google sheet files and upload them to my Google Drive folder. However, when uploaded, only the last 8 ...
1
vote
1
answer
41
views
Convert TSV file data to a dataframe, which can be pushed to database
We have TSV files which holds IOT data, want to convert to table like structure using pandas. I have worked on TSV data, similar to given below, were the logics goes like
read the file
Add new column ...
- 428
0
votes
1
answer
57
views
How can I combine multiple CSV files into one Excel worksheet using Python?
I am trying to combine multiple CSV files into an Excel worksheet so I can analyse my data.
So far I have been able to create the worksheet with the names of the CSV files as the tabs, but in the ...
-3
votes
1
answer
80
views
Python - How to read a CSV file with data starting on row 10 (skipping rows gives a NaN)
I have a CSV file where the first 8 rows explain the file and the data starts on row 10. I tried skipping the data first, however, it gave me errors with reading the file.
#Trying another way... Issue ...
2
votes
2
answers
90
views
Adding leading zeros to data columns when loading from CSV files using pandas
I have a script to load and combine time-series data from two .csv files that have the same base filename (specified as a path using Pathlib), but different suffixes. Given that the importing of the ...
- 23
-1
votes
0
answers
31
views
Scrape all of the tabled entries from a website and write them to a csv [duplicate]
I just need to scrape all 7,959 possible entries on this page into a csv:
https://skillbridge.osd.mil/locations.htm
I've been trying to use Beautiful Soup but it never quite works. I tried using LLMs ...
- 31
0
votes
0
answers
33
views
FileNotFoundError when trying to load a CSV file into pandas in Jupyter Notebook [duplicate]
I have been attempting to read data from a CSV file using a Python script in Jupyter Notebook. I expected the script to successfully load the CSV data into a pandas DataFrame without errors, however, ...
- 1
-4
votes
0
answers
41
views
Extract temperature data out of NetCDF4
My problem is that I have a NETCDF4 file with a lot of temperature data in the tas variable. I can extract a couple of temperature data and find the closest point of lon and lat in the grid. The ...
- 49