All Questions
Tagged with csv selenium-webdriver
282
questions
0
votes
0
answers
59
views
I am trying to find a way for the code to work (aka the console displays all meal types for each dining hall) without having to quit the driver
I am trying to find a way for the code to work (aka the console displays all meal types for each dining hall) without having to quit the driver in the second for loop.
import time
import csv
from ...
1
vote
1
answer
57
views
"CSV Data in Linux Shows '???' in First Element but works fine in windows - How to Resolve?"
I'm executing my code in GitHub Actions (Linux environment) and trying to retrieve data from a CSV file. However, the first element of the CSV file is showing as '???"'. Interestingly, the same ...
- 11
0
votes
0
answers
56
views
Use multithreading on scrapy scraper using selenium
I'm working on a scrapy scraper which is using selenium to scrape data but this process is time taking.
It can only scrape 2000 records in 12 hours. I want to speed up the scraper using multithreading....
1
vote
0
answers
56
views
Scraping data Airbnb
I am working on a Python script using Selenium to scrape Airbnb listings from multiple pages and gather information such as the title, price, and details about each listing. The script navigates ...
- 11
0
votes
0
answers
65
views
Downloading a CSV from a Website Using Requests in Python
I'm a researcher trying to download some weather data from a website and I'm looking for a way to automate it using Python. I'm using Selenium and Requests libraries. The website looks like this:
...
0
votes
2
answers
72
views
Extracting data from a table using selenium
I want to extract data from a table that contains pagination using selenium but I have no idea how. The code below extracts the data correctly but I need all the data in the table and it only shows me ...
- 1
0
votes
2
answers
569
views
Testing for downloading file in a feature test
Currently, my code downloads data in the Controller using send_data. I need to write a feature test to check for the download of the file. I'm using Capybara, selenium (chrome browser). Is there a way ...
- 366
0
votes
0
answers
76
views
Been trying to web scrape a blocked website for over a month
I'm trying to web scrape this damned website 'https://www.soccerstats.com/' for so long, but it's not working. The website is blocked in my country. I usually open it with a vpn extension. But, on ...
- 107
0
votes
0
answers
35
views
Python Script adding data to wrong row
I wrote a python script to use selenium for scraping a website. The website has 2 dropdown options for Country and Company Code or Company Name, and displays the list of documents needed after ...
-1
votes
1
answer
58
views
Selnium/spotify API - Bulk like list of songs
I have a csv list of 3000+ songs, name and artist, I want to "like" all the songs that appear on the list in my spotify account.
I looked for a solution inside spotify API but couldn't find ...
0
votes
1
answer
41
views
Issue Extracting Dollar Amounts from Web Scraped Text
I am trying to extract dollar amounts from a web page that I am scraping using Python and Selenium. I have implemented the following code to scrape data from a webpage and extract dollar amounts from ...
- 3
-2
votes
1
answer
43
views
Selenium - using csv as dataframe - inputting user data on a website (onboarding) - need help iterating through the whole csv
import pandas as pd
import time
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.common.keys import Keys
from selenium.webdriver....
-2
votes
1
answer
32
views
How do I prevent filling the same details repeatedly when entering data from a CSV file using Python Selenium and Xpath?
with open('C://pyhtonprograms//flipkartinfo.csv', 'r') as csv_file:
csv_reader = csv.reader (csv_file)
next(csv_reader)
for line in csv_reader:
driver.get("https://www....
0
votes
0
answers
65
views
how do i make loop for each input in python?
i'm trying to make a loop for my script (web scraping with selenium), so i earned every match id that i got. Here's my table
from selenium import webdriver
from selenium.webdriver.common.by import By
...
- 49
0
votes
0
answers
46
views
How to read .csv lines in an automated sequence
I'm a novice to programming and have been writing a script using selenium.webdriver, pyautogui and csv that sequentially opens up .pdf files on the browser and saves them to a directory.
I have a ...
- 1