All Questions
206
questions
-8
votes
0
answers
33
views
im trying to make a python post request but i end up getting a java scrip error from the site can anyone help me please [closed]
im trying to make a post request and the web site give me this error :
Requires JavaScript to sign in. This web browser either does not support JavaScript, or scripts are being blocked.
how can i fix ...
-6
votes
2
answers
88
views
This website cannot be correctly scraped even with requets-html
i'm trying to get the prices displayed on :
https://campervans.jeanlain.com/locations/?city-input=annecy&city-name=ANNECY&departure_date=06%2F01%2F2025&departure_time=11%3A00&...
- 73
0
votes
0
answers
49
views
How to get roblox csrf-token 2024 node.js
Does anyone know how to get your csrf-token on roblox in 2024, I use
to know back in 2022 but it doesn't seem to work.
import axios from 'axios'
const cookie = ".ROBLOSECURITY="+'_|WARNING:-...
-1
votes
1
answer
46
views
parsing with requests and BeautifulSoup . Why the email cannot be scraped from the link [duplicate]
my script is not returning email field that I want to scrape from a website . Any workaround??
from bs4 import BeautifulSoup
import requests
url = 'https://www.kw.com/agent/UPA-6587385179144187908-...
- 31
0
votes
2
answers
1k
views
JS fetch to Python request
I am trying to use an API but all the examples are in JS, and my project is in python.
Here is the sample code they gave me:
const request = await fetch("https://api.tiktokenizer.dev/openai",...
- 69
1
vote
1
answer
43
views
Checking if "protected" links resolve
I wrote a simple python script that goes over local HTML documents and text files and tries to check if all the links in them resolve.
Basically, something similar to this (very simplified):
import re,...
- 1,609
0
votes
1
answer
72
views
How To Extract URLs From a Hindi Newspaper Amar Ujala
I am trying to extract the url of articles present on a Hindi Newspaper called Amar Ujala.
Link: https://www.amarujala.com/india-news?src=mainmenu
In 'Network' section of Dev Tools, It seems required ...
- 361
1
vote
1
answer
78
views
Python requests result doesn't match the website because of JavaScript
I'm trying to scrape links of products from a webpage (url below). The page uses JavaScript. I tried different libraries, but the links don't show up in the results (the links have the format */...
- 1,660
-2
votes
1
answer
447
views
FedEx API ('BAD.REQUEST.ERROR': Missing or duplicate parameters... )
Post request to fedex Authorization Api is returning an error. I've tried doing this request in PHP, Javascript and python in a number of methods, yet only the python script is working properly, ...
- 1
0
votes
0
answers
121
views
How can I get the content inside <div id="App"></div> using Python?
I'm trying to gather the text of all the stories in League of Legends lore. I'm webscraping the page where all the short stories are listed in order to find their links and then going to those pages ...
0
votes
2
answers
138
views
PYTHON module "requests" not working with packaged electron app
In my electron app I have a python file that has two import statements shown below
import requests
import shutil
The app works fine without an errors in the IDE but after packaging the electron app ...
- 30
-2
votes
1
answer
98
views
Download file in python on clicking on href
I am trying to click on below href link.
href="javascript:;"
<div class="xlsdownload">
<a id="downloadOCTable"
download="data-download.csv"
...
- 11
0
votes
1
answer
151
views
How to scrape 'src' or 'href' value when it uses Javascript?
Perhaps this is a simple solution, but I'm just really stuck on this one.
Say when you would pull the value of 'href' from a webpage using BeautifulSoup, for example:
soup.find("a", {"...
- 104
0
votes
1
answer
95
views
Python -Requests -BS4 and scraping JS websites (ajax)
Trying to scrape
https://online.transport.wa.gov.au/webExternal/registration/;jsessionid=f5niZvGzB71vhrxMujeQPc2lxEWUqj5nc_fuXDvU9ZvvmTEcncK7!1976798565!-891443374?0
and return my Rego details.
I am ...
- 13
0
votes
1
answer
78
views
How to remove slashes from couchdb value of a document
I am trying to send data to couchdb database but I saw that it shows it the couchdb document of the database as this but I sended that data :
like this, res = requests.post('http://admin:pass@...
user18862346