/Python/Python scrape data from aspx page

Python scrape data from aspx page

#pip install requests
#pip install lxml
#pip install bs4
import requests
from bs4 import BeautifulSoup

r_obj = requests.Session()
url = "aspx_website_url_here" # i.e. http://bisegrw.edu.pk/
r_soup = r_obj.get(url)
soup = BeautifulSoup(r_soup.content , "lxml")

hidden_inputs = soup.find_all("input",type="hidden")

data = {
hidden_inputs[0]['name']:hidden_inputs[0]['value'],
hidden_inputs[1]['name']:hidden_inputs[1]['value'],
hidden_inputs[2]['name']:hidden_inputs[2]['value'],
'other_input':'value',  # i.e. 'rno':'487431',
'submitButton':'submit'}

url_needed = "aspx_endpoint" # i.e. http://bisegrw.edu.pk/result-card-matric.html
final = r_obj.post(url_needed,verify=False,data=data)
soup1 = BeautifulSoup(final.content,"lxml")
detail_tab = soup1.find_all("table")

Similar codes

14 votes293 views3 answers
Python tkinter define window size
Python
19 votes266 views1 answer
Python substring from end
Python
0 vote271 views1 answer
Malware with python
Python
0 vote266 views1 answer
Set dtype for multiple columns pandas
Python
-2 votes263 views2 answers
Entered_text_1 = textbox_1.get(1.0, tk.END+"-1c")
Python
0 vote316 views1 answer
Sessions in flask
Python Flask
0 vote259 views1 answer
Display multiple dataframe as table jupyter notebook
Python
0 vote284 views1 answer
Python how to count number of true
Python
1 vote255 views1 answer
How to remove none in python
Python
0 vote310 views1 answer
Read dict from text
Python