/Python/How to know google index of a page using python

How to know google index of a page using python

import requests
import pandas as pd
import time
from bs4 import BeautifulSoup
from urllib.parse import urlencode

seconds = 3
proxies = {
    'https' : 'https://localhost:8123',
    'http' : 'http://localhost:8123'
    }

user_agent = 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36'
headers = { 'User-Agent' : user_agent}

df = pd.read_excel('url_links.xlsx')
for i in range(0, len(df)):
    line = df.loc[i,'links']
    #print(line)
    if line:
        query = {'q': 'site:' + line}
        google = "https://www.google.com/search?" + urlencode(query)
        data = requests.get(google, headers=headers)
        data.encoding = 'ISO-8859-1'
        soup = BeautifulSoup(str(data.content), "html.parser")
        try:
            check = soup.find(id="rso").find("div").find("div").find("div").find("div").find("div").find("a")["href"]
            print("URL is Index ")
        except AttributeError:
            print("URL Not Index")
        time.sleep(float(seconds))
    else:
        print("Invalid Url")

Source: stackoverflow.com

Similar codes

0 vote327 views1 answer
Python readlines end of file
Python
0 vote323 views1 answer
Python convert string to byte array
Python
0 vote353 views1 answer
Cloud Build Quickstart
Python
41 votes342 views5 answers
UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 92: character maps to <undefined>
Python
7 votes458 views3 answers
Spacy en_core_web_sm error
Python
0 vote363 views1 answer
Use latest file on aws s3 bucket python
Python
-1 vote281 views1 answer
Import url
Python
2 votes405 views1 answer
Flask session timeout
Python Flask
3 votes328 views1 answer
Get python directiory
Python
1 vote341 views1 answer
Python send object reference to another function and edit property
Python