/Python/How to know google index of a page using python

How to know google index of a page using python

import requests
import pandas as pd
import time
from bs4 import BeautifulSoup
from urllib.parse import urlencode

seconds = 3
proxies = {
    'https' : 'https://localhost:8123',
    'http' : 'http://localhost:8123'
    }

user_agent = 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36'
headers = { 'User-Agent' : user_agent}

df = pd.read_excel('url_links.xlsx')
for i in range(0, len(df)):
    line = df.loc[i,'links']
    #print(line)
    if line:
        query = {'q': 'site:' + line}
        google = "https://www.google.com/search?" + urlencode(query)
        data = requests.get(google, headers=headers)
        data.encoding = 'ISO-8859-1'
        soup = BeautifulSoup(str(data.content), "html.parser")
        try:
            check = soup.find(id="rso").find("div").find("div").find("div").find("div").find("div").find("a")["href"]
            print("URL is Index ")
        except AttributeError:
            print("URL Not Index")
        time.sleep(float(seconds))
    else:
        print("Invalid Url")

Source: stackoverflow.com

Similar codes

5 votes251 views1 answer
How to search for a specific file extension with python
Python
0 vote268 views1 answer
Django add to database
Python
0 vote259 views1 answer
Python discord if == emoji not working
Python
0 vote280 views1 answer
Ms access python dataframe
Python
1 vote251 views1 answer
How to convert ton to kg using python
Python
0 vote308 views1 answer
Get admin url of instance django
Python Django
28 votes255 views2 answers
Python print without new lines
Python
0 vote268 views1 answer
Fernet generate key from password
Python
0 vote271 views1 answer
Sorts this RDD, which is assumed to consist of (key, value) pairs
Python
7 votes266 views1 answer
How to get user location in python
Python