/Python/How to know google index of a page using python

How to know google index of a page using python

import requests
import pandas as pd
import time
from bs4 import BeautifulSoup
from urllib.parse import urlencode

seconds = 3
proxies = {
    'https' : 'https://localhost:8123',
    'http' : 'http://localhost:8123'
    }

user_agent = 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36'
headers = { 'User-Agent' : user_agent}

df = pd.read_excel('url_links.xlsx')
for i in range(0, len(df)):
    line = df.loc[i,'links']
    #print(line)
    if line:
        query = {'q': 'site:' + line}
        google = "https://www.google.com/search?" + urlencode(query)
        data = requests.get(google, headers=headers)
        data.encoding = 'ISO-8859-1'
        soup = BeautifulSoup(str(data.content), "html.parser")
        try:
            check = soup.find(id="rso").find("div").find("div").find("div").find("div").find("div").find("a")["href"]
            print("URL is Index ")
        except AttributeError:
            print("URL Not Index")
        time.sleep(float(seconds))
    else:
        print("Invalid Url")

Source: stackoverflow.com

Similar codes

0 vote256 views1 answer
Packing and unpacking in python
Python
0 vote261 views1 answer
How to log errors while debug is false in django
Python Django
0 vote242 views1 answer
Django file upload this field is required
Python Django
0 vote256 views1 answer
Get ip address in django
Python Django
0 vote264 views1 answer
Get all view port type dynamo revit
Python
0 vote239 views1 answer
Gamma distribution python normalized
Python
1 vote230 views1 answer
How to find python location in cmd
Python
0 vote238 views1 answer
Pandas 3d set camara cords
Python
0 vote228 views1 answer
Test with python
Python
0 vote309 views1 answer
Python send sigint to subprocess
Python