/Python/How to know google index of a page using python

How to know google index of a page using python

import requests
import pandas as pd
import time
from bs4 import BeautifulSoup
from urllib.parse import urlencode

seconds = 3
proxies = {
    'https' : 'https://localhost:8123',
    'http' : 'http://localhost:8123'
    }

user_agent = 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/48.0.2564.116 Safari/537.36'
headers = { 'User-Agent' : user_agent}

df = pd.read_excel('url_links.xlsx')
for i in range(0, len(df)):
    line = df.loc[i,'links']
    #print(line)
    if line:
        query = {'q': 'site:' + line}
        google = "https://www.google.com/search?" + urlencode(query)
        data = requests.get(google, headers=headers)
        data.encoding = 'ISO-8859-1'
        soup = BeautifulSoup(str(data.content), "html.parser")
        try:
            check = soup.find(id="rso").find("div").find("div").find("div").find("div").find("div").find("a")["href"]
            print("URL is Index ")
        except AttributeError:
            print("URL Not Index")
        time.sleep(float(seconds))
    else:
        print("Invalid Url")

Source: stackoverflow.com

Similar codes

8 votes154 views1 answer
How to do collision detection in pygame
Python
8 votes171 views1 answer
Charmap codec can't encode character
Python
0 vote160 views1 answer
How to redirect where requests library downloads file python
Python
0 vote162 views3 answers
Python unittest mock
Python
11 votes174 views6 answers
How to check the size of a file in python
Python
0 vote153 views1 answer
Python load a txt file and assign a variable
Python
5 votes166 views3 answers
Python convert list to list of strings
Python
3 votes173 views2 answers
Multiply all values in column pandas
Python
0 vote166 views2 answers
Read image from a folder python
Python
34 votes160 views3 answers
How to install pyaudio in python
Python