/Python/List files in http directory python

List files in http directory python

import requests
from bs4 import BeautifulSoup

def get_url_paths(url, ext='', params={}):
    response = requests.get(url, params=params)
    if response.ok:
        response_text = response.text
    else:
        return response.raise_for_status()
    soup = BeautifulSoup(response_text, 'html.parser')
    parent = [url + node.get('href') for node in soup.find_all('a') if node.get('href').endswith(ext)]
    return parent

url = 'http://cdimage.debian.org/debian-cd/8.2.0-live/i386/iso-hybrid'
ext = 'iso'
result = get_url_paths(url, ext)
print(result)

Source: stackoverflow.com

Similar codes

0 vote111 views1 answer
Pandas pull value from column
Python
60 votes111 views6 answers
Translate french to english
Python
4 votes136 views3 answers
Pip clear cache command
Python
0 vote124 views1 answer
Tkinter get child in frame
Python
31 votes125 views3 answers
How to adda vaslues to data frame
Python
2 votes75 views1 answer
Python split string at index
Python
0 vote116 views1 answer
Triplets in python
Python
0 vote108 views2 answers
A guide to numpy and pandas
Python
11 votes120 views1 answer
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe2 in position 10: invalid continuation byte
Python
0 vote112 views1 answer
Plt.clear
Python