/Python/List files in http directory python

List files in http directory python

import requests
from bs4 import BeautifulSoup

def get_url_paths(url, ext='', params={}):
    response = requests.get(url, params=params)
    if response.ok:
        response_text = response.text
    else:
        return response.raise_for_status()
    soup = BeautifulSoup(response_text, 'html.parser')
    parent = [url + node.get('href') for node in soup.find_all('a') if node.get('href').endswith(ext)]
    return parent

url = 'http://cdimage.debian.org/debian-cd/8.2.0-live/i386/iso-hybrid'
ext = 'iso'
result = get_url_paths(url, ext)
print(result)

Source: stackoverflow.com

Similar codes

1 vote221 views1 answer
List methods in python
Python
0 vote260 views1 answer
How to add new column in csv file using pandas
Python
0 vote274 views2 answers
The module in NAME could not be imported: django.contrhtmlib.auth.password_validation.UserAttributeSimilarityValidator. Check your AUTH_PASSWORD_VALIDATORS setting.
Python Django
0 vote218 views1 answer
How to get input from pyqt line edit
Python
9 votes256 views2 answers
Python: remove specific values in a dataframe
Python
4 votes223 views4 answers
Get file parent directory python
Python
0 vote237 views2 answers
How to take input for list in one line in python
Python
0 vote232 views1 answer
How to sort dataframe in python by length of groups
Python
0 vote242 views1 answer
Change matplotlib fontsize
Python
0 vote212 views1 answer
Split dat file into datafram in python
Python