/Python/List files in http directory python

List files in http directory python

import requests
from bs4 import BeautifulSoup

def get_url_paths(url, ext='', params={}):
    response = requests.get(url, params=params)
    if response.ok:
        response_text = response.text
    else:
        return response.raise_for_status()
    soup = BeautifulSoup(response_text, 'html.parser')
    parent = [url + node.get('href') for node in soup.find_all('a') if node.get('href').endswith(ext)]
    return parent

url = 'http://cdimage.debian.org/debian-cd/8.2.0-live/i386/iso-hybrid'
ext = 'iso'
result = get_url_paths(url, ext)
print(result)

Source: stackoverflow.com

Similar codes

-2 votes312 views2 answers
Extract directory python
Python
16 votes341 views5 answers
Python manage.py collectstatic
Python
0 vote330 views1 answer
Django MESSAGE_TAGS
Python
1 vote396 views1 answer
Django class based views ListView
Python Django
-1 vote311 views1 answer
Web browser api python
Python
0 vote342 views1 answer
Discord py how to ban everyone
Python
1 vote305 views1 answer
Change shortcuts in pychar,
Python
8 votes317 views1 answer
ValueError: invalid literal for int() with base 10: site:stackoverflow.com
Python
0 vote381 views1 answer
Flask windows auto reload
Python Flask
18 votes335 views6 answers
Pd.set_option('display.max_columns' none)
Python