/Python/List files in http directory python

List files in http directory python

import requests
from bs4 import BeautifulSoup

def get_url_paths(url, ext='', params={}):
    response = requests.get(url, params=params)
    if response.ok:
        response_text = response.text
    else:
        return response.raise_for_status()
    soup = BeautifulSoup(response_text, 'html.parser')
    parent = [url + node.get('href') for node in soup.find_all('a') if node.get('href').endswith(ext)]
    return parent

url = 'http://cdimage.debian.org/debian-cd/8.2.0-live/i386/iso-hybrid'
ext = 'iso'
result = get_url_paths(url, ext)
print(result)

Source: stackoverflow.com

Similar codes

0 vote277 views1 answer
Remove ï»¿ python
Python
1 vote246 views1 answer
How to scroll down to end of page in selenium python
Python
0 vote277 views1 answer
Set_flip_h( false )
Python
0 vote279 views1 answer
Rotch randn
Python
0 vote255 views1 answer
While importing we detected an older version of numpy in
Python
0 vote256 views1 answer
Studygyaan python everywhere - host on heroku
Python
11 votes273 views5 answers
Python sorted lambda
Python
0 vote247 views1 answer
Converting string key to int py
Python
0 vote285 views1 answer
Bfs in python 3
Python
4 votes261 views1 answer
Python format only 1 decimal place
Python