[Ilugc] [OT] need of libraries for exploring websites (Python/PERL)

  • From: rajasuperman@xxxxxxxxx (Raja Subramanian)
  • Date: Mon Dec 29 18:30:51 2008

On Mon, Dec 29, 2008 at 5:34 PM, kish <realmailer@xxxxxxxxx> wrote:

I wish to download a bunch of files from a site which allows directory
listing
with links like
...
After which I can apply a filter to extract only those I need and pass
the list to wget or the like

wget can probably do everything you are looking for.

Recursively fetch files (use with caution):
    http://www.gnu.org/software/wget/manual/wget.html#Recursive-Download

Use the include/exclude filters to selectively download files.

- Raja

Other related posts: