Advanced

Httpmirror Publisher Description

You are at work. Your network admin uses restrictive firewall rules. You can't use rsync or ftp to create a local mirror of your favorite Linux distribution. Your only door to Linux mirrors is through http. What to do?

I took this as an opportunity to brush up on my rusty python scripting skills and cobbled together httpmirror.

httpmirror is a roughly made script that lets you mirror linux distributions. There are two main functionalities provided by httpmirror:

Recursively download all the files from a Linux http mirror.

Recursively download a list of all the files from a Linux http mirror.

Recursive downloading of files is experimental so use this if you have a very reliable connection and you feel adventurous. Having said that, resuming works here whereas it doesn't when you are only creating a list of files.

Alternatively you might want to only generate a list of files to download and then feed that list to your favorite download program. This is the recommended way.

To get a better picture of what you can do with httpmirror here is the output from httpmirror if you don't provide any command-line arguments

a@a:~/Desktop/python-to-go$ ./httpmirror.py Usage: httpmirror.py [options] Options: -h, --help show this help message and exit -x NOLIST a comma-separated list of words that should be avoided -m URL The base url. This will download all the files -l URLLIST The base url. This will only save the list of files -o FILE The file output should you decide to only download the file list

The -x option allows the use of exceptions. Oftentimes you need to exclude certain files/directories from being fetched. For example if you are only interested in the i386 arch distribution and want to exclude amd64, sparc, and powerpc you'd add the following '-x amd64,sparc,powerpc'

You MUST specify either -m with a url or -l with a url.

The -o option is optional and only useful if you want to generate a list of files to download and you want to specify a custom file name. The default is out.txt

To use a proxy server the 'http_proxy' environment variable must be set. (in linux you'd enter 'export http_proxy=http://myproxy:port').

Options

Top Downloads

To embed the Top Downloads list on your blog or website simply copy the HTML code below:

<a href='http://google-chrome.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/64123.jpg' width='16' height='16' border='0' />Google Chrome</a><br /><a href='http://opera.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/2580.gif' width='16' height='16' border='0' />Opera</a><br /><a href='http://mozilla-firefox.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/9401.gif' width='16' height='16' border='0' />Mozilla Firefox</a><br /><a href='http://yahoo-messenger.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/1214.gif' width='16' height='16' border='0' />Yahoo! Messenger</a><br /><a href='http://msn-messenger.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/1494.gif' width='16' height='16' border='0' />MSN Messenger</a><br /><a href='http://trillian.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58798.gif' width='16' height='16' border='0' /> Trillian</a><br /><a href='http://aim.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58872.gif' width='16' height='16' border='0' />AIM</a><br /><a href='http://skype.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/56167.gif' width='16' height='16' border='0' /> Skype</a><br /><a href='http://ad-aware.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58889.gif' width='16' height='16' border='0' />Ad-Aware</a><br /><a href='http://mozilla-thunderbird.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/19497.png' width='16' height='16' border='0' />Mozilla Thunderbird</a><br /><a href='http://nero-burning-rom.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/1061.gif' width='16' height='16' border='0' />Nero</a><br /><a href='http://google-earth.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58843.gif' width='16' height='16' border='0' />Google Earth</a><br /><a href='http://picasa.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/19638.png' width='16' height='16' border='0' />Picasa</a><br /><a href='http://winamp.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/8548.GIF' width='16' height='16' border='0' />Winamp</a><br /><a href='http://itunes.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58811.jpg' width='16' height='16' border='0' />iTunes</a><br /><a href='http://realplayer.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58815.gif' width='16' height='16' border='0' /> RealPlayer</a><br /><a href='http://utorrent.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58871.gif' width='16' height='16' border='0' />uTorrent</a><br /><a href='http://limewire.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/1208.GIF' width='16' height='16' border='0' />LimeWire Basic</a><br /><a href='http://emule.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/15722.GIF' width='16' height='16' border='0' />eMule</a><br /><a href='http://bitcomet.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/57835.png' width='16' height='16' border='0' />BitComet</a><br /><a href='http://winrar.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/634.gif' width='16' height='16' border='0' />WinRAR</a><br /><a href='http://winzip.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/630.gif' width='16' height='16' border='0' />WinZip</a><br /><a href='http://frostwire.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/57887.gif' width='16' height='16' border='0' /> FrostWire</a><br /><a href='http://shareaza.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/57883.gif' width='16' height='16' border='0' />Shareaza</a><br /><a href='http://ccleaner.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58849.gif' width='16' height='16' border='0' /> CCleaner</a><br /><a href='http://recuva.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58834.gif' width='16' height='16' border='0' /> Recuva</a><br /><a href='http://tweak-ui.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/58903.gif' width='16' height='16' border='0' />Tweak UI</a><br /><a href='http://cuteftp.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/46.png' width='16' height='16' border='0' />CuteFTP Home</a><br /><a href='http://flashget.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/1670.gif' width='16' height='16' border='0' />FlashGet</a><br /><a href='http://daemon-tools.findmysoft.com/'><img src='http://findmysoft.cachefly.net/img/ico/19619.jpg' width='16' height='16' border='0' />DAEMON Tools</a><br />

Link to us:

HTML code for linking to Httpmirror

Reviews

New Software

Copyright © FindMySoft.com 2006-2008
7.589 s