From: http:\/\/www.cyberciti.biz\/tips\/download-accelerator-for-linux-command-line-tools.html
\nLinux ultra fast command line download accelerator<\/p>\n
Usually I use wget, which is ultimate command line downloader. However, wget failed to accelerate my download speed. I was downloading 1.4GB file around 800KB\/s download speed (this box is hooked to uplink port speed 10 Mbps ). However, remote server was restricting me.<\/p>\n
Therefore, I decided to get rid of wget. I have downloaded axel – a light download accelerator for Linux command line.
\nHow Axel works?<\/p>\n
Axel does the same thing any other accelerator does: it opens more than one HTTP\/FTP connection per download and each connection transfers its own, separate, part of the file. It may sound weird, but it works very well in practice. For example, some FTP sites limit the speed of each connection, therefore opening more than one connection at a time multiplies the allowable bandwidth. Be forewarned that some FTP operators don’t like it when you do this. It is better to open the additional connections on several servers and download from all of them simultaneously. Axel supports this feature too. You may either specify a list of mirrors to use or tell the program to search for mirrors.<\/p>\n
This is a perfect tool over remote ssh session for downloading large file.
\nInstall axel<\/p>\n
If you are using Debian, type the following command to install axel:
\n# apt-get install axel<\/p>\n
Or you can download axel from official website:
\n$ wget http:\/\/wilmer.gaast.net\/downloads\/axel-1.0b.tar.gz<\/p>\n
Untar the axel:
\n$ tar -zxvf axel-1.0b.tar.gz<\/p>\n
Configre and compile axel:
\n$ .\/configure<\/p>\n
Install axel:
\n# make install<\/p>\n
On the other hand, just upload a newly build axel binary to remote Linux server using scp. Usually I do not install gcc c\/c++ compilers collection on any of my production web\/ftp\/MySql servers for security reasons.
\nHow do I use axel?<\/p>\n
Just type the command as follows:
\n$ axel http:\/\/download.com\/file.tar.gz<\/p>\n
Limit speed
\nYou can also specify a speed (bytes per sec) for axel so that it will not eat up all your bandwidth. For example following will try to keep the average speed around 5242880 (5120 Kilobyte per\/sec):
\n$ axel -s 5242880 http:\/\/download.com\/my.iso<\/p>\n
Limit a number of connection
\nYou can also specify number of connection you want to open. For example open 3 connections for downloading:
\n$ axel -n 3 -s 5242880 http:\/\/download.com\/my.iso
\nBut how fast is axel?<\/p>\n
Here is sample test that demonstrates how fast is axel<\/p>\n
$ wget http:\/\/kernel.org\/pub\/linux\/kernel\/v2.6\/linux-2.6.17.11.tar.bz2<\/p>\n
Output:<\/p>\n
–12:10:31– http:\/\/kernel.org\/pub\/linux\/kernel\/v2.6\/linux-2.6.17.11.tar.bz2
\n => `linux-2.6.17.11.tar.bz2′
\nResolving kernel.org… 204.152.191.5, 204.152.191.37
\nConnecting to kernel.org|204.152.191.5|:80… connected.
\nHTTP request sent, awaiting response… 200 OK
\nLength: 41,288,067 (39M) [application\/x-bzip2]<\/p>\n
100%[================================================================================>] 41,288,067 2.33M\/s ETA 00:00<\/p>\n
12:10:48 (2.31 MB\/s) – `linux-2.6.17.11.tar.bz2′ saved [41288067\/41288067]<\/p>\n
$ axel http:\/\/kernel.org\/pub\/linux\/kernel\/v2.6\/linux-2.6.17.11.tar.bz2<\/p>\n
Output:<\/p>\n
Initializing download: http:\/\/kernel.org\/pub\/linux\/kernel\/v2.6\/linux-2.6.17.11.tar.bz2
\nFile size: 41288067 bytes
\nOpening output file linux-2.6.17.11.tar.bz2.1
\nStarting download<\/p>\n
[ 0%] ………. ………. ………. ………. ………. [ 247.1KB\/s]
\n[ 0%] ………. ………. ………. ………. ………. [ 408.3KB\/s]
\n[ 0%] ………. ………. ………. ………. ………. [ 566.3KB\/s]
\n[ 0%] ………. ………. ………. ………. ………. [ 707.2KB\/s]
\n[ 0%] ………. ………. ………. ………. ………. [ 836.5KB\/s]
\n[ 0%] ………. ………. ………. ………. ………. [ 975.9KB\/s]
\n[ 0%] ………. ………. ………. ………. ………. [1079.9KB\/s]
\n[ 0%] ………. ………. ………. ………. ………. [1210.0KB\/s]
\n[ 0%] ………. ………. ………. ………. ………. [1303.1KB\/s]
\n[ 1%] ………. ………. ………. ………. ………. [1422.1KB\/s]
\n[ 1%] ………. ………. ………. ………. ………. [1508.0KB\/s]
\n[ 1%] ………. ………. ………. ………. ………. [1629.2KB\/s]
\n……….
\n…
\n….
\n[ 99%] ………. ………. ………. ………. ………. [8710.2KB\/s]
\n[ 99%] ………. ………. ………. ………. ………. [8680.7KB\/s]
\n[100%] ………. ……….<\/p>\n
Downloaded 39.4 megabytes in 4 seconds. (8681.65 KB\/s)<\/p>\n
As you see axel downloaded same file in 4 seconds. Another great thing its binary size, I can put axel on boot disk and replace a wget.<\/p>\n","protected":false},"excerpt":{"rendered":"
From: http:\/\/www.cyberciti.biz\/tips\/download-accelerator-for-linux-command-line-tools.html Linux ultra fast command line download accelerator Usually I use wget, which is ultimate command line downloader. However, wget failed to accelerate my download speed. I was downloading 1.4GB file around 800KB\/s download speed (this box is hooked to uplink port speed 10 Mbps ). However, remote server was restricting me. Therefore, I… <\/p>\n