wget:命令行下载工具
简介wget命令用于从网络上下载某些资源,该命令对于能够连接到互联网的Linux系统的作用非常大,可以直接从网络上下载自己所需要的文件。
说明
wget命令用于从网络上下载某些资源,该命令对于能够连接到互联网的Linux系统的作用非常大,可以直接从网络上下载自己所需要的文件。
wget的特点如下:
支持断点下载功能;
- 支持ftp额http下载方式;
- 支持代理服务器;
- 非常稳定,他在带宽很窄的情况下或不稳定的网络中都很强的适应性。如果由于网络原因下载失败,wget会不断的尝试,直到整个文件都下载完。如果服务打断了下载过程,他会再次连接到服务器上从停止的地方继续下载。这对那些从限定了连接时间的服务器上下载大文件非常有用。
格式
wget [option] [url]
常用参数
- -o:将命令的执行结果写入到文件中
- -O:指定保存的文件名后下载文件
- —limit-rate:限速下载
- -b:转入后台执行命令
- -c:断点续传
- —user-agent:指定客户端标志
- -q:关闭下载时的输出
- —tries=number:设置重试次数
- —spider:模拟爬虫访问
- -T seconds:设置访问超时时间
- -P:指定下载文件的保存目录
示例
1、下载单个文件
[root@localhost ~]# wget http://download.redis.io/releases/redis-4.0.9.tar.gz
--2018-06-20 04:50:09-- http://download.redis.io/releases/redis-4.0.9.tar.gz
Resolving download.redis.io (download.redis.io)... 109.74.203.151
Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1737022 (1.7M) [application/x-gzip]
Saving to: ‘redis-4.0.9.tar.gz’
100%[===================================================================================================================================================>] 1,737,022 296KB/s in 6.2s
2018-06-20 04:50:16 (275 KB/s) - ‘redis-4.0.9.tar.gz’ saved [1737022/1737022]
[root@localhost ~]#
2、使用-O选项指定下载文件的保存文件名
[root@localhost ~]# wget -O redis_new.tar.gz http://download.redis.io/releases/redis-4.0.9.tar.gz
--2018-06-20 04:52:18-- http://download.redis.io/releases/redis-4.0.9.tar.gz
Resolving download.redis.io (download.redis.io)... 109.74.203.151
Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1737022 (1.7M) [application/x-gzip]
Saving to: ‘redis_new.tar.gz’
100%[===================================================================================================================================================>] 1,737,022 42.8KB/s in 26s
2018-06-20 04:52:44 (66.0 KB/s) - ‘redis_new.tar.gz’ saved [1737022/1737022]
[root@localhost ~]# ll redis_new.tar.gz
-rw-r--r--. 1 root root 1737022 Mar 26 12:04 redis_new.tar.gz
3、限速下载(—limit-rate)
[root@localhost ~]# wget --limit-rate=3k http://download.redis.io/releases/redis-4.0.9.tar.gz
--2018-06-20 04:54:25-- http://download.redis.io/releases/redis-4.0.9.tar.gz
Resolving download.redis.io (download.redis.io)... 109.74.203.151
Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1737022 (1.7M) [application/x-gzip]
Saving to: ‘redis-4.0.9.tar.gz.1’
5% [======> ] 87,291 3.00KB/s eta 8m 57s
4、断点续传(-c)
[root@localhost ~]# wget -c http://download.redis.io/releases/redis-4.0.9.tar.gz
--2018-06-20 04:56:10-- http://download.redis.io/releases/redis-4.0.9.tar.gz
Resolving download.redis.io (download.redis.io)... 109.74.203.151
Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1737022 (1.7M) [application/x-gzip]
Saving to: ‘redis-4.0.9.tar.gz’
8% [===========> ] 148,987 57.6KB/s ^C #强制终止
[root@localhost ~]# wget -c http://download.redis.io/releases/redis-4.0.9.tar.gz #继续下载
--2018-06-20 04:56:16-- http://download.redis.io/releases/redis-4.0.9.tar.gz
Resolving download.redis.io (download.redis.io)... 109.74.203.151
Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 1737022 (1.7M), 1567203 (1.5M) remaining [application/x-gzip]
Saving to: ‘redis-4.0.9.tar.gz’
20% [++++++++++++++===============> ] 359,852 47.7KB/s eta 26s ^C
[root@localhost ~]# wget -c http://download.redis.io/releases/redis-4.0.9.tar.gz
--2018-06-20 04:56:22-- http://download.redis.io/releases/redis-4.0.9.tar.gz
Resolving download.redis.io (download.redis.io)... 109.74.203.151
Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected.
HTTP request sent, awaiting response... 206 Partial Content
Length: 1737022 (1.7M), 1356170 (1.3M) remaining [application/x-gzip]
Saving to: ‘redis-4.0.9.tar.gz’
25% [++++++++++++++++++++++++++++++++=====> ] 446,845 43.2KB/s ^C
5、使用wget -b后台下载文件
[root@localhost ~]# wget -b http://download.redis.io/releases/redis-4.0.9.tar.gz
Continuing in background, pid 2641.
Output will be written to ‘wget-log’.
[root@localhost ~]# tail wget-log
Saving to: ‘redis-4.0.9.tar.gz.2’
0K .......... .......... .......... .......... .......... 2% 44.7K 37s
50K .......... .......... .......... .......... .......... 5% 57.7K 32s
100K .......... .......... .......... .......... .......... 8% 40.2K 33s
150K .......... .......... .......... .......... .......... 11% 48.7K 32s
200K .......... .......... .......... .......... .......... 14% 34.7K 33s
250K .......... .......... .......... .......... .......... 17% 39.9K 32s
300K .......... .......... .......... .......... .......... 20% 32.0K 33s
[root@localhost ~]# tail wget-log
1350K .......... .......... .......... .......... .......... 82% 58.1K 7s
1400K .......... .......... .......... .......... .......... 85% 58.7K 6s
1450K .......... .......... .......... .......... .......... 88% 35.5K 4s
1500K .......... .......... .......... .......... .......... 91% 44.9K 3s
1550K .......... .......... .......... .......... .......... 94% 55.7K 2s
1600K .......... .......... .......... .......... .......... 97% 44.1K 1s
1650K .......... .......... .......... .......... ...... 100% 55.0K=38s
2018-06-20 04:58:37 (44.7 KB/s) - ‘redis-4.0.9.tar.gz.2’ saved [1737022/1737022]
6、伪装代理名称下载(—user-agent)
[root@localhost ~]# wget --user-agent="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36" http://download.redis.io/releases/redis-4.0.9.tar.gz
--2018-06-20 05:01:32-- http://download.redis.io/releases/redis-4.0.9.tar.gz
Resolving download.redis.io (download.redis.io)... 109.74.203.151
Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1737022 (1.7M) [application/x-gzip]
Saving to: ‘redis-4.0.9.tar.gz.3’
100%[===================================================================================================================================================>] 1,737,022 43.1KB/s in 25s
2018-06-20 05:01:58 (67.0 KB/s) - ‘redis-4.0.9.tar.gz.3’ saved [1737022/1737022]
7、监控网站URL是否正常
[root@localhost ~]# wget -q -T 3 --tries=1 --spider www.hi917.com #采用静默访问方式,3秒超时,重试1次,模拟爬虫的方式进行访问
[root@localhost ~]# echo $?
0
#返回0表示正常
8、指定下载文件的保存目录
[root@localhost ~]# wget -P /tmp/ http://download.redis.io/releases/redis-4.0.9.tar.gz #这里我们将下载的文件保存到/tmp目录下
--2018-10-08 19:18:25-- http://download.redis.io/releases/redis-4.0.9.tar.gz
Resolving download.redis.io (download.redis.io)... 109.74.203.151
Connecting to download.redis.io (download.redis.io)|109.74.203.151|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1737022 (1.7M) [application/x-gzip]
Saving to: ‘/tmp/redis-4.0.9.tar.gz’ #这里就可以看出保存的位置
网页扫描二维码库:Html5-Qrcode,官网地址:https://scanapp.org/html5-qrcode-docs/
nodejs中使用npm和yarn,使用最新阿里云镜像 aliyun mirror,网上很多还是文章用的是下面这个地址~~yarn config set registry https://registry.npm.taobao.org~~
《康熙王朝》是一部非常优秀的电视连续剧,陈道明演的康熙是我觉得最有帝王气魄,让人意犹未尽,本文主要记录一小段非常经典的对白。
HI博客上线啦!这一刻不知道等待了多少年,做为以为技术开发人员,没有自己的博客怎么能行呢!最近利用换工作的空余的时间,为自己搭建了该博客,也在自己人生中很重要的日子上线了该博客。也希望该博客能将自己在工作中比较好的技术整理成文章和一些其他比较好文章转载过来,为需要用到相关技术的同行提供有用的帮助。还希望以后大家能指出相关文章中出现的错误,让看到相关博文的人受益,别被我的个人错误而误导他人。
默认情况下 pip 使用的是国外的镜像,在下载的时候速度非常慢,本文我们介绍使用国内源对pip进行加速。
快速生成表格
Electron页面跳转、浏览器打开链接和打开新窗口
Docker编译镜像出现:fetch http://dl-cdn.alpinelinux.org/alpine/v3.12/main/x86_64/APKINDEX.tar.gz
ERROR: http://dl-cdn.alpinelinux.org/alpine/v3.12/main: temporary error (try again later)
WARNING: Ignoring APKINDEX.2c4ac24e.tar.gz: No such file or directory问题
在Mac电脑中,如何对Git的用户名和密码进行修改呢?起初不懂Mac,所以整了很久,本文将记录如何对这个进行操作,以便后期使用。
在使用Git的过程中,不想每次都输入用户名和密码去拉取代码,所以就需要保存这些信息,那么既然有保存了,就必须有清除功能。