[20131226]linux下使用pigz高效傳輸檔案.txt

[20131226]linux下使用pigz高效傳輸檔案.txt



pigz, which stands for parallel implementation of gzip, is a fully functional replacement for gzip that exploits
multiple processors and multiple cores to the hilt when compressing data. pigz was written by Mark Adler, and uses the
zlib and pthread libraries. To compile and use pigz, please read the README file in the source code distribution. You
can read the pigz manual page here.

以前自己也測試過,tar+pigz確實非常快.

http://blog.itpub.net/267265/viewspace-752461/

今天要克隆機器,要傳輸檔案從新機器,我使用如下:

我使用的linux版本是centos 6.2,pigz從這裡下載:


#  rpm -qa | grep pigz
pigz-2.1.6-1.el6.rf.x86_64


使用命令如下:
tar cvf - oracle -I pigz | ssh oracle@ip_address "( cd /u01/app/ ; tar xvf - -I pigz )"
or
tar cvf - oracle -I pigz | ssh oracle@ip_address tar xvf - -I pigz -C /u01/app/
--注意cvf 後面的-,千萬不要忘記寫!
--注意xvf 後面的-,千萬不要忘記寫!

--我拿pigz與lzop做了對比,明顯pigz快許多.當然如果你網路不行,使用pigz會影響正常的業務.