CentOS大資料實驗環境更改記錄

Profeel發表於2016-01-17
CentOS大資料

CentOS大資料實驗環境更改記錄

標籤（空格分隔）： 未分類

1.修改163的yum源

使用說明

首先備份/etc/yum.repos.d/CentOS-Base.repo

mv /etc/yum.repos.d/CentOS-Base.repo /etc/yum.repos.d/CentOS-Base.repo.backup

下載對應版本repo檔案, 放入/etc/yum.repos.d/(操作前請做好相應備份)

CentOS6

執行以下命令生成快取

yum clean all
yum makecache

2.更新python從2.6.6版本為2.7

#wget http://www.python.org/ftp/python/2.7.5/Python-2.7.5.tar.bz2
#tar jxvf Python-2.7.5.tar.bz2
#cd Python-2.7.5
#./configure --prefix=/usr/local 
#make && make altinstall 
#mv /usr/bin/python /usr/bin/python2.6.6
#ln -s /usr/local/bin/python2.7 /usr/bin/python

3.安裝pip
1）安裝setuptools
解壓安裝遇到錯誤
RuntimeError: Compression requires the (missing) zlib module

yum install zlib& zilib devel

然後遇到yum因為python版本不對錯誤錯誤：

[root@localhost bin]# yum install pip
There was a problem importing one of the Python modules
required to run yum. The error leading to this problem was:

   No module named yum

Please install a package which provides this module, or
verify that the module is installed correctly.

It`s possible that the above module doesn`t match the
current version of Python, which is:
2.7.3 (default, Jan 16 2016, 05:59:11) 
[GCC 4.4.6 20120305 (Red Hat 4.4.6-4)]

If you cannot solve this problem yourself, please go to 
the yum faq at:
  http://yum.baseurl.org/wiki/Faq

查詢yum檔案,並編輯此py檔案

[root@develop local]# which yum
/usr/bin/yum
[root@develop local]# vi /usr/bin/yum

將
#!/usr/bin/python
改為:
#!/usr/bin/python2.6

然後儲存OK.

補充：yum基於python寫的。

4.安裝zlib&zlib-devel
重新編譯python
/.configure
make
make install
然後重新安裝setuptools

5.遇到wangqi is not in the sudoers file.

#visudo
## Allow root to run any commands anywhere
root    ALL=(ALL)       ALL
wangqi  ALL=(ALL)       ALL

6.遇到ImportError: cannot import name HTTPSHandler
yum install openssl openssl-devel -y
之後，再重新安裝Python即可。
/.configure
make
make install

7.pip安裝完成
8.安裝numpy,
9.安裝pandas
出現問題：
UnicodeDecodeError: `ascii` codec can`t decode byte 0xe2 in position 32: ordinal not in range(128)
解決方法：
修改mimetypes.py檔案，路徑位於python的安裝路徑下的Libmimetypes.py檔案。在import下新增如下幾行：

if sys.getdefaultencoding() != `gbk`: 
    reload(sys) 
    sys.setdefaultencoding(`gbk`)

依然報錯：

gcc: error trying to exec `cc1plus`: execvp: No such file or directory

error: command `gcc` failed with exit status 1

嘗試解決：
yum -y install gcc

依然報錯：

Command /usr/local/bin/python -c "import setuptools, tokenize;__file__=`/tmp/pip_build_root/pandas/setup.py`;exec(compile(getattr(tokenize, `open`, open)(__file__).read().replace(`
`, `
`), __file__, `exec`))" install --record /tmp/pip-5RbGXm-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip_build_root/pandas
Traceback (most recent call last):
  File "/usr/local/bin/pip", line 9, in <module>
    load_entry_point(`pip==1.5.6`, `console_scripts`, `pip`)()
  File "/usr/local/lib/python2.7/site-packages/pip-1.5.6-py2.7.egg/pip/__init__.py", line 185, in main
    return command.main(cmd_args)
  File "/usr/local/lib/python2.7/site-packages/pip-1.5.6-py2.7.egg/pip/basecommand.py", line 161, in main
    text = `
`.join(complete_log)
UnicodeDecodeError: `gbk` codec can`t decode bytes in position 97-98: illegal multibyte sequence

使用安裝包直接進行安裝，發現是以下問題：

gcc: error trying to exec `cc1plus`: execvp: No such file or directory
error: command `gcc` failed with exit status 1

安裝gcc-c++

[root@localhost pandas-0.17.1]# yum list gcc-c++
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
Available Packages
gcc-c++.i686                                 4.4.7-16.el6                                  base
[root@localhost pandas-0.17.1]# yum -y install gcc-c++.i686

遇到問題

No local packages or download links found for python-dateutil
error: Could not find suitable distribution for Requirement.parse(`python-dateutil`)

pip install python-dateutil

終於大功告成

相關文章