MongoDB分片群集的部署（用心描述，詳細易懂）！！

艾艾貼發表於2018-07-19

概念：

MongoDB分片是使用多個伺服器儲存資料的方法，以支援巨大的資料儲存和對資料進行儲存

優勢：

1、減少了每個分片需啊喲處理的請求數，群集可以提高自己的儲存容量和吞吐量

2、減少了每個分片儲存的資料

三個主要元件：

shard：分片伺服器，用於儲存實際的資料塊，由多臺伺服器組成一個複製集承擔，防止主機單點故障

config server：配置伺服器，儲存整個分片群集的配置資訊，包括塊資訊

routers：前端路由，客戶端由此進入，讓整個群集看上去像單一資料庫

如何部署MongoDB分片群集！！！

1、安裝MongoDB3.2版本包和openssl-devel包

[root@localhost ~]# yum install openssl-devel -y

[root@localhost ~]# mkdir /abc
[root@localhost ~]# mount.cifs //192.168.200.1/orc /abc
Password for root@//192.168.200.1/orc:  
[root@localhost ~]# cd /abc
[root@localhost abc]# ls
mongodb-linux-x86_64-3.2.1.tgz  //MongoDB 3.2版本
[root@localhost abc]# tar zxvf mongodb-linux-x86_64-3.2.1.tgz -C /opt
[root@localhost abc]# cd /opt
[root@localhost opt]# ls
mongodb-linux-x86_64-3.2.1  rh
[root@localhost opt]# mv mongodb-linux-x86_64-3.2.1/ /usr/local/mongodb                 

[root@localhost opt]# cd /usr/local/bin/
[root@localhost bin]# ln -s /usr/local/mongodb/bin/mongo /usr/bin/mongo //建立軟連線
[root@localhost bin]# ln -s /usr/local/mongodb/bin/mongod /usr/bin/mongod

[root@localhost bin]# mkdir -p /data/mongodb/mongodb{1,2,3,4}
[root@localhost bin]# mkdir /data/mongodb/logs
[root@localhost bin]# touch /data/mongodb/logs/mongodb{1,2,3,4}.log
[root@localhost bin]# chmod -R 777 /data/mongodb/logs/*.log

[root@localhost bin]# ulimit -n 25000   //開啟檔案數量
[root@localhost bin]# ulimit -u 25000    //程式併發數

2、部署配置伺服器

編輯mongodb1.conf配置檔案，埠為37017，設定configsvr=true，啟動配置伺服器

[root@localhost bin]# vim mongodb1.con
port=37017
dbpath=/data/mongodb/mongodb1
logpath=/data/mongodb/logs/mongodb1.log
logappend=true
fork=true
maxConns=5000
storageEngine=mmapv1
configsvr=true                //開啟配置伺服器

3、某節點記憶體不足，從其它節點分配記憶體

[root@localhost bin]# sysctl -w vm.zone_reclaim_mode=0
vm.zone_reclaim_mode = 0
[root@localhost bin]# echo never > /sys/kernel/mm/transparent_hugepage/enabled
[root@localhost bin]# echo never > /sys/kernel/mm/transparent_hugepage/defrag

[root@localhost bin]# mongod -f mongodb1.conf 
about to fork child process, waiting until server is ready for connections.
forked process: 6895
child process started successfully, parent exiting

4、部署分片伺服器

編輯mongodb2.conf配置檔案，埠為47017，設定shardsvr=true；編輯mongodb3.conf配置檔案，埠為47018，啟動兩個分片伺服器


[root@localhost bin]# cp -p mongodb1.conf mongodb2.conf 

[root@localhost bin]# vim mongodb2.conf 
port=47017                   //修改埠
dbpath=/data/mongodb/mongodb2
logpath=/data/mongodb/logs/mongodb2.log
logappend=true
fork=true
maxConns=5000
storageEngine=mmapv1
shardsvr=true                //開啟分片伺服器

[root@localhost bin]# cp -p mongodb2.conf mongodb3.conf
[root@localhost bin]# vim mongodb3.conf 
port=47018
dbpath=/data/mongodb/mongodb3
logpath=/data/mongodb/logs/mongodb3.log
logappend=true
fork=true
maxConns=5000
storageEngine=mmapv1
shardsvr=true

[root@localhost bin]# mongod -f mongodb2.conf 
about to fork child process, waiting until server is ready for connections.
forked process: 7080
child process started successfully, parent exiting
[root@localhost bin]# mongod -f mongodb3.conf 
about to fork child process, waiting until server is ready for connections.
forked process: 7107
child process started successfully, parent exiting

[root@localhost bin]# netstat -antp | grep mongod
tcp        0      0 0.0.0.0:37017           0.0.0.0:*               LISTEN      god         
tcp        0      0 0.0.0.0:47017           0.0.0.0:*               LISTEN      god         
tcp        0      0 0.0.0.0:47018           0.0.0.0:*               LISTEN      god

5、啟動路由伺服器

./mongos –help命令可以檢視路由相關引數資訊。chunkSize為資料塊大小，預設為200M，這裡將值設為1

[root@localhost bin]# ./mongos --port 27017 --fork --logpath=/usr/local/mongodb/bin/route.log --configdb 192.168.200.142:37017 --chunkSize 1

6、啟用分片伺服器

mongos> sh.addShard("192.168.200.142:47017")
{ "shardAdded" : "shard0000", "ok" : 1 }
mongos> sh.addShard("192.168.200.142:47018")
{ "shardAdded" : "shard0001", "ok" : 1 }
mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
    "_id" : 1,
    "minCompatibleVersion" : 5,
    "currentVersion" : 6,
    "clusterId" : ObjectId("5b4f68599dcf397cc4e7c598")
}
  shards:                 //分片伺服器開啟
    {  "_id" : "shard0000",  "host" : "192.168.200.142:47017" }
    {  "_id" : "shard0001",  "host" : "192.168.200.142:47018" }
  active mongoses:
    "3.2.1" : 1
  balancer:
    Currently enabled:  yes
    Currently running:  no
    Failed balancer rounds in last 5 attempts:  0
    Migration Results for the last 24 hours: 
        No recent migratio

7、分片功能

[root@localhost bin]# mongo
mongos> use school
switched to db school

mongos> for(var i=1;i<=10000;i++)db.users.insert({"id":i,"name":"jack"+i})           
WriteResult({ "nInserted" : 1 })

mongos> show dbs
config  0.031GB
school  0.078GB             

mongos> use school
switched to db school

mongos> show collections
system.indexes
users

mongos> db.users.find().limit(10)  //檢視頭十行內容
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4ae"), "id" : 1, "name" : "jack1" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4af"), "id" : 2, "name" : "jack2" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4b0"), "id" : 3, "name" : "jack3" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4b1"), "id" : 4, "name" : "jack4" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4b2"), "id" : 5, "name" : "jack5" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4b3"), "id" : 6, "name" : "jack6" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4b4"), "id" : 7, "name" : "jack7" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4b5"), "id" : 8, "name" : "jack8" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4b6"), "id" : 9, "name" : "jack9" }
{ "_id" : ObjectId("5b4f6a24ef33d588c0dbc4b7"), "id" : 10, "name" : "jack10" }

mongos> sh.status()             //檢視資料庫分片資訊
--- Sharding Status --- 
  sharding version: {
    "_id" : 1,
    "minCompatibleVersion" : 5,
    "currentVersion" : 6,
    "clusterId" : ObjectId("5b4f68599dcf397cc4e7c598")
}
  shards:
    {  "_id" : "shard0000",  "host" : "192.168.200.142:47017" }
    {  "_id" : "shard0001",  "host" : "192.168.200.142:47018" }
  active mongoses:
    "3.2.1" : 1
  balancer:
    Currently enabled:  yes
    Currently running:  no
    Failed balancer rounds in last 5 attempts:  0
    Migration Results for the last 24 hours: 
        No recent migrations
  databases:
    {  "_id" : "school",  "primary" : "shard0000",  "partitioned" : false }

mongos> sh.enableSharding("school") //啟用資料庫分片
{ "ok" : 1 }

mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
    "_id" : 1,
    "minCompatibleVersion" : 5,
    "currentVersion" : 6,
    "clusterId" : ObjectId("5b4f68599dcf397cc4e7c598")
}
  shards:
    {  "_id" : "shard0000",  "host" : "192.168.200.142:47017" }
    {  "_id" : "shard0001",  "host" : "192.168.200.142:47018" }
  active mongoses:
    "3.2.1" : 1
  balancer:
    Currently enabled:  yes
    Currently running:  no
    Failed balancer rounds in last 5 attempts:  0
    Migration Results for the last 24 hours: 
        No recent migrations
  databases:
    {  "_id" : "school",  "primary" : "shard0000",  "partitioned" : true }

mongos> db.users.createIndex({"id":1})  //對users表建立索引
{
    "raw" : {
        "192.168.200.142:47017" : {
            "createdCollectionAutomatically" : false,
            "numIndexesBefore" : 1,
            "numIndexesAfter" : 2,
            "ok" : 1
        }
    },
    "ok" : 1
}

mongos> sh.shardCollection("school.users",{"id":1})//表分片
{ "collectionsharded" : "school.users", "ok" : 1 }

mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
    "_id" : 1,
    "minCompatibleVersion" : 5,
    "currentVersion" : 6,
    "clusterId" : ObjectId("5b4f68599dcf397cc4e7c598")
}
  shards:
    {  "_id" : "shard0000",  "host" : "192.168.200.142:47017" }
    {  "_id" : "shard0001",  "host" : "192.168.200.142:47018" }
  active mongoses:
    "3.2.1" : 1
  balancer:
    Currently enabled:  yes
    Currently running:  no
    Failed balancer rounds in last 5 attempts:  0
    Migration Results for the last 24 hours: 
        No recent migrations
  databases:
    {  "_id" : "school",  "primary" : "shard0000",  "partitioned" : true }
        school.users
            shard key: { "id" : 1 }
            unique: false
            balancing: true
            chunks:
                shard0000   3
            { "id" : { "$minKey" : 1 } } -->> { "id" : 4682 } on : shard0000 Timestamp(1, 0) 
            { "id" : 4682 } -->> { "id" : 9364 } on : shard0000 Timestamp(1, 1) 
            { "id" : 9364 } -->> { "id" : { "$maxKey" : 1 } } on : shard0000 Timestamp(1, 2)        //分片成功

請詳細描述AJAX的工作原理
2024-11-25
MongoDB 分片管理
2018-05-25
MongoDB
mongodb 分片叢集建立分片集合
2019-12-19
MongoDB
mongodb之shard分片
2022-03-05
MongoDB
【Mongodb】分片複製集環境新增新的分片
2018-05-08
MongoDB
超詳細的IIS部署
2020-10-23
servlet的url-pattern匹配規則詳細描述
2020-09-29
Servlet
【超詳細】安全測試===sqlmap使用心得（零）
2021-12-22
SQL
搭建MongoDB分片叢集
2024-05-03
MongoDB
MongoDB 分片叢集搭建
2019-12-19
MongoDB
windows安裝mongodb詳細教程
2021-06-15
WindowsMongoDB
openstack完整的部署（最詳細）
2024-05-04
sql如何最佳化的，詳細描述一下？
2024-08-11
SQL
詳述盒子模型（包含padding、border、margin的詳細用法和描述）
2021-06-02
模型padding
MongoDB 分片鍵的選擇與案例
2018-05-31
MongoDB
Spring Data MongoDB 操作 document DB 的詳細示例
2024-07-09
SpringMongoDB
mongodb 分片叢集設定
2018-08-30
MongoDB
MongoDB分片鍵選擇指南
2024-10-09
MongoDB
MongoDB分片叢集常用操作
2018-03-28
MongoDB
mongodb分片物理搬遷方案
2022-03-06
MongoDB
MyCat分片：分片規則的十四種演算法詳細解讀&程式碼實現（上篇）
2021-03-23
演算法
部署分片叢集
2024-07-08
IIS部署WCF詳細教程
2021-10-11
伺服器群集—LVS負載均衡群集（LVS-NAT部署）
2020-12-08
伺服器負載
高可用mongodb叢集(分片+副本)
2024-06-17
MongoDB
MongoDB Sharding(二) -- 搭建分片叢集
2021-01-16
MongoDB
CentOS 7 安裝MongoDB詳細步驟
2018-11-01
CentOSMongoDB
MongoDB4 事務簡單易懂的?
2018-07-09
MongoDB
Redis的安裝及建立節點、部署群集
2018-07-23
Redis
mongodb分片(sharding)搭建、應用及管理
2020-02-04
MongoDB
Mongodb分散式叢集副本集+分片
2020-12-23
MongoDB分散式
MongoDB4.2 分片掃盲說明
2021-03-16
MongoDB
Linux Centos 7安裝MongoDB（簡單！詳細！）
2019-04-23
LinuxCentOSMongoDB
mysql主從複製詳細部署
2024-10-22
MySql
Kubernetes 部署 - DevOps CI/CD詳細指南
2023-01-08
dev
linux下Mongodb叢集搭建：分片+副本集
2018-09-28
LinuxMongoDB
MongoDB mongoshake 遷移分片到複製集合
2023-11-30
MongoDB
vlookup函式不會用？詳細使用方法就在這兒，用心學！
2018-12-13
函式