RabbitMQ 訊息確認機制

海向發表於2019-05-21

生產端 Confirm 訊息確認機制

訊息的確認,是指生產者投遞訊息後,如果 Broker 收到訊息,則會給我們生產者一個應答。生產者進行接收應答,用來確定這條訊息是否正常的傳送到 Broker ,這種方式也是訊息的可靠性投遞的核心保障!

Confirm 確認機制流程圖

RabbitMQ 訊息確認機制

如何實現Confirm確認訊息?

  • 第一步:在 channel 上開啟確認模式: channel.confirmSelect()
  • 第二步:在 channel 上新增監聽: channel.addConfirmListener(ConfirmListener listener);, 監聽成功和失敗的返回結果,根據具體的結果對訊息進行重新傳送、或記錄日誌等後續處理!
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.ConfirmListener;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory;

import java.io.IOException;

public class ConfirmProducer {
    public static void main(String[] args) throws Exception {
        ConnectionFactory factory = new ConnectionFactory();
        factory.setHost("localhost");
        factory.setVirtualHost("/");
        factory.setUsername("guest");
        factory.setPassword("guest");

        Connection connection = factory.newConnection();

        Channel channel = connection.createChannel();

        String exchangeName = "test_confirm_exchange";
        String routingKey = "item.update";

        //指定訊息的投遞模式:confirm 確認模式
        channel.confirmSelect();

        //傳送
        final long start = System.currentTimeMillis();
        for (int i = 0; i < 5 ; i++) {
            String msg = "this is confirm msg ";
            channel.basicPublish(exchangeName, routingKey, null, msg.getBytes());
            System.out.println("Send message : " + msg);
        }

        //新增一個確認監聽, 這裡就不關閉連線了,為了能保證能收到監聽訊息
        channel.addConfirmListener(new ConfirmListener() {
            /**
             * 返回成功的回撥函式
             */
            public void handleAck(long deliveryTag, boolean multiple) throws IOException {
                System.out.println("succuss ack");
                System.out.println(multiple);
                System.out.println("耗時:" + (System.currentTimeMillis() - start) + "ms");
            }
            /**
             * 返回失敗的回撥函式
             */
            public void handleNack(long deliveryTag, boolean multiple) throws IOException {
                System.out.printf("defeat ack");
                System.out.println("耗時:" + (System.currentTimeMillis() - start) + "ms");
            }
        });
    }
}
import com.rabbitmq.client.*;
import java.io.IOException;

public class ConfirmConsumer {
    public static void main(String[] args) throws Exception {
        ConnectionFactory factory = new ConnectionFactory();
        factory.setHost("localhost");
        factory.setVirtualHost("/");
        factory.setUsername("guest");
        factory.setPassword("guest");
        factory.setAutomaticRecoveryEnabled(true);
        factory.setNetworkRecoveryInterval(3000);

        Connection connection = factory.newConnection();

        Channel channel = connection.createChannel();
      
        String exchangeName = "test_confirm_exchange";
        String queueName = "test_confirm_queue";
        String routingKey = "item.#";
        channel.exchangeDeclare(exchangeName, "topic", true, false, null);
        channel.queueDeclare(queueName, false, false, false, null);

        //一般不用程式碼繫結,在管理介面手動繫結
        channel.queueBind(queueName, exchangeName, routingKey);

        //建立消費者並接收訊息
        Consumer consumer = new DefaultConsumer(channel) {
            @Override
            public void handleDelivery(String consumerTag, Envelope envelope,
                                       AMQP.BasicProperties properties, byte[] body)
                    throws IOException {
                String message = new String(body, "UTF-8");
                System.out.println(" [x] Received '" + message + "'");
            }
        };

        //設定 Channel 消費者繫結佇列
        channel.basicConsume(queueName, true, consumer);

    }
}

我們此處只關注生產端輸出訊息

Send message : this is confirm msg 
Send message : this is confirm msg 
Send message : this is confirm msg 
Send message : this is confirm msg 
Send message : this is confirm msg 
succuss ack
true
耗時:3ms
succuss ack
true
耗時:4ms

注意事項

  • 我們採用的是非同步 confirm 模式:提供一個回撥方法,服務端 confirm 了一條或者多條訊息後 Client 端會回撥這個方法。除此之外還有單條同步 confirm 模式、批量同步 confirm 模式,由於現實場景中很少使用我們在此不做介紹,如有興趣直接參考官方文件。

  • 我們執行生產端會發現每次執行結果都不一樣,會有多種情況出現,因為 Broker 會進行優化,有時會批量一次性 confirm ,有時會分開幾條 confirm。

  • succuss ack
    true
    耗時:3ms
    succuss ack
    false
    耗時:4ms
    
    或者
    succuss ack
    true
    耗時:3ms

Return 訊息機制

  • Return Listener 用於處理一-些不可路 由的訊息!
  • 訊息生產者,通過指定一個 ExchangeRoutingkey,把訊息送達到某一個佇列中去,然後我們的消費者監聽佇列,進行消費處理操作!
  • 但是在某些情況下,如果我們在傳送訊息的時候,當前的 exchange 不存在或者指定的路由 key 路由不到,這個時候如果我們需要監聽這種不可達的訊息,就要使用 Return Listener !

  • 在基礎API中有一個關鍵的配置項:Mandatory:如果為 true,則監聽器會接收到路由不可達的訊息,然後進行後續處理,如果為 false,那麼 broker 端自動刪除該訊息!

Return 訊息機制流程圖

RabbitMQ 訊息確認機制

Return 訊息式例

  • 首先我們需要傳送三條訊息,並且故意將第 0 條訊息的 routing Key設定為錯誤的,讓他無法正常路由到消費端。

  • mandatory 設定為 true 路由不可達的訊息會被監聽到,不會被自動刪除.即channel.basicPublish(exchangeName, errRoutingKey, true,null, msg.getBytes());
  • 最後新增監聽即可監聽到不可路由到消費端的訊息channel.addReturnListener(ReturnListener r))

import com.rabbitmq.client.*;
import java.io.IOException;

public class ReturnListeningProducer {
    public static void main(String[] args) throws Exception {
        ConnectionFactory factory = new ConnectionFactory();
        factory.setHost("localhost");
        factory.setVirtualHost("/");
        factory.setUsername("guest");
        factory.setPassword("guest");
      
        Connection connection = factory.newConnection();
        Channel channel = connection.createChannel();

        String exchangeName = "test_return_exchange";
        String routingKey = "item.update";
        String errRoutingKey = "error.update";

        //指定訊息的投遞模式:confirm 確認模式
        channel.confirmSelect();

        //傳送
        for (int i = 0; i < 3 ; i++) {
            String msg = "this is return——listening msg ";
            //@param mandatory 設定為 true 路由不可達的訊息會被監聽到,不會被自動刪除
            if (i == 0) {
                channel.basicPublish(exchangeName, errRoutingKey, true,null, msg.getBytes());
            } else {
                channel.basicPublish(exchangeName, routingKey, true, null, msg.getBytes());
            }
            System.out.println("Send message : " + msg);
        }

        //新增一個確認監聽, 這裡就不關閉連線了,為了能保證能收到監聽訊息
        channel.addConfirmListener(new ConfirmListener() {
            /**
             * 返回成功的回撥函式
             */
            public void handleAck(long deliveryTag, boolean multiple) throws IOException {
                System.out.println("succuss ack");
            }
            /**
             * 返回失敗的回撥函式
             */
            public void handleNack(long deliveryTag, boolean multiple) throws IOException {
                System.out.printf("defeat ack");
            }
        });

        //新增一個 return 監聽
        channel.addReturnListener(new ReturnListener() {
            public void handleReturn(int replyCode, String replyText, String exchange, String routingKey, AMQP.BasicProperties properties, byte[] body) throws IOException {
                System.out.println("return relyCode: " + replyCode);
                System.out.println("return replyText: " + replyText);
                System.out.println("return exchange: " + exchange);
                System.out.println("return routingKey: " + routingKey);
                System.out.println("return properties: " + properties);
                System.out.println("return body: " + new String(body));
            }
        });

    }
}
import com.rabbitmq.client.*;
import java.io.IOException;

public class ReturnListeningConsumer {
    public static void main(String[] args) throws Exception {
        //1. 建立一個 ConnectionFactory 並進行設定
        ConnectionFactory factory = new ConnectionFactory();
        factory.setHost("localhost");
        factory.setVirtualHost("/");
        factory.setUsername("guest");
        factory.setPassword("guest");
        factory.setAutomaticRecoveryEnabled(true);
        factory.setNetworkRecoveryInterval(3000);

        //2. 通過連線工廠來建立連線
        Connection connection = factory.newConnection();

        //3. 通過 Connection 來建立 Channel
        Channel channel = connection.createChannel();

        //4. 宣告
        String exchangeName = "test_return_exchange";
        String queueName = "test_return_queue";
        String routingKey = "item.#";

        channel.exchangeDeclare(exchangeName, "topic", true, false, null);
        channel.queueDeclare(queueName, false, false, false, null);

        //一般不用程式碼繫結,在管理介面手動繫結
        channel.queueBind(queueName, exchangeName, routingKey);

        //5. 建立消費者並接收訊息
        Consumer consumer = new DefaultConsumer(channel) {
            @Override
            public void handleDelivery(String consumerTag, Envelope envelope,
                                       AMQP.BasicProperties properties, byte[] body)
                    throws IOException {
                String message = new String(body, "UTF-8");
                System.out.println(" [x] Received '" + message + "'");
            }
        };

        //6. 設定 Channel 消費者繫結佇列
        channel.basicConsume(queueName, true, consumer);
    }
}

我們只關注生產端結果,消費端只收到兩條訊息。

Send message : this is return——listening msg 
Send message : this is return——listening msg 
Send message : this is return——listening msg 
return relyCode: 312
return replyText: NO_ROUTE
return exchange: test_return_exchange
return routingKey: error.update
return properties: #contentHeader<basic>(content-type=null, content-encoding=null, headers=null, delivery-mode=null, priority=null, correlation-id=null, reply-to=null, expiration=null, message-id=null, timestamp=null, type=null, user-id=null, app-id=null, cluster-id=null)
return body: this is return——listening msg 
succuss ack
succuss ack
succuss ack

消費端 Ack 和 Nack 機制

消費端進行消費的時候,如果由於業務異常我們可以進行日誌的記錄,然後進行補償!如果由於伺服器當機等嚴重問題,那我們就需要手工進行ACK保障消費端消費成功!消費端重回佇列是為了對沒有處理成功的訊息,把訊息重新會遞給Broker!一般我們在實際應用中,都會關閉重回佇列,也就是設定為False。

參考 api

void basicNack(long deliveryTag, boolean multiple, boolean requeue) throws IOException;

void basicAck(long deliveryTag, boolean multiple) throws IOException;

如何設定手動 Ack 、Nack 以及重回佇列

  • 首先我們傳送五條訊息,將每條訊息對應的迴圈下標 i 放入訊息的 properties 中作為標記,以便於我們在後面的回撥方法中識別。

  • 其次, 我們將消費端的 ·channel.basicConsume(queueName, false, consumer); 中的 autoAck屬性設定為 false,如果設定為true的話 將會正常輸出五條訊息。

  • 我們通過 Thread.sleep(2000)來延時一秒,用以看清結果。我們獲取到properties中的num之後,通過channel.basicNack(envelope.getDeliveryTag(), false, true);num為0的訊息設定為 nack,即消費失敗,並且將 requeue屬性設定為true,即消費失敗的訊息重回佇列末端。

import com.rabbitmq.client.*;
import java.util.HashMap;
import java.util.Map;

public class AckAndNackProducer {
    public static void main(String[] args) throws Exception {
        ConnectionFactory factory = new ConnectionFactory();
        factory.setHost("localhost");
        factory.setVirtualHost("/");
        factory.setUsername("guest");
        factory.setPassword("guest");

        Connection connection = factory.newConnection();
        Channel channel = connection.createChannel();

        String exchangeName = "test_ack_exchange";
        String routingKey = "item.update";

        String msg = "this is ack msg";
        for (int i = 0; i < 5; i++) {
            Map<String, Object> headers = new HashMap<String, Object>();
            headers.put("num" ,i);

            AMQP.BasicProperties properties = new AMQP.BasicProperties().builder()
                    .deliveryMode(2)
                    .headers(headers)
                    .build();

            String tem = msg + ":" + i;

            channel.basicPublish(exchangeName, routingKey, true, properties, tem.getBytes());
            System.out.println("Send message : " + msg);
        }

        channel.close();
        connection.close();
    }
}
import com.rabbitmq.client.*;
import java.io.IOException;

public class AckAndNackConsumer {
    public static void main(String[] args) throws Exception {
        ConnectionFactory factory = new ConnectionFactory();
        factory.setHost("localhost");
        factory.setVirtualHost("/");
        factory.setUsername("guest");
        factory.setPassword("guest");
        factory.setAutomaticRecoveryEnabled(true);
        factory.setNetworkRecoveryInterval(3000);

        Connection connection = factory.newConnection();

        final Channel channel = connection.createChannel();

        String exchangeName = "test_ack_exchange";
        String queueName = "test_ack_queue";
        String routingKey = "item.#";
        channel.exchangeDeclare(exchangeName, "topic", true, false, null);
        channel.queueDeclare(queueName, false, false, false, null);

        //一般不用程式碼繫結,在管理介面手動繫結
        channel.queueBind(queueName, exchangeName, routingKey);

        Consumer consumer = new DefaultConsumer(channel) {
            @Override
            public void handleDelivery(String consumerTag, Envelope envelope,
                                       AMQP.BasicProperties properties, byte[] body)
                    throws IOException {

                String message = new String(body, "UTF-8");
                System.out.println(" [x] Received '" + message + "'");

                try {
                    Thread.sleep(2000);
                } catch (InterruptedException e) {
                    e.printStackTrace();
                }

                if ((Integer) properties.getHeaders().get("num") == 0) {
                    channel.basicNack(envelope.getDeliveryTag(), false, true);
                } else {
                    channel.basicAck(envelope.getDeliveryTag(), false);
                }
            }
        };

        //6. 設定 Channel 消費者繫結佇列
        channel.basicConsume(queueName, false, consumer);

    }
}

我們此處只關心消費端輸出,可以看到第 0 條消費失敗重新回到佇列尾部消費。

 [x] Received 'this is ack msg:1'
 [x] Received 'this is ack msg:2'
 [x] Received 'this is ack msg:3'
 [x] Received 'this is ack msg:4'
 [x] Received 'this is ack msg:0'
 [x] Received 'this is ack msg:0'
 [x] Received 'this is ack msg:0'
 [x] Received 'this is ack msg:0'
 [x] Received 'this is ack msg:0'

相關文章