消息队列RocketMQ版设计-阿里云

RocketMQ 5.0 多语言客户端的设计与实现

本文作者：古崟佑，阿里云中间件开发。RocketMQ 5.0 版本拥有非常多新特性，比如存储计算分离、 batch 能力的提升等，它是具有里程碑意义的版本。提到新版本，我们往往会首先想到服务端架构的设计变动，很容易忽略客户端的设计理念。客户端也是消息产品的必要组成部分，许多特性需要 client 与...

RocketMQ Compaction Topic的设计与实现

本文作者：刘涛，阿里云智能技术专家。01 Compaction Topic介绍一般来说，消息队列提供的数据过期机制有如下几种，比如有基于时间的过期机制——数据保存多长时间后即进行清理，也有基于数据总量的过期机制——数据分区数据量达到一定值后进行清理。而 Compaction Topic 是...

RocketMQ Flink Catalog 设计与实践

摘要：本文为 RocketMQ Flink Catalog 使用指南。主要内容包括：Flink 和 Flink CatalogRocketMQ Flink ConnectorRocketMQ Flink Catalog作者：李晓双，Apache RocketMQ ContributorMentor...

RocketMQ-存储设计

Domain Model领域模型（Domain Model）是对领域内的概念类或现实世界中对象的可视化表示。又称概念模型、领域对象模型、分析对象模型。它专注于分析问题领域本身，发掘重要的业务领域概念，并建立业务领域概念之间的关系。MessageMessage是RocketMQ消息引擎中的主体。mes...

一个开发者自述：我是如何设计针对冷热读写场景的 RocketMQ 存储系统

作者：Ninety Percent悸动32 岁，码农的倒数第二个本命年，平淡无奇的生活总觉得缺少了点什么。想要去创业，却害怕家庭承受不住再次失败的挫折，想要生二胎，带娃的压力让我想着还不如去创业；所以我只好在生活中寻找一些小感动，去看一些老掉牙的电影，然后把自己感动得稀里...

7张图揭晓RocketMQ存储设计的精髓

1、存储概述RocketMQ存储的文件主要包括Commitlog文件、ConsumeQueue文件、Index文件。RocketMQ将所有主题的消息存储在同一个文件中，确保消息发送时按顺序写文件，尽最大能力确保消息发送的高可用性与高吞吐量。但消息中间件一般都是基于主题的订阅与发布模式，消息消费时必须...

RocketMQ 整合 DLedger(多副本)即主从切换实现平滑升级的设计技巧

源码分析 RocketMQ DLedger 多副本即主从切换系列已经进行到第8篇了，前面的章节主要是介绍了基于 raft 协议的选主与日志复制，从本篇开始将开始关注如何将 DLedger 应用到 RocketMQ中。摘要：详细分析了RocketMQ DLedger 多副本(主从切换) 是...

基于 raft 协议的 RocketMQ DLedger 多副本日志复制设计原理

前面已经用源码的手段对 RocketMQ 日志复制的实现细节做了一个详细的介绍，可能有不少读者朋友们觉得源码阅读较为枯燥，看的有点云里雾里，本篇将首先梳理一下 RocketMQ DLedger 多副本关于日志复制的三个核心流程图，然后再思考一下在异常情况下如何保证数据一致性。1、RocketMQ D...

RocketMQ消息轨迹-设计篇

RocketMQ消息轨迹主要包含两篇文章：设计篇与源码分析篇，本节将详细介绍RocketMQ消息轨迹-设计相关。RocketMQ消息轨迹，主要跟踪消息发送、消息消费的轨迹，即详细记录消息各个处理环节的日志，从设计上至少需要解决如下三个核心问题：消费轨迹数据格式记录消息轨迹(消息日志)消息轨迹数据存储...

RocketMQ消息发送的高可用设计

从rocketmq topic的创建机制可知，一个topic对应有多个消息队列，那么我们在发送消息时，是如何选择消息队列进行发送的？假如这时有broker宕机了，rocketmq是如何规避故障broker的？看完这篇文章，相信你会从文中找到答案。rocketmq在发送消息时，由于nam...

共有26条

< 1 2 3 >

跳转至： GO

更新时间 2023-01-05 11:46:21

本页面内关键词为智能算法引擎基于机器学习所生成，如有任何问题，可在页面下方点击"联系我们"与我们沟通。

产品推荐

{"moduleinfo":{"card_count":[{"count_phone":1,"count":1}],"search_count":[{"count_phone":4,"count":4}]},"card":[{"des":"阿里巴巴双11官方指定消息中间件，经过阿里巴巴交易核心链路反复打磨与历年双十一购物狂欢节的严苛考验，是一个真正具备低延迟、高并发、高可用、高可靠，可支撑万亿级数据洪峰的分布式消息中间件。","link1":"https://common-buy.aliyun.com/?commodityCode=onsbag&request=%7B%22pack_type%22:%22topic%22,%22region%22:%22ons-pack-china%22,%22flowout_topic%22:%22150%22,%22pack%22:%22FPT_onsbag_deadlineAcc_1544755088%22,%22ord_time%22:%226:Month%22%7D","link":"https://www.aliyun.com/product/rocketmq","icon":"https://img.alicdn.com/tfs/TB1DThKRXXXXXa.XpXXXXXXXXXX-200-200.png","btn2":"消息产品总览","tip":"消息队列RabbitMQ发布，兼容 RabbitMQ，推出7种多语言客户端<a href=\"https://www.aliyun.com/product/amqp\" target=\"_blank\">了解详情</a>！","btn1":"超值资源包","link2":"https://www.aliyun.com/product/ons","title":"消息队列 RocketMQ"}],"search":[{"txt":"消息队列 RocketMQ-金融等业务消息领域","link":"https://common-buy.aliyun.com/?commodityCode=onsbag&request=%7B%22pack_type%22:%22topic%22,%22region%22:%22ons-pack-china%22,%22flowout_topic%22:%22150%22,%22pack%22:%22FPT_onsbag_deadlineAcc_1544755088%22,%22ord_time%22:%226:Month%22%7D"},{"txt":"消息队列 MQTT-支持IOT与物联网等领域","link":"https://common-buy.aliyun.com/?commodityCode=onsMqtt&request=%7B%22version%22:%22normal%22,%22region%22:%22mq-internet-access%22,%22max_connection%22:%22100%22,%22max_tps%22:%22100%22,%22max_sub%22:%221000%22,%22order_num%22:1,%22ord_time%22:%22%5B3,%5C%22Month%5C%22%5D%22%7D"},{"txt":"消息队列 RabbitMQ-全面兼容RabbitMQ","link":"https://common-buy.aliyun.com/?commodityCode=onsproxy_bag&request=%7B%22pack_type%22:%22queue%22,%22region%22:%22ons-pack-china%22,%22flowout_queue%22:%22150%22,%22pack%22:%22FPT_onsproxy_bag_deadlineAcc_1547457704%22,%22ord_time%22:%223:Month%22%7D"},{"txt":"消息队列 Kafka-大数据通道","link":"https://common-buy.aliyun.com/?commodityCode=alikafka_post&request=%7B%22region%22:%22cn-hangzhou%22,%22vpc_deploy%22:%22true%22,%22IO_max%22:%2220%22,%22disk_type%22:%220%22,%22disk_size%22:900,%22msg_retain%22:72,%22order_num%22:1%7D"}],"countinfo":{"search":{"length_pc":0,"length":0},"card":{"length_pc":0,"length":0}},"simplifiedDisplay":"newEdition","newCard":[{"link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"ons","title":"消息队列 RocketMQ 版","des":"消息队列 RocketMQ 版(原ONS)是阿里云基于 Apache RocketMQ 构建的低延迟、高并发、高可用、高可靠的分布式“消息、事件、流”统一处理平台。RocketMQ 自诞生以来一直服务阿里集团13年，历经多次双十一万亿级数据洪峰稳定性验证。","btn1":"消息队列 RocketMQ 版","link1":"https://www.aliyun.com/product/rocketmq","btn2":"消息服务 MNS","link2":"https://www.aliyun.com/product/mns?spm=5176.19720258.J_3207526240.53.7b8176f4Fm5ext","btn3":"消息队列 RabbitMQ 版","link3":"https://www.aliyun.com/product/amqp","infoGroup":[{"infoName":"查看概览","infoContent":{"firstContentName":"消息队列 RocketMQ ","firstContentLink":"https://www.aliyun.com/product/rocketmq?spm=5176.21213303.J_8058803260.45.7df153c9xdZiih","lastContentName":"","lastContentLink":""}},{"infoName":"优惠活动","infoContent":{"firstContentName":"RabbitMQ 0元试用","firstContentLink":"https://www.aliyun.com/product/amqp","lastContentName":"","lastContentLink":""}},{"infoName":"优惠活动","infoContent":{"firstContentName":"MQTT 基础版8.8元/月","firstContentLink":"https://www.aliyun.com/product/mq4iot?spm=5176.22772544.J_3207526240.52.757c2ea9UXGJEa","lastContentName":"","lastContentLink":""}},{"infoName":"优惠活动","infoContent":{"firstContentName":"MNS资源包0.9元/月","firstContentLink":"https://www.aliyun.com/product/mns?spm=5176.19720258.J_3207526240.53.7b8176f4Fm5ext","lastContentName":"","lastContentLink":""}}],"ifIcon":"img","iconImg":"https://img.alicdn.com/imgextra/i4/O1CN013mOrtS1ZbbKa0FoIX_!!6000000003213-0-tps-800-800.jpg","contentLink":"https://www.aliyun.com/product/rocketmq?spm=5176.14834222.746107.1.f2f9535aDHGNZb"}],"visual":{"icon":"ons","topbg":"https://img.alicdn.com/tfs/TB14iILhgDqK1RjSZSyXXaxEVXa-286-101.jpg","textColor":"light"}}

{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"moduleinfo":{"card_count":[{"count_phone":1,"count":1}],"search_count":[{"count_phone":4,"count":4}]},"card":[{"des":"阿里巴巴双11官方指定消息中间件，经过阿里巴巴交易核心链路反复打磨与历年双十一购物狂欢节的严苛考验，是一个真正具备低延迟、高并发、高可用、高可靠，可支撑万亿级数据洪峰的分布式消息中间件。","link1":"https://common-buy.aliyun.com/?commodityCode=onsbag&request=%7B%22pack_type%22:%22topic%22,%22region%22:%22ons-pack-china%22,%22flowout_topic%22:%22150%22,%22pack%22:%22FPT_onsbag_deadlineAcc_1544755088%22,%22ord_time%22:%226:Month%22%7D","link":"https://www.aliyun.com/product/rocketmq","icon":"https://img.alicdn.com/tfs/TB1DThKRXXXXXa.XpXXXXXXXXXX-200-200.png","btn2":"消息产品总览","tip":"消息队列RabbitMQ发布，兼容 RabbitMQ，推出7种多语言客户端<a href=\"https://www.aliyun.com/product/amqp\" target=\"_blank\">了解详情</a>！","btn1":"超值资源包","link2":"https://www.aliyun.com/product/ons","title":"消息队列 RocketMQ"}],"search":[{"txt":"消息队列 RocketMQ-金融等业务消息领域","link":"https://common-buy.aliyun.com/?commodityCode=onsbag&request=%7B%22pack_type%22:%22topic%22,%22region%22:%22ons-pack-china%22,%22flowout_topic%22:%22150%22,%22pack%22:%22FPT_onsbag_deadlineAcc_1544755088%22,%22ord_time%22:%226:Month%22%7D"},{"txt":"消息队列 MQTT-支持IOT与物联网等领域","link":"https://common-buy.aliyun.com/?commodityCode=onsMqtt&request=%7B%22version%22:%22normal%22,%22region%22:%22mq-internet-access%22,%22max_connection%22:%22100%22,%22max_tps%22:%22100%22,%22max_sub%22:%221000%22,%22order_num%22:1,%22ord_time%22:%22%5B3,%5C%22Month%5C%22%5D%22%7D"},{"txt":"消息队列 RabbitMQ-全面兼容RabbitMQ","link":"https://common-buy.aliyun.com/?commodityCode=onsproxy_bag&request=%7B%22pack_type%22:%22queue%22,%22region%22:%22ons-pack-china%22,%22flowout_queue%22:%22150%22,%22pack%22:%22FPT_onsproxy_bag_deadlineAcc_1547457704%22,%22ord_time%22:%223:Month%22%7D"},{"txt":"消息队列 Kafka-大数据通道","link":"https://common-buy.aliyun.com/?commodityCode=alikafka_post&request=%7B%22region%22:%22cn-hangzhou%22,%22vpc_deploy%22:%22true%22,%22IO_max%22:%2220%22,%22disk_type%22:%220%22,%22disk_size%22:900,%22msg_retain%22:72,%22order_num%22:1%7D"}],"countinfo":{"search":{"length_pc":0,"length":0},"card":{"length_pc":0,"length":0}},"simplifiedDisplay":"newEdition","newCard":[{"link":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png","icon":"ons","title":"消息队列 RocketMQ 版","des":"消息队列 RocketMQ 版(原ONS)是阿里云基于 Apache RocketMQ 构建的低延迟、高并发、高可用、高可靠的分布式“消息、事件、流”统一处理平台。RocketMQ 自诞生以来一直服务阿里集团13年，历经多次双十一万亿级数据洪峰稳定性验证。","btn1":"消息队列 RocketMQ 版","link1":"https://www.aliyun.com/product/rocketmq","btn2":"消息服务 MNS","link2":"https://www.aliyun.com/product/mns?spm=5176.19720258.J_3207526240.53.7b8176f4Fm5ext","btn3":"消息队列 RabbitMQ 版","link3":"https://www.aliyun.com/product/amqp","infoGroup":[{"infoName":"查看概览","infoContent":{"firstContentName":"消息队列 RocketMQ ","firstContentLink":"https://www.aliyun.com/product/rocketmq?spm=5176.21213303.J_8058803260.45.7df153c9xdZiih","lastContentName":"","lastContentLink":""}},{"infoName":"优惠活动","infoContent":{"firstContentName":"RabbitMQ 0元试用","firstContentLink":"https://www.aliyun.com/product/amqp","lastContentName":"","lastContentLink":""}},{"infoName":"优惠活动","infoContent":{"firstContentName":"MQTT 基础版8.8元/月","firstContentLink":"https://www.aliyun.com/product/mq4iot?spm=5176.22772544.J_3207526240.52.757c2ea9UXGJEa","lastContentName":"","lastContentLink":""}},{"infoName":"优惠活动","infoContent":{"firstContentName":"MNS资源包0.9元/月","firstContentLink":"https://www.aliyun.com/product/mns?spm=5176.19720258.J_3207526240.53.7b8176f4Fm5ext","lastContentName":"","lastContentLink":""}}],"ifIcon":"img","iconImg":"https://img.alicdn.com/imgextra/i4/O1CN013mOrtS1ZbbKa0FoIX_!!6000000003213-0-tps-800-800.jpg","contentLink":"https://www.aliyun.com/product/rocketmq?spm=5176.14834222.746107.1.f2f9535aDHGNZb"}],"visual":{"icon":"ons","topbg":"https://img.alicdn.com/tfs/TB14iILhgDqK1RjSZSyXXaxEVXa-286-101.jpg","textColor":"light"}}}