当前位置: 首页 > news >正文

kafka-消费者组偏移量重置

文章目录

  • 1、消费者组偏移量重置
    • 1.1、列出所有的消费者组
    • 1.2、查看 my_group1 组的详细信息
    • 1.3、获取 kafka-consumer-groups.sh 的帮助信息
    • 1.4、 偏移量重置
    • 1.5、再次查看 my_group1 组的详细信息

1、消费者组偏移量重置

1.1、列出所有的消费者组

[root@localhost ~]# kafka-consumer-groups.sh --bootstrap-server 192.168.74.148:9092 --list
my_group2
my_group1

1.2、查看 my_group1 组的详细信息

[root@localhost ~]# kafka-consumer-groups.sh --bootstrap-server 192.168.74.148:9092 --group my_group1 --describeGROUP           TOPIC           PARTITION  CURRENT-OFFSET  LOG-END-OFFSET  LAG             CONSUMER-ID                                               HOST            CLIENT-ID
my_group1       my_topic1       1          1               1               0               consumer-my_group1-1-c2ff5a19-af5c-47fc-9ad9-d6028844f86c /192.168.74.148 consumer-my_group1-1
my_group1       my_topic1       2          3               3               0               consumer-my_group1-1-c6a31cdb-c924-49bb-99da-cf45ffdbefb6 /192.168.74.148 consumer-my_group1-1
my_group1       my_topic1       0          2               2               0               consumer-my_group1-1-19852a4a-9a4e-4b41-b605-0a78530d0cd8 /192.168.74.148 consumer-my_group1-1

1.3、获取 kafka-consumer-groups.sh 的帮助信息

[root@localhost ~]# kafka-consumer-groups.sh --help
Missing required argument "[bootstrap-server]"
Option                                  Description                            
------                                  -----------                            
--all-groups                            Apply to all consumer groups.          
--all-topics                            Consider all topics assigned to a      group in the `reset-offsets` process.
--bootstrap-server <String: server to   REQUIRED: The server(s) to connect to. connect to>                                                                  
--by-duration <String: duration>        Reset offsets to offset by duration    from current timestamp. Format:      'PnDTnHnMnS'                         
--command-config <String: command       Property file containing configs to be config property file>                   passed to Admin Client and Consumer. 
--delete                                Pass in groups to delete topic         partition offsets and ownership      information over the entire consumer group. For instance --group g1 --    group g2                             
--delete-offsets                        Delete offsets of consumer group.      Supports one consumer group at the   time, and multiple topics.           
--describe                              Describe consumer group and list       offset lag (number of messages not   yet processed) related to given      group.                               
--dry-run                               Only show results without executing    changes on Consumer Groups.          Supported operations: reset-offsets. 
--execute                               Execute operation. Supported           operations: reset-offsets.           
--export                                Export operation execution to a CSV    file. Supported operations: reset-   offsets.                             
--from-file <String: path to CSV file>  Reset offsets to values defined in CSV file.                                
--group <String: consumer group>        The consumer group we wish to act on.  
--help                                  Print usage information.               
--list                                  List all consumer groups.              
--members                               Describe members of the group. This    option may be used with '--describe' and '--bootstrap-server' options     only.                                Example: --bootstrap-server localhost: 9092 --describe --group group1 --    members                              
--offsets                               Describe the group and list all topic  partitions in the group along with   their offset lag. This is the        default sub-action of and may be     used with '--describe' and '--       bootstrap-server' options only.      Example: --bootstrap-server localhost: 9092 --describe --group group1 --    offsets                              
--reset-offsets                         Reset offsets of consumer group.       Supports one consumer group at the   time, and instances should be        inactive                             Has 2 execution options: --dry-run     (the default) to plan which offsets  to reset, and --execute to update    the offsets. Additionally, the --    export option is used to export the  results to a CSV format.             You must choose one of the following   reset specifications: --to-datetime, --by-period, --to-earliest, --to-    latest, --shift-by, --from-file, --  to-current.                          To define the scope use --all-topics   or --topic. One scope must be        specified unless you use '--from-    file'.                               
--shift-by <Long: number-of-offsets>    Reset offsets shifting current offset  by 'n', where 'n' can be positive or negative.                            
--state [String]                        When specified with '--describe',      includes the state of the group.     Example: --bootstrap-server localhost: 9092 --describe --group group1 --    state                                When specified with '--list', it       displays the state of all groups. It can also be used to list groups with specific states.                     Example: --bootstrap-server localhost: 9092 --list --state stable,empty     This option may be used with '--       describe', '--list' and '--bootstrap-server' options only.                
--timeout <Long: timeout (ms)>          The timeout that can be set for some   use cases. For example, it can be    used when describing the group to    specify the maximum amount of time   in milliseconds to wait before the   group stabilizes (when the group is  just created, or is going through    some changes). (default: 5000)       
--to-current                            Reset offsets to current offset.       
--to-datetime <String: datetime>        Reset offsets to offset from datetime. Format: 'YYYY-MM-DDTHH:mm:SS.sss'    
--to-earliest                           Reset offsets to earliest offset.      
--to-latest                             Reset offsets to latest offset.        
--to-offset <Long: offset>              Reset offsets to a specific offset.    
--topic <String: topic>                 The topic whose consumer group         information should be deleted or     topic whose should be included in    the reset offset process. In `reset- offsets` case, partitions can be     specified using this format: `topic1:0,1,2`, where 0,1,2 are the          partition to be included in the      process. Reset-offsets also supports multiple topic inputs.               
--verbose                               Provide additional information, if     any, when describing the group. This option may be used with '--          offsets'/'--members'/'--state' and   '--bootstrap-server' options only.   Example: --bootstrap-server localhost: 9092 --describe --group group1 --    members --verbose                    
--version                               Display Kafka version.  

1.4、 偏移量重置

[root@localhost ~]# kafka-consumer-groups.sh --bootstrap-server 192.168.74.148:9092 --topic my_topic1 --group my_group1 --reset-offsets --to-offset 1 --executeGROUP                          TOPIC                          PARTITION  NEW-OFFSET     
my_group1                      my_topic1                      0          1              
my_group1                      my_topic1                      1          1              
my_group1                      my_topic1                      2          1   

在这里插入图片描述

1.5、再次查看 my_group1 组的详细信息

[root@localhost ~]# kafka-consumer-groups.sh --bootstrap-server 192.168.74.148:9092 --group my_group1 --describeGROUP           TOPIC           PARTITION  CURRENT-OFFSET  LOG-END-OFFSET  LAG             CONSUMER-ID                                               HOST            CLIENT-ID
my_group1       my_topic1       0          2               2               0               consumer-my_group1-1-1306dc19-4077-4622-ae3b-ed6d077c4206 /192.168.74.148 consumer-my_group1-1
my_group1       my_topic1       2          3               3               0               consumer-my_group1-1-c4e3e804-e469-4f1a-ac0c-5b57907356f9 /192.168.74.148 consumer-my_group1-1
my_group1       my_topic1       1          1               1               0               consumer-my_group1-1-ad5fc413-e598-4e4b-b44c-0ae976a615c8 /192.168.74.148 consumer-my_group1-1
http://www.lryc.cn/news/357042.html

相关文章:

  • 一书读懂Python全栈安全,剑指网络空间安全
  • 原生js实现拖拽改变元素顺序
  • 以果决其行,只为文化的传承
  • Flutter 中的 SizedOverflowBox 小部件:全面指南
  • 图像视频智能抹除修复解决方案,适应性强,应用广泛
  • 20240521(代码整洁和测试入门学习)
  • git中忽略文件的配置
  • 如何进行前端职业规划
  • GD32F103系列单片机片上FLASH和ARM介绍
  • Ansible自动化运维中的Setup收集模块应用详解
  • 再次学习History.scrollRestoration
  • python PyQt5 数字时钟程序
  • 骨传导耳机哪个品牌值得入手?精选五大不容错过的王者品牌推荐!
  • Vue.js|项目安装
  • 多线程新手村4--定时器
  • 如何衡量安全阀检测的价格与价值?一文揭晓答案
  • Sectigo证书介绍以及申请流程
  • 网络安全-钓鱼篇-利用cs进行钓鱼
  • 机器学习-6-对随机梯度下降算法SGD的理解
  • windows 11 精简版下载
  • rpm与yum扩展、命令
  • SpringBoot实现接口防抖的几种方案,杜绝重复提交
  • 了解VS安全编译选项GS
  • python 垃圾回收机制
  • 深度学习设计模式之组合模式
  • C++ 网络编程
  • 服务案例|网络攻击事件的排查与修复
  • 如何使用宝塔面板搭建Tipask问答社区网站并发布公网远程访问
  • Git学习和使用指南简单篇
  • HTTPS单双向认证流程详解与联想