千家信息网

kafka深度研究之路(3)-kafka 与zk 集群启停脚本

发表于:2024-11-18 作者:千家信息网编辑
千家信息网最后更新 2024年11月18日,编写 kafka集群 启动 和 停止脚本[hadoop@kafka01-55-11 scripts]$ cat kafka_cluster_stop.sh#!/bin/bash -x#date 201
千家信息网最后更新 2024年11月18日kafka深度研究之路(3)-kafka 与zk 集群启停脚本

编写 kafka集群 启动 和 停止脚本

[hadoop@kafka01-55-11 scripts]$ cat kafka_cluster_stop.sh#!/bin/bash -x#date 20190801#autnor majihuiclush -g all "source /etc/profile ;jps|grep Kafka|awk '{print $1}' | xargs kill -9 "[hadoop@kafka01-55-11 scripts]$ cat kafka_cluster_start.sh    #!/bin/bash -x#author majihui#date 20190801clush -g all "source /etc/profile ;jps|grep Kafka|awk '{print $1}' | xargs kill -9 "sleep 3clush -g all "source /etc/profile;/home/hadoop/kafka/bin/kafka-server-start.sh -daemon /home/hadoop/kafka/config/server.properties"

他的输出日志 在

[hadoop@kafka01-55-11 scripts]$ ls -l ~/kafka/logs/total 164-rw-rw-r-- 1 hadoop hadoop   316 Aug  2 17:25 controller.log-rw-rw-r-- 1 hadoop hadoop     0 Aug  2 17:25 kafka-authorizer.log-rw-rw-r-- 1 hadoop hadoop     0 Aug  2 17:25 kafka-request.log-rw-rw-r-- 1 hadoop hadoop  6123 Aug  2 17:25 kafkaServer-gc.log.0.current-rw-rw-r-- 1 hadoop hadoop 54058 Aug  2 17:25 kafkaServer.out-rw-rw-r-- 1 hadoop hadoop   172 Aug  2 17:25 log-cleaner.log-rw-rw-r-- 1 hadoop hadoop 54058 Aug  2 17:25 server.log-rw-rw-r-- 1 hadoop hadoop 33737 Aug  2 17:25 state-change.log[hadoop@kafka01-55-11 scripts]$ cat /etc/clustershell/groupsall: kafka01-55-11 kafka02-55-12 kafka03-55-13kafka_slave: kafka02-55-12 kafka03-55-13

zookeeper 启动和停止脚本

[hadoop@kafka01-55-11 scripts]$ cat zookeeper_cluster_stop.sh #!/bin/bash -x#author:majihui#date:20190801clush -g all  "source /etc/profile; zkServer.sh stop"
[hadoop@kafka01-55-11 scripts]$ cat zookeeper_cluster_start.sh      // 这里面指定了zookeeper.out 输出到 /data/zookeeper/data/zookeeper.out #!/bin/bash -x#author:majihui#date:20190801clush -g all  "source /etc/profile; cd /data/zookeeper/data && zkServer.sh start|sort"sleep 3clush -g all  "source /etc/profile; zkServer.sh status|sort"
[hadoop@kafka03-55-13 ] pwd/data/zookeeper/data[hadoop@kafka03-55-13 data]$ lltotal 20-rw-rw-r-- 1 hadoop hadoop     2 Aug  1 01:04 myiddrwxrwxr-x 2 hadoop hadoop    45 Aug  1 01:33 version-2-rw-rw-r-- 1 hadoop hadoop 11623 Aug  1 01:33 zookeeper.out-rw-rw-r-- 1 hadoop hadoop     5 Aug  1 01:33 zookeeper_server.pid[hadoop@kafka01-55-11 scripts]$ cat jps_cluster_check.sh #!/bin/bashclush -g all "source /etc/profile;jps|sort"

以上启动脚本 编写完成
需要结合与clush

[hadoop@kafka01-55-11 scripts]$ cat /etc/clustershell/groupsall: kafka01-55-11 kafka02-55-12 kafka03-55-13kafka_slave: kafka02-55-12 kafka03-55-13[hadoop@kafka01-55-11 scripts]$ lltotal 28-rw-rw-r-- 1 hadoop hadoop  57 Aug  1 15:01 jps_cluster_check.sh-rw-rw-r-- 1 hadoop hadoop 312 Aug  1 14:51 kafka_cluster_start.sh-rw-rw-r-- 1 hadoop hadoop 132 Aug  1 14:43 kafka_cluster_stop.sh-rw-rw-r-- 1 hadoop hadoop 291 Aug  1 14:23 start_kafka_manager.sh-rw-rw-r-- 1 hadoop hadoop 286 Aug  1 14:28 stop_kafka_manager.sh-rw-rw-r-- 1 hadoop hadoop 176 Aug  1 14:57 zookeeper_cluster_start.sh-rw-rw-r-- 1 hadoop hadoop 101 Aug  1 14:56 zookeeper_cluster_stop.sh[hadoop@kafka01-55-11 scripts]$ chmod +x *sh[hadoop@kafka01-55-11 scripts]$ lltotal 28-rwxrwxr-x 1 hadoop hadoop  57 Aug  1 15:01 jps_cluster_check.sh-rwxrwxr-x 1 hadoop hadoop 312 Aug  1 14:51 kafka_cluster_start.sh-rwxrwxr-x 1 hadoop hadoop 132 Aug  1 14:43 kafka_cluster_stop.sh-rwxrwxr-x 1 hadoop hadoop 291 Aug  1 14:23 start_kafka_manager.sh-rwxrwxr-x 1 hadoop hadoop 286 Aug  1 14:28 stop_kafka_manager.sh-rwxrwxr-x 1 hadoop hadoop 176 Aug  1 14:57 zookeeper_cluster_start.sh-rwxrwxr-x 1 hadoop hadoop 101 Aug  1 14:56 zookeeper_cluster_stop.sh
0