千家信息网

Hadoop 查看某个文件分成几个块,分别在那台机架的哪个机器上

发表于:2024-12-03 作者:千家信息网编辑
千家信息网最后更新 2024年12月03日,命令是hadoop fsck /g6/input/baidu.log -files -blocks -locations -racks[hadoop@hadoop002 ~]$ hadoop fsck
千家信息网最后更新 2024年12月03日Hadoop 查看某个文件分成几个块,分别在那台机架的哪个机器上

命令是

hadoop fsck /g6/input/baidu.log -files -blocks -locations -racks
[hadoop@hadoop002 ~]$ hadoop fsck /g6/input/baidu.log -files -blocks -locations -racksDEPRECATED: Use of this script to execute hdfs command is deprecated.Instead use the hdfs command for it.Connecting to namenode via http://hadoop001:50070FSCK started by hadoop (auth:SIMPLE) from /192.168.1.202 for path /g6/input/baidu.log at Fri May 17 07:17:29 EDT 2019/g6/input/baidu.log 709286098 bytes, 3 block(s):  OK0. BP-1964109503-192.168.1.201-1557058616667:blk_1073741939_1115 len=268435456 Live_repl=3 [/default-rack/192.168.1.203:50010, /default-rack/192.168.1.202:50010, /default-rack/192.168.1.201:50010]1. BP-1964109503-192.168.1.201-1557058616667:blk_1073741940_1116 len=268435456 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]2. BP-1964109503-192.168.1.201-1557058616667:blk_1073741941_1117 len=172415186 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]Status: HEALTHY Total size:    709286098 B Total dirs:    0 Total files:   1 Total symlinks:        0 Total blocks (validated):  3 (avg. block size 236428699 B) Minimally replicated blocks:   3 (100.0 %) Over-replicated blocks:    3 (100.0 %) Under-replicated blocks:   0 (0.0 %) Mis-replicated blocks:     0 (0.0 %) Default replication factor:    2 Average block replication: 3.0 Corrupt blocks:        0 Missing replicas:      0 (0.0 %) Number of data-nodes:      3 Number of racks:       1FSCK ended at Fri May 17 07:17:29 EDT 2019 in 3 millisecondsThe filesystem under path '/g6/input/baidu.log' is HEALTHY

下方这部分信息就是块的位置信息和副本信息

0. BP-1964109503-192.168.1.201-1557058616667:blk_1073741939_1115 len=268435456 Live_repl=3 [/default-rack/192.168.1.203:50010, /default-rack/192.168.1.202:50010, /default-rack/192.168.1.201:50010]1. BP-1964109503-192.168.1.201-1557058616667:blk_1073741940_1116 len=268435456 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]2. BP-1964109503-192.168.1.201-1557058616667:blk_1073741941_1117 len=172415186 Live_repl=3 [/default-rack/192.168.1.202:50010, /default-rack/192.168.1.203:50010, /default-rack/192.168.1.201:50010]
0