导航：首页 > 互联网科技 >

HADOOP中HDFS基准测试

发表于：2025-01-25 作者：千家信息网编辑

千家信息网最后更新 2025年01月25日，hdfs 基准测试：磁盘读写性能测试hadoop jar ./hadoop-mapreduce-client-jobclient-2.7.2.3.jar TestDFSIO -read -nrFile

千家信息网最后更新 2025年01月25日HADOOP中HDFS基准测试

hdfs 基准测试：

磁盘读写性能测试

hadoop jar ./hadoop-mapreduce-client-jobclient-2.7.2.3.jar TestDFSIO -read -nrFiles 10 -fileSize 10MBhadoop jar ./hadoop-mapreduce-client-jobclient-2.7.2.3.jar TestDFSIO -write -nrFiles 10 -fileSize 10MB

dev环境：
read:

19/06/28 08:14:45 INFO fs.TestDFSIO: ----- TestDFSIO ----- : read19/06/28 08:14:45 INFO fs.TestDFSIO:            Date & time: Fri Jun 28 08:14:45 CST 201919/06/28 08:14:45 INFO fs.TestDFSIO:        Number of files: 1019/06/28 08:14:45 INFO fs.TestDFSIO: Total MBytes processed: 100.019/06/28 08:14:45 INFO fs.TestDFSIO:      Throughput mb/sec: 1369.8630136986319/06/28 08:14:45 INFO fs.TestDFSIO: Average IO rate mb/sec: 1448.01586914062519/06/28 08:14:45 INFO fs.TestDFSIO:  IO rate std deviation: 313.016840947768119/06/28 08:14:45 INFO fs.TestDFSIO:     Test exec time sec: 1.444

write:

19/06/28 08:17:58 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write19/06/28 08:17:58 INFO fs.TestDFSIO:            Date & time: Fri Jun 28 08:17:58 CST 201919/06/28 08:17:58 INFO fs.TestDFSIO:        Number of files: 1019/06/28 08:17:58 INFO fs.TestDFSIO: Total MBytes processed: 100.019/06/28 08:17:58 INFO fs.TestDFSIO:      Throughput mb/sec: 94.250706880301619/06/28 08:17:58 INFO fs.TestDFSIO: Average IO rate mb/sec: 94.3214874267578119/06/28 08:17:58 INFO fs.TestDFSIO:  IO rate std deviation: 2.578073452981487719/06/28 08:17:58 INFO fs.TestDFSIO:     Test exec time sec: 2.48219/06/28 08:17:58 INFO fs.TestDFSIO:

很赞哦！