Hi all,
最近,我把测试了一下HLFS的I/O,自己写程序测试的,得到了一些
能说明问题的数据,并且从理论上也验证了测试数据的正确性。
1, 测试I/O前关闭了HLFS缓冲
2, 测试前关闭了所有信息输出,因为他们影响I/O
得到以下对比数据
Conclusions
Write SEQ
Parameter HLFS(MB/s) HDFS(MB/s) Percent(HLFS/HDFS)
BS=8K, SIZE=500M 96.603293 121.302870 %79.34
BS=8K, SIZE=100M 81.852351 101.024591 %80.20
bs=8K size=50M 66.130306 70.212885 %94.29
bs=8K size=30M 59.562691 70.661557 %84.29
bs=8K size=10M 34.460063 37.793323 %91.90
bs=8K size=1M 5.694599 14.682994 %35.71
HINTS:
1, The percentage of HLFS/HDFS is almost %80 --- %90.
2, The last one says HDFS is really for large datas!
Read SEQ
Parameter HLFS(MB/s) HDFS(MB/s) Percent(HLFS/HDFS)
BS=8K, SIZE=500M 103.661705 148.397059 %70.00
BS=8K, SIZE=100M 115.244018 138.883874 %83.33
bs=8K size=50M 168.971437 123.734812 %136.59
bs=8K size=20M 143.544104 101.496567 %141.58
bs=8K size=10M 310.694091 75.263800 %413.33
bs=8K size=1M 257.003341 21.067268 %1223.80
HINTS:
1, HLFS has a wonderful read performance for small datas (because of
i-node structure).
2, HDFS is better for large datas!
测试代码和数据详见
https://code.google.com/p/hlfs/wiki/HLFSIOPerformance
--
Thanks
Harry Wei