[HLFS] HLFS IO Performance

3 views
Skip to first unread message

harryxiyou

unread,
May 19, 2013, 10:36:43 AM5/19/13
to clo...@googlegroups.com, Kang Hua
Hi all,

最近,我把测试了一下HLFS的I/O,自己写程序测试的,得到了一些
能说明问题的数据,并且从理论上也验证了测试数据的正确性。

1, 测试I/O前关闭了HLFS缓冲
2, 测试前关闭了所有信息输出,因为他们影响I/O

得到以下对比数据

Conclusions

Write SEQ

Parameter HLFS(MB/s) HDFS(MB/s) Percent(HLFS/HDFS)
BS=8K, SIZE=500M 96.603293 121.302870 %79.34
BS=8K, SIZE=100M 81.852351 101.024591 %80.20
bs=8K size=50M 66.130306 70.212885 %94.29
bs=8K size=30M 59.562691 70.661557 %84.29
bs=8K size=10M 34.460063 37.793323 %91.90
bs=8K size=1M 5.694599 14.682994 %35.71

HINTS:
1, The percentage of HLFS/HDFS is almost %80 --- %90.
2, The last one says HDFS is really for large datas!

Read SEQ

Parameter HLFS(MB/s) HDFS(MB/s) Percent(HLFS/HDFS)
BS=8K, SIZE=500M 103.661705 148.397059 %70.00
BS=8K, SIZE=100M 115.244018 138.883874 %83.33
bs=8K size=50M 168.971437 123.734812 %136.59
bs=8K size=20M 143.544104 101.496567 %141.58
bs=8K size=10M 310.694091 75.263800 %413.33
bs=8K size=1M 257.003341 21.067268 %1223.80

HINTS:
1, HLFS has a wonderful read performance for small datas (because of
i-node structure).
2, HDFS is better for large datas!


测试代码和数据详见
https://code.google.com/p/hlfs/wiki/HLFSIOPerformance


--
Thanks
Harry Wei

Chen Lijun

unread,
May 20, 2013, 3:33:45 AM5/20/13
to clo...@googlegroups.com


与我们期望的差不多。


>
>
>--
>Thanks
>Harry Wei
>
>-- 
>您收到此邮件是因为您订阅了 Google 网上论坛的“cloudxy”论坛。
>要退订此论坛并停止接收此论坛的电子邮件,请发送电子邮件到 cloudxy+u...@googlegroups.com。
>要查看更多选项,请访问 https://groups.google.com/groups/opt_out。
>
>


Reply all
Reply to author
Forward
0 new messages