cloudtw1 meeting wrapup; Eucalyptus installfest; cloudtw2 meeting
michael
We had another great meeting last night. Thanks for choupi for
providing us an overview of the Hadoop stack (incl HDFS and HBase) and
pofeng (using Google Storage).
As we mentioned in the meeting, we (pofeng and I) are meeting with
OpenFoundry tomorrow regarding the Eucalyptus installfest. Please
respond to this message and provide us with some information if you
are interested in the participating in the installfest
* will you be using your own hardware (see
http://groups.google.com/group/cloudtw/web/eucalyptus-installfest for
hardware requirements), or do you need some or all of the required
hardware.
* what times are most convenient for you?
Also, please see the page on the next meeting, and add your
availability times. Next meeting will be very exciting, as we already
have the two speakers lined up. ethan will be giving us an overview
of the improvements that Hadoop 0.21 provides over 0.20 (over 1300+
tickets closed!) and cclient will be giving an overview of Ceph, an
open source distributed file system that was recently added to the
Linux kernel.
Cheers
Mike
李柏鋒 (Pofeng Lee)
> ethan will be giving us an overview
> of the improvements that Hadoop 0.21 provides over 0.20 (over 1300+
> tickets closed!) and cclient will be giving an overview of Ceph, an
> open source distributed file system that was recently added to the
> Linux kernel.
謝謝 michael and choupi 和我們分享
如果方便的話, 能否請 choupi 分享一下 slide
非常感謝
Hadoop 我不是很懂，歡迎大家補充一下筆記
我把我自己的筆記，野人獻曝一下
1. Google storage 提供一個 command line 的操作工具 gsutil
而 gsutil 的底層是 boto,
michael: boto 的作者現在任職於 eucalyptus.com
http://code.google.com/p/boto/
2. choupi: 台大計中採用 MCloud / Hyper-V
Hyper-V 的優勢是, 如果買 Datacenter version,
其 guest OS - Windows 全部免費授權
VMware 台灣的代理商是 群環
VMware solution: VMWare vSphere / VMware vCenter
3. Arthur 問: 是否有支援 排列成多行 checkbox 的 form ?
pofeng: 可以試試 Zoho creator ( zoho.com ) 支援兩個 column
wufoo.com 也可看看 ( 但是不支援兩個 column )
我自己其實不會寫程式，所以如果朋友只是單純的使用
SaaS ，也歡迎一起討論
另外自己賀一下，Eucalyptus compile 過了
ref: http://open.eucalyptus.com/wiki/EucalyptusInstallation_v2.0
只有一個地方要改一下
export JAVA_HOME="/usr/lib/jvm/java-6-openjdk"
--
Pofeng "informer" Lee, 李柏鋒, pofeng at gmail dot com
Sam Wu
我也寫一下我的 ( 一直分心在弄朋友的機器 , 所以好像也沒記到重點 :P ) , 然後不知道對不對 . 請大大們指教 .
hadoop
clone of google solution ,
Google file system : HDFS, 大量 replication.
MapReduce : Hadoop MapReduce : 2 stage , mapper , reducer
(processing )
HDFS
有 namenode , datanode , secondary namenode
namenode : SPOF
single namemode : battleneck
backup: memory dump
HDFS 有 permission 設定
job tracker:分配工作 , task tracker: maper and reducer工作用
scheduler: fairshare scheduler(在同一time period , 可以拿到同樣的 resource ?) ,
capacity scheduler
Hbase
Role : master , region server
整個 db 是很大的 table , 每個 region 有很多 colum
zookeeper 當 region 掛了, 檔案都在 hdfs (?) hadoop's chubby
BTW , 這次參加的名單有(依簽到序) : Fattom , SamWu , Michael , blue119 , Gavin ,
Sakana , Choupi , Choupi 閃光 , Ethan , cclien , pofeng , RAY ,
hsiaulong , Kevin , Arthur Lu.
以上請大大們賜正 .. 感恩 .
Sam
Chou, Ping-I
李柏鋒 (Pofeng Lee)
Max
Hadoop with openSUSE Lab 文件
https://docs.google.com/document/edit?id=1V581pJGih59UyzVtC4yYMkYh467JqJcQmMrGOWTx3eY&hl=zh_TW&authkey=CNvgsKID
希望有一點點幫助
Best regards
sakana
--
_/_/ openSUSE Ambassador - Taiwan _/_/
_/_/ Weekly News Team _/_/
_/_/ mail: sakanamax_at_gmail.com _/_/
_/_/ twitter: sakanamax _/_/
_/_/ nickname: sakana _/_/
--