installation
49 views
Skip to first unread message
Keren-Audrey Ouaknine
Jun 18, 2012, 10:34:05 AM6/18/12
to hyrack...@googlegroups.com
Hello,
I would like to install Hyracks, and followed
Some configuration details are missing:
- where is the list of slaves and master configured?
- on which port are the processes running?
In the meantime, I have checked-out the source and built the project (maven package).
It didn't generate the executables to run hyracks: hyrackscc, etc
Thanks,
Keren
Vinayak Borkar
Jun 18, 2012, 1:12:44 PM6/18/12
to hyrack...@googlegroups.com
Hi Keren,
To start Hyracks on a cluster, you will first need to have the built
project on a filesystem accessible by all the machines. One way is to
use an NFS partition to build Hyracks if your cluster is based on Linux.
You should find the scripts to start the Hyracks Cluster Controller and
the Hyracks Node Controllers in
hyracks-server/target/hyracks-server/target/hyracks-server-<VERSION>-binary-assembly/bin
At this time, you will need to start the CC on the master node and use
ssh to each slave node to start the NCs. I will soon attach the scripts
we use to do this to the Downloads page of Hyracks.
Thanks,
Vinayak
To start Hyracks on a cluster, you will first need to have the built
project on a filesystem accessible by all the machines. One way is to
use an NFS partition to build Hyracks if your cluster is based on Linux.
You should find the scripts to start the Hyracks Cluster Controller and
the Hyracks Node Controllers in
hyracks-server/target/hyracks-server/target/hyracks-server-<VERSION>-binary-assembly/bin
At this time, you will need to start the CC on the master node and use
ssh to each slave node to start the NCs. I will soon attach the scripts
we use to do this to the Downloads page of Hyracks.
Thanks,
Vinayak
Keren Ouaknine
Jun 19, 2012, 4:00:53 AM6/19/12
to hyrack...@googlegroups.com, vina...@gmail.com
Thanks Vinayak. Yes, I am building hyracks on a Linux cluster and my server is accessible by all nodes.
However, I cant see a target folder as expected under hyracks-server folder.
The files I see are the same ones like in the following path:
So I am still looking to have executables to run the server and the slaves.
I understand there is no slave file to list the slaves, what happens when you have two versions of hyracks running on the same cluster? let's say: 10.239.24.1..11 running one version and 10.239.24.12..22 running another, if the NC talks directly to CC how does the CC knows if NC belongs to its list of nodes or not?
Thanks,
Keren
Vinayak Borkar
Jun 19, 2012, 5:07:55 AM6/19/12
to Keren Ouaknine, hyrack...@googlegroups.com
Hi Keren,
Can you send the output of running "mvn package" from the hyracks-0.2.0
folder?
Thanks,
Vinayak
On 6/19/12 1:00 AM, Keren Ouaknine wrote:
> Thanks Vinayak. Yes, I am building hyracks on a Linux cluster and my server
> is accessible by all nodes.
>
> However, I cant see a target folder as expected under hyracks-server
> folder.
> The files I see are the same ones like in the following path:
> http://hyracks.googlecode.com/svn/tags/hyracks-0.2.0/hyracks-server/
>
> So I am still looking to have executables to run the server and the slaves.
> I understand there is no slave file to list the slaves, what happens when
> you have two versions of hyracks running on the same cluster? let's say:
> 10.239.24.1..11 running one version and 10.239.24.12..22 running another,
> if the NC talks directly to CC how does the CC knows if NC belongs to its
> list of nodes or not?
>
> Thanks,
> Keren
>
> On Mon, Jun 18, 2012 at 8:12 PM, Vinayak Borkar <vina...@gmail.com> wrote:
>
>> Hi Keren,
>>
>>
>> To start Hyracks on a cluster, you will first need to have the built
>> project on a filesystem accessible by all the machines. One way is to use
>> an NFS partition to build Hyracks if your cluster is based on Linux.
>>
>> You should find the scripts to start the Hyracks Cluster Controller and
>> the Hyracks Node Controllers in hyracks-server/target/hyracks-**
>> server/target/hyracks-server-<**VERSION>-binary-assembly/bin
Can you send the output of running "mvn package" from the hyracks-0.2.0
folder?
Thanks,
Vinayak
On 6/19/12 1:00 AM, Keren Ouaknine wrote:
> Thanks Vinayak. Yes, I am building hyracks on a Linux cluster and my server
> is accessible by all nodes.
>
> However, I cant see a target folder as expected under hyracks-server
> folder.
> The files I see are the same ones like in the following path:
> http://hyracks.googlecode.com/svn/tags/hyracks-0.2.0/hyracks-server/
>
> So I am still looking to have executables to run the server and the slaves.
> I understand there is no slave file to list the slaves, what happens when
> you have two versions of hyracks running on the same cluster? let's say:
> 10.239.24.1..11 running one version and 10.239.24.12..22 running another,
> if the NC talks directly to CC how does the CC knows if NC belongs to its
> list of nodes or not?
>
> Thanks,
> Keren
>
> On Mon, Jun 18, 2012 at 8:12 PM, Vinayak Borkar <vina...@gmail.com> wrote:
>
>> Hi Keren,
>>
>>
>> To start Hyracks on a cluster, you will first need to have the built
>> project on a filesystem accessible by all the machines. One way is to use
>> an NFS partition to build Hyracks if your cluster is based on Linux.
>>
>> You should find the scripts to start the Hyracks Cluster Controller and
>> server/target/hyracks-server-<**VERSION>-binary-assembly/bin
>>
>> At this time, you will need to start the CC on the master node and use ssh
>> to each slave node to start the NCs. I will soon attach the scripts we use
>> to do this to the Downloads page of Hyracks.
>>
>>
>> Thanks,
>> Vinayak
>>
>>
>> On 6/18/12 7:34 AM, Keren-Audrey Ouaknine wrote:
>>
>>> Hello,
>>>
>>> I would like to install Hyracks, and followed
>>> http://code.google.com/p/**hyracks/wiki/QuickStartGuide<http://code.google.com/p/hyracks/wiki/QuickStartGuide>
>> At this time, you will need to start the CC on the master node and use ssh
>> to each slave node to start the NCs. I will soon attach the scripts we use
>> to do this to the Downloads page of Hyracks.
>>
>>
>> Thanks,
>> Vinayak
>>
>>
>> On 6/18/12 7:34 AM, Keren-Audrey Ouaknine wrote:
>>
>>> Hello,
>>>
>>> I would like to install Hyracks, and followed
Vinayak Borkar
Jun 22, 2012, 6:07:09 AM6/22/12
to hyrack...@googlegroups.com
Keren,
It looks like your command results in a build failure -- that is the
reason you do not have the scripts.
The reason for the failure seems to be that some of the Java files
contain characters that are UTF8 encoded whereas your default platform
encoding is ANSI_X3.4-1968.
Can you try:
mvn package -Dproject.build.sourceEncoding=UTF-8
Thanks,
Vinayak
On 6/19/12 1:00 AM, Keren Ouaknine wrote:
>> server/target/hyracks-server-<**VERSION>-binary-assembly/bin
It looks like your command results in a build failure -- that is the
reason you do not have the scripts.
The reason for the failure seems to be that some of the Java files
contain characters that are UTF8 encoded whereas your default platform
encoding is ANSI_X3.4-1968.
Can you try:
mvn package -Dproject.build.sourceEncoding=UTF-8
Thanks,
Vinayak
On 6/19/12 1:00 AM, Keren Ouaknine wrote:
> Thanks Vinayak. Yes, I am building hyracks on a Linux cluster and my server
> is accessible by all nodes.
>
> However, I cant see a target folder as expected under hyracks-server
> folder.
> The files I see are the same ones like in the following path:
> http://hyracks.googlecode.com/svn/tags/hyracks-0.2.0/hyracks-server/
>
> So I am still looking to have executables to run the server and the slaves.
> I understand there is no slave file to list the slaves, what happens when
> you have two versions of hyracks running on the same cluster? let's say:
> 10.239.24.1..11 running one version and 10.239.24.12..22 running another,
> if the NC talks directly to CC how does the CC knows if NC belongs to its
> list of nodes or not?
>
> Thanks,
> Keren
>
> On Mon, Jun 18, 2012 at 8:12 PM, Vinayak Borkar <vina...@gmail.com> wrote:
>
>> Hi Keren,
>>
>>
>> To start Hyracks on a cluster, you will first need to have the built
>> project on a filesystem accessible by all the machines. One way is to use
>> an NFS partition to build Hyracks if your cluster is based on Linux.
>>
>> You should find the scripts to start the Hyracks Cluster Controller and
>> the Hyracks Node Controllers in hyracks-server/target/hyracks-**
> is accessible by all nodes.
>
> However, I cant see a target folder as expected under hyracks-server
> folder.
> The files I see are the same ones like in the following path:
> http://hyracks.googlecode.com/svn/tags/hyracks-0.2.0/hyracks-server/
>
> So I am still looking to have executables to run the server and the slaves.
> I understand there is no slave file to list the slaves, what happens when
> you have two versions of hyracks running on the same cluster? let's say:
> 10.239.24.1..11 running one version and 10.239.24.12..22 running another,
> if the NC talks directly to CC how does the CC knows if NC belongs to its
> list of nodes or not?
>
> Thanks,
> Keren
>
> On Mon, Jun 18, 2012 at 8:12 PM, Vinayak Borkar <vina...@gmail.com> wrote:
>
>> Hi Keren,
>>
>>
>> To start Hyracks on a cluster, you will first need to have the built
>> project on a filesystem accessible by all the machines. One way is to use
>> an NFS partition to build Hyracks if your cluster is based on Linux.
>>
>> You should find the scripts to start the Hyracks Cluster Controller and
>> server/target/hyracks-server-<**VERSION>-binary-assembly/bin
>>
>> At this time, you will need to start the CC on the master node and use ssh
>> to each slave node to start the NCs. I will soon attach the scripts we use
>> to do this to the Downloads page of Hyracks.
>>
>>
>> Thanks,
>> Vinayak
>>
>>
>> On 6/18/12 7:34 AM, Keren-Audrey Ouaknine wrote:
>>
>>> Hello,
>>>
>>> I would like to install Hyracks, and followed
>>> http://code.google.com/p/**hyracks/wiki/QuickStartGuide<http://code.google.com/p/hyracks/wiki/QuickStartGuide>
>> At this time, you will need to start the CC on the master node and use ssh
>> to each slave node to start the NCs. I will soon attach the scripts we use
>> to do this to the Downloads page of Hyracks.
>>
>>
>> Thanks,
>> Vinayak
>>
>>
>> On 6/18/12 7:34 AM, Keren-Audrey Ouaknine wrote:
>>
>>> Hello,
>>>
>>> I would like to install Hyracks, and followed
Keren Ouaknine
Jun 22, 2012, 6:51:47 AM6/22/12
to hyrack...@googlegroups.com
Thanks Vinayak! Sorry, the flag didn't help. I got a compilation failure (details below).
Building Unnamed - edu.uci.ics.hyracks:hyracks-dataflow-std:jar:0.2.0
[INFO] task-segment: [package]
[INFO] ------------------------------------------------------------------------
[INFO] [resources:resources]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /mnt/disk1/home/kouaknine/hyracks-0.2.0/hyracks-dataflow-std/src/main/resources
[INFO] [compiler:compile]
[INFO] Compiling 120 source files to /mnt/disk1/home/kouaknine/hyracks-0.2.0/hyracks-dataflow-std/target/classes
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Compilation failure
Vinayak Borkar
Jun 28, 2012, 2:41:11 PM6/28/12
to hyrack...@googlegroups.com
Hi Keren,
Can you try to build the code from the head of
https://hyracks.googlecode.com/svn/branches/hyracks_asterix_stabilization
I have cleaned up the non-compliant characters in that branch. This
branch also represents the code that will become the next release.
Thanks,
Vinayak
>> mvn package -Dproject.build.**sourceEncoding=UTF-8
>>>> server/target/hyracks-server-<****VERSION>-binary-assembly/bin
>>>>> <h**ttp://code.google.com/p/**hyracks/wiki/QuickStartGuide<http://code.google.com/p/hyracks/wiki/QuickStartGuide>
Can you try to build the code from the head of
https://hyracks.googlecode.com/svn/branches/hyracks_asterix_stabilization
I have cleaned up the non-compliant characters in that branch. This
branch also represents the code that will become the next release.
Thanks,
Vinayak
>>
>>
>>
>> Thanks,
>> Vinayak
>>
>>
>> On 6/19/12 1:00 AM, Keren Ouaknine wrote:
>>
>>> Thanks Vinayak. Yes, I am building hyracks on a Linux cluster and my
>>> server
>>> is accessible by all nodes.
>>>
>>> However, I cant see a target folder as expected under hyracks-server
>>> folder.
>>> The files I see are the same ones like in the following path:
>>> http://hyracks.googlecode.com/**svn/tags/hyracks-0.2.0/**hyracks-server/<http://hyracks.googlecode.com/svn/tags/hyracks-0.2.0/hyracks-server/>
>>
>>
>> Thanks,
>> Vinayak
>>
>>
>> On 6/19/12 1:00 AM, Keren Ouaknine wrote:
>>
>>> Thanks Vinayak. Yes, I am building hyracks on a Linux cluster and my
>>> server
>>> is accessible by all nodes.
>>>
>>> However, I cant see a target folder as expected under hyracks-server
>>> folder.
>>> The files I see are the same ones like in the following path:
>>>
>>> So I am still looking to have executables to run the server and the
>>> slaves.
>>> I understand there is no slave file to list the slaves, what happens when
>>> you have two versions of hyracks running on the same cluster? let's say:
>>> 10.239.24.1..11 running one version and 10.239.24.12..22 running another,
>>> if the NC talks directly to CC how does the CC knows if NC belongs to its
>>> list of nodes or not?
>>>
>>> Thanks,
>>> Keren
>>>
>>> On Mon, Jun 18, 2012 at 8:12 PM, Vinayak Borkar <vina...@gmail.com>
>>> wrote:
>>>
>>> Hi Keren,
>>>>
>>>>
>>>> To start Hyracks on a cluster, you will first need to have the built
>>>> project on a filesystem accessible by all the machines. One way is to use
>>>> an NFS partition to build Hyracks if your cluster is based on Linux.
>>>>
>>>> You should find the scripts to start the Hyracks Cluster Controller and
>>>> the Hyracks Node Controllers in hyracks-server/target/hyracks-****
>>> So I am still looking to have executables to run the server and the
>>> slaves.
>>> I understand there is no slave file to list the slaves, what happens when
>>> you have two versions of hyracks running on the same cluster? let's say:
>>> 10.239.24.1..11 running one version and 10.239.24.12..22 running another,
>>> if the NC talks directly to CC how does the CC knows if NC belongs to its
>>> list of nodes or not?
>>>
>>> Thanks,
>>> Keren
>>>
>>> On Mon, Jun 18, 2012 at 8:12 PM, Vinayak Borkar <vina...@gmail.com>
>>> wrote:
>>>
>>> Hi Keren,
>>>>
>>>>
>>>> To start Hyracks on a cluster, you will first need to have the built
>>>> project on a filesystem accessible by all the machines. One way is to use
>>>> an NFS partition to build Hyracks if your cluster is based on Linux.
>>>>
>>>> You should find the scripts to start the Hyracks Cluster Controller and
>>>> server/target/hyracks-server-<****VERSION>-binary-assembly/bin
>>>>
>>>>
>>>> At this time, you will need to start the CC on the master node and use
>>>> ssh
>>>> to each slave node to start the NCs. I will soon attach the scripts we
>>>> use
>>>> to do this to the Downloads page of Hyracks.
>>>>
>>>>
>>>> Thanks,
>>>> Vinayak
>>>>
>>>>
>>>> On 6/18/12 7:34 AM, Keren-Audrey Ouaknine wrote:
>>>>
>>>> Hello,
>>>>>
>>>>> I would like to install Hyracks, and followed
>>>>> http://code.google.com/p/****hyracks/wiki/QuickStartGuide<http://code.google.com/p/**hyracks/wiki/QuickStartGuide>
>>>>
>>>> At this time, you will need to start the CC on the master node and use
>>>> ssh
>>>> to each slave node to start the NCs. I will soon attach the scripts we
>>>> use
>>>> to do this to the Downloads page of Hyracks.
>>>>
>>>>
>>>> Thanks,
>>>> Vinayak
>>>>
>>>>
>>>> On 6/18/12 7:34 AM, Keren-Audrey Ouaknine wrote:
>>>>
>>>> Hello,
>>>>>
>>>>> I would like to install Hyracks, and followed
>>>>> <h**ttp://code.google.com/p/**hyracks/wiki/QuickStartGuide<http://code.google.com/p/hyracks/wiki/QuickStartGuide>
Keren-Audrey Ouaknine
Jul 1, 2012, 10:27:45 AM7/1/12
to hyrack...@googlegroups.com
Hello Vinayak,
Thanks! I tried the stabilization version and still got a compilation error..
[INFO] Compiling 3 source files to /mnt/disk1/home/kouaknine/hyracks_asterix_stabilization/hyracks-algebricks/hyracks-algebricks-tests/target/test-classes
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
I tried building on my laptop (centos 6.2) hyracks v2.0 and it worked fine!
I launched the wordcount example and encountered a class not found error (I printed the classpath to make sure it includes a path to the missing file).
Didn't seem to help.
Thanks,
Keren
[root@keren bin]# ./textclient -host "172.20.10.3" -app text -infile-splits "NC1:</home/kereno/derby.log>" -outfile-splits "NC2:/tmp/output" -algo hash
CLASSPATH = :/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/etc:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/hyracks-dataflow-std-0.2.0.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/hyracks-api-0.2.0.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/json-20090211.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/httpclient-4.1-alpha2.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/httpcore-4.1-beta1.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/commons-logging-1.1.1.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/commons-codec-1.4.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/args4j-2.0.12.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/hyracks-ipc-0.2.0.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/commons-lang3-3.1.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/hyracks-dataflow-common-0.2.0.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/hyracks-data-std-0.2.0.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/texthelper-0.2.0.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-examples/text-example/textclient/target/textclient-0.2.0-binary-assembly/lib/textclient-0.2.0.jar:/home/kereno/hadoop23/hyracks-0.2.0/hyracks-api/target/classes/edu/uci/ics/hyracks/api/job
Exception in thread "main" edu.uci.ics.hyracks.api.exceptions.HyracksException: java.lang.ClassNotFoundException: edu/uci/ics/hyracks/api/job/JobSpecification
at edu.uci.ics.hyracks.control.cc.job.DeserializingJobSpecificationFactory.createJobSpecification(DeserializingJobSpecificationFactory.java:40)
at edu.uci.ics.hyracks.control.cc.application.CCApplicationContext.createJobSpecification(CCApplicationContext.java:75)
at edu.uci.ics.hyracks.control.cc.work.JobCreateWork.doRun(JobCreateWork.java:61)
at edu.uci.ics.hyracks.control.common.work.SynchronizableWork.run(SynchronizableWork.java:32)
at edu.uci.ics.hyracks.control.common.work.WorkQueue$WorkerThread.run(WorkQueue.java:115)
Caused by: java.lang.ClassNotFoundException: edu/uci/ics/hyracks/api/job/JobSpecification
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at edu.uci.ics.hyracks.api.util.JavaSerializationUtils$ClassLoaderObjectInputStream.resolveClass(JavaSerializationUtils.java:61)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1574)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1495)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1731)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1328)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:350)
at edu.uci.ics.hyracks.api.util.JavaSerializationUtils.deserialize(JavaSerializationUtils.java:44)
at edu.uci.ics.hyracks.control.cc.job.DeserializingJobSpecificationFactory.createJobSpecification(DeserializingJobSpecificationFactory.java:36)
... 4 more
[root@keren bin]# ls /home/kereno/hadoop23/hyracks-0.2.0/hyracks-api/target/classes/edu/uci/ics/hyracks/api/job
IJobletEventListener.class IJobLifecycleListener.class IOperatorEnvironment.class JobFlag.class JobSpecification.class profiling
IJobletEventListenerFactory.class IJobSpecificationFactory.class JobActivityGraph.class JobId.class JobStatus.class
[root@keren bin]#
Reply all
Reply to author
Forward
0 new messages