Re: Question For Twister4Azure

57 views
Skip to first unread message

Thilina Gunarathne

unread,
Sep 2, 2012, 6:10:21 PM9/2/12
to Jian Syuan Wong, twiste...@googlegroups.com
Hi Shane,
I fixed that issue. Please test and let me know.

thanks,
Thilina

On Sun, Sep 2, 2012 at 5:02 PM, Thilina Gunarathne <tgun...@indiana.edu> wrote:
I found the issue. Will upload a fix soon.  We've been doing lot of optimizations lately for iterative MapReduce computations, which seems to have broken other things :(..

Thanks for finding the issue. 

thanks,
Thilina


On Sun, Sep 2, 2012 at 4:13 PM, Jian Syuan Wong <jwo...@student.gsu.edu> wrote:
Hi Thilina,

I ran the WordCount example with the latest version I download today (modified on Sep 1), but the output result only shows one key value pair (one result). I used the sample data included in MapReduceRole4Azure.

I tried to debug the Map and Reduce task, and I found both of them worked well. However, there is only one key value pair left when I checked the SequenceOutputFormat class. Do you have an ideal what problem it might be?

Thanks,
Shane

From: cse...@gmail.com [cse...@gmail.com] on behalf of Thilina Gunarathne [tgun...@indiana.edu]
Sent: Friday, August 31, 2012 4:12 PM

To: Jian Syuan Wong
Subject: Re: Question For Twister4Azure

Hi Shane,
I updated the repository. The Wordcount sample in the latest source code should work out of the box with the development storage. 

Sorry, we had to remove certain things when making this opensource and that seems to have broken few things. I'll also test the rest of the applications in the coming days.

Please open an issue in  http://twister4azure.codeplex.com/workitem/list/basic  in case you encounter any issues with the latest source code. You can also mail me or the group as well.

thanks,
Thilina

On Fri, Aug 31, 2012 at 11:21 AM, Thilina Gunarathne <tgun...@indiana.edu> wrote:
I just fixed it a while ago. I'll test wordcount and will commit the changes and let you know.

thanks,
Thilina


On Fri, Aug 31, 2012 at 10:55 AM, Jian Syuan Wong <jwo...@student.gsu.edu> wrote:
 Hi Thilina,

I just tried to run the latest version of Twister4Azure ,
In the Twister4Azure project, it shows 4 error message and 1 warning:
1.
The type or namespace name 'ZipFile' could not be found (are you missing a using directive or an assembly reference?)  \twister4azure_ddd4faf6cc74\Samples\Blast\BlastWorker\BlastMR.cs
2.
The name 'ZipFile' does not exist in the current context \twister4azure_ddd4faf6cc74\Samples\Blast\BlastWorker\BlastMR.cs
3.
Metadata file '\twister4azure_ddd4faf6cc74\Samples\Blast\BlastWorker\bin\Debug\BlastWorkerSample.dll' could not be found. 
4.
WAT070 : The referenced assembly \twister4azure_ddd4faf6cc74\Twister4AzureWorker\bin\Debug\Twister4AzureWorker.dll was not found. Please make sure to build the role project that produces this assembly before building this Windows Azure Cloud Service Project. C:\Program Files (x86)\MSBuild\Microsoft\VisualStudio\v10.0\Windows Azure Tools\1.7\Microsoft.WindowsAzure.targets

Warning message:
The referenced component 'Ionic.Zip' could not be found.

For SampleClient project, I got a error message for all the clients.
I am not sure whether it's because the version of my vs2010 or sdk. In order to run these project, I just updated them to the latest version.

Error message:

Assembly 'AzureMRCore, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null' uses 'Microsoft.WindowsAzure.StorageClient, Version=1.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' which has a higher version than referenced assembly 'Microsoft.WindowsAzure.StorageClient, Version=1.1.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' \twister4azure_ddd4faf6cc74\AzureMRCore\bin\Debug\AzureMRCore.dll WordCountMRClient

Thanks,
Shane  



From: cse...@gmail.com [cse...@gmail.com] on behalf of Thilina Gunarathne [tgun...@indiana.edu]
Sent: Thursday, August 30, 2012 4:40 PM
To: Jian Syuan Wong
Subject: Re: Question For Twister4Azure

Hi Shane,
We are working on open sourcing the Twister4Azure at  http://twister4azure.codeplex.com/. All the code is now in that project under the Apache License. I'm still working on creating the new release, testing and writing documentation. 

In the mean time, you can try downloading the latest source code by going to  http://twister4azure.codeplex.com/SourceControl/list/changesets  and clicking "download" under the "Latest Version". Then you can try to run it. I'll also test the latest version tonight and let you know.

Thanks for your patience and continued interest in Twister4Azure.

thanks,
Thilina

PS: Please try to use http://groups.google.com/group/twister4azure mailing list or the http://twister4azure.codeplex.com/discussions forum for questions, so that we would not miss your mails.

On Sun, Aug 26, 2012 at 4:51 PM, Jian Syuan Wong <jwo...@student.gsu.edu> wrote:
Hi  Thilina,
Do you have a new release for wordCount and k-means example?
I downloaded the files, copied, and replaced with the project, but I still the follosing errors.
Could you help me to fix the problem?

1.The type or namespace name 'Drivers' does not exist in the namespace 'AzureMRCore' (are you missing an assembly reference?)  'C:\Twister4Azure-Alpha-3\Samples\WordCount\WCWorker\WordCountMR.cs

2.The type or namespace name 'MapReduceDriver' could not be found (are you missing a using directive or an assembly reference?)  'C:\Twister4Azure-Alpha-3\Samples\WordCount\WCWorker\WordCountMR.cs

3.Metadata file 'C:\Twister4Azure-Alpha-3\Samples\WordCount\WCWorker\bin\Debug\WordCountSample.dll' could not be found

4.WAT070 : The referenced assembly C:\Twister4Azure-Alpha-3\Twister4AzureWorker\bin\Debug\Twister4AzureWorker.dll was not found. Please make sure to build the role project that produces this assembly before building this Windows Azure Project. C:\Program Files (x86)\MSBuild\Microsoft\VisualStudio\v10.0\Windows Azure Tools\1.6\Microsoft.WindowsAzure.targets

Thank you very much,
Sincerely,
Shane
From: cse...@gmail.com [cse...@gmail.com] on behalf of Thilina Gunarathne [tgun...@indiana.edu]
Sent: Monday, May 14, 2012 5:35 AM
To: Jian Syuan Wong
Subject: Re: Question For Twister4Azure

Hi Jian,
Thanks for your interest in using Twister4Azure.

This is a known bug in the sequence output format  (introduced by a method extension experiment gone wrong)  that managed to slip through our hands when we were testing the alpha-3 release.
 
The word count package on [1] should fix this particular issue.  I added the correct output format to the word count project it self, so that you can get alone by updating only that project. We are currently working on open sourcing Twister4Azure and performing a more stable release with many new features. My apologies for the inconvenience.
 
thanks,
Thilina

PS: Apologies for the delay in responding. I'm currently traveling and will be back to the normal schedule from early June.
 
[1] http://dl.dropbox.com/u/12951553/WCWorker.zip

On Sun, May 13, 2012 at 2:40 AM, Jian Syuan Wong <jwo...@student.gsu.edu> wrote:
Hi Thilina,

I am a new user of Twister4Azure.
I had a problem that when I tried to execute the word count example in Twister4Azure sample.
The output results had a weird format such as:

"##AzureMRCore.DataTypes.IntValue
"a##AzureMRCore.DataTypes.IntValue
"A##AzureMRCore.DataTypes.IntValue
"About##AzureMRCore.DataTypes.IntValue
"After##AzureMRCore.DataTypes.IntValue
"Agatha##AzureMRCore.DataTypes.IntValue


The current version of Azure SDK is V1.6 and  version of Twister4Azure is Twister4Azure-Alpha-3.
The attachment is the output file. Could you give me some help for this problem.
Thank you very much.

Sincerely,
Shane 






--
Thilina Gunarathne  - http://thilinag.blogspot.com



--
https://www.cs.indiana.edu/~tgunarat/
http://www.linkedin.com/in/thilina



--
https://www.cs.indiana.edu/~tgunarat/
http://www.linkedin.com/in/thilina



--
https://www.cs.indiana.edu/~tgunarat/
http://www.linkedin.com/in/thilina



--
https://www.cs.indiana.edu/~tgunarat/
http://www.linkedin.com/in/thilina



--
https://www.cs.indiana.edu/~tgunarat/
http://www.linkedin.com/in/thilina
Reply all
Reply to author
Forward
0 new messages