DataTorrent setup.

[akshay naidu]

Hello Users,

I have installed DataTorrent on my Laptop having 4GB RAM.

Hadoop-2.7.3 (local mode) and Kafka Is also installed and running.

DataTorrent is properly installed and running on my system but when I launch an App the computer get too slow. Even Switching Tabs takes minutes, mouse hangs, every action takes a long time to response. This happens only after I launch an application in datatorrent , otherwise my laptop runs fine. I believe this is because of low RAM as the requirement to run DataTorrent is 8GB.

1. Is there a way with which I can speed up the process in my 4GB RAM laptop.?

2. Will it make a difference if I set Hadoop cluster on two laptops having 4GB RAM each and then run DataTorrent on it.?

For now, I am able to run Kafka-to-HDFS-Sync app, I am also getting output in HDFS, but I am not able to visualise graphics, I am working on how to get it but the slowness of the machine is making it impossible for me to work on DataTorrent.

Please someone assist me.

Thank You. 

[Amol Kekre]

Akshay,

4GB is usually on the low side.8GB should be used. You would get 4GB to work, but that will need you to fine tune a lot. Two laptops with 4GB each will work once you set up Hadoop in non-local mode.

Thks

Amol

--
You received this message because you are subscribed to the Google Groups "DataTorrent Users Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dt-users+unsubscribe@googlegroups.com.
To post to this group, send email to dt-u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dt-users/339789ff-4169-422f-a3d3-b135cf9a9ca1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[akshay naidu]

thanks for your response Amol, 

I would try to fine tune if it helps me in working from my laptop only . on local mode itself. Can you please suggest me ways to increase performance on 4GB ram laptop for datatorrent.

thanks .

On Friday, January 27, 2017 at 11:43:17 PM UTC+5:30, Amol Kekre wrote:

Akshay,

4GB is usually on the low side.8GB should be used. You would get 4GB to work, but that will need you to fine tune a lot. Two laptops with 4GB each will work once you set up Hadoop in non-local mode.

Thks

Amol

On Fri, Jan 27, 2017 at 7:27 AM, akshay naidu <akshay...@gmail.com> wrote:

Hello Users,

I have installed DataTorrent on my Laptop having 4GB RAM.

Hadoop-2.7.3 (local mode) and Kafka Is also installed and running.

DataTorrent is properly installed and running on my system but when I launch an App the computer get too slow. Even Switching Tabs takes minutes, mouse hangs, every action takes a long time to response. This happens only after I launch an application in datatorrent , otherwise my laptop runs fine. I believe this is because of low RAM as the requirement to run DataTorrent is 8GB.

1. Is there a way with which I can speed up the process in my 4GB RAM laptop.?

2. Will it make a difference if I set Hadoop cluster on two laptops having 4GB RAM each and then run DataTorrent on it.?

For now, I am able to run Kafka-to-HDFS-Sync app, I am also getting output in HDFS, but I am not able to visualise graphics, I am working on how to get it but the slowness of the machine is making it impossible for me to work on DataTorrent.

Please someone assist me.

Thank You. 

--
You received this message because you are subscribed to the Google Groups "DataTorrent Users Group" group.

To unsubscribe from this group and stop receiving emails from it, send an email to dt-users+u...@googlegroups.com.

[Amol Kekre]

Akshay,

It will be a lot of work as opposed to upgrading to 8GB. You will need to go through all local process (Hadoop inclusive), reduce their memory footprint and see if that hurts/help for your particular app. 

Thks

Amol

To unsubscribe from this group and stop receiving emails from it, send an email to dt-users+unsubscribe@googlegroups.com.

To post to this group, send email to dt-u...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/dt-users/8b3d25d7-9b0b-4884-aa4f-b89a34be7a6f%40googlegroups.com.

[akshay naidu]

I understand that upgrading to 8GB will be much easier option, but my laptop doesn't support increasing RAM, I'll have to buy a new machine, that's why i am ready to take the hard way.