storing and retrieving images in/from HDFS

[Rajasri]

hi all...I am using hadoop 0.20.1. I successfully stored image into hdfs. But while retrieving, an image file is created in the local file system. But when i try to open that image file i am getting an error stating "Could not load image. Image loading failed". I have attached the code's screenshot below for further reference.Thanks in advance!!

[Rajasri]

 The problem here is, only the file is getting created in both hdfs and in local file system..I have created only the objects to input n output stream...what function should i use to write image contents into hdfs? Thanks in advance!
Regards,
Rajasri

[Vallarasu S]

Hello there,

Greetings, Can some one please point me to any resource on how to install and configuring Eclipse on ubutu to work with Hadoop?

forgive me if it sounds silly.

Thanks,

Vasu

[Ashwanth Kumar]

When you create the file you get an instance of FSDataOutputStream,
this extends java's Outputstream. You can use the traditional write()
method. Same is with the FSDataInputStream.

_Sample Example_ can be found at http://pastebin.com/tTQvwmEN

[Sai Sivam]

HDFS is different from Ext FS you use.

$ hadoop dfs -copyFromLocal local-image.jpg dfs-image.jpg
$ gimp dfs-image.jpg # will not work

> --
>
>

[Sai Sivam]

Pl eval:

https://www.google.co.in/search?q=direct+hdfs+writes+in+java&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a

http://blog.rajeevsharma.in/2009/06/using-hdfs-in-java-0200.html

FWIW.

Thanks.

> --
>
>

[Srinivasan Ramalingam]

Hai valla,
     i will try to help you.please follow the below steps
1.Download the eclipse helios for linux version(http://www.eclipse.org/downloads/packages/release/helios/sr2)
2.install the eclipse from ubuntu
3.Download the hadoop plugin(http://code.google.com/p/hadoop-eclipse-plugin/downloads/detail?name=hadoop-0.20.1-eclipse-plugin.jar&can=2&q=)
4.copy the hadoop plugin adn paste it in eclipse/plugin folder.
5.that is it

--
 
 

[Srinivasan Ramalingam]

install the eclipse from ubuntu{http://colinrrobinson.com/technology/install-eclipse-ubuntu/}

On Thu, Jan 3, 2013 at 12:37 PM, Srinivasan Ramalingam <eceseen...@gmail.com> wrote:

install the eclipse from ubuntu

[Rajasri janakiraman]

u needn't strain much...just go to built in ubuntu software center...From there select Eclipse / search for eclipse there. It will  get downloaded and installed and to access hadoop from eclipse, download "org.apache.hadoop" jar and add that as external jar to the required program (in eclipse) from which u wish to access hadoop /hdfs..This is my suggestion...let me know if there is any error in this method..

--
 
 

[Nagarajan B]

You can simply type the command sudo apt-get install eclipse.... This is how i installed eclipse in my machine.


Thanks
Nagu.

[Vallarasu S]

Thank everyone for your time and patience.

Since I'm completely new to ubuntu I've followed Srinivasan Ramalingam links which had step by step guides.

http://colinrrobinson.com/technology/install-eclipse-ubuntu/

Everything went well but finally throws this error when invoking eclipse

vasu@ubuntu:~$ /opt/eclipse/eclipse -clean &

[1] 3758

vasu@ubuntu:~$ bash: /opt/eclipse/eclipse: cannot execute binary file

How should I rollback if I wish to follow other instructions?

Thanks,

 - Vasu

---

Date: Thu, 3 Jan 2013 22:17:16 +0530
Subject: Re: Eclipse installation and configuration
From: naguh...@gmail.com
To: chenn...@googlegroups.com

You can simply type the command sudo apt-get install eclipse.... This is how i installed eclipse in my machine.


Thanks
Nagu.

--
 
 

[Rajasri janakiraman]

Thanks u sir...Its working..:)

--

[Rajasri]

 I tried the coding which u gave me about a month back (in the below link).It worked fine. But now if i run, a copy(image) is created in the local system. But when i access my HDFS using localhost, i cannot see the file. What should i do now?

[Ashwanth Kumar]

Check the "destinationPath"on the local filesystem, to see if the File is created on the local FS instead of HDFS. Then may be your configuration is not loaded properly to have NN address. This typically happens if you don't add the config resources / run it directly from an IDE.

--

Ashwanth Kumar / ashwanthkumar.in