All Devices dev1, dev2 are down!

[rajan chandi]

Hi All,

I am trying to migrate MogileFS database to another server and database sounds to be migrated and tables are also created.

Now, When I try to add the host/devices they works but all devices have status "down"!

How to make it alive? "device mark alive" doesn't seem to work!

Thanks and regards
Rajan Chandi

[rajan chandi]

This might help too.

mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0 --trackers=mglfs1_srv:6001 check     
Checking trackers...
  mglfs1_srv:6001 ... OK

Checking hosts...
  [ 1] mogilestorage ... skipping; status = down
No devices found on tracker(s).

Regards
Rajan

[rajan chandi]

more commands looks like below.

mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0 --trackers=mglfs1_srv:6001 host list
mogilestorage [1]: down
  IP:       188.138.19.80:7500

mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0 --trackers=mglfs1_srv:6001 device list
mogilestorage [1]: down
                   used(G) free(G) total(G)
  dev1: down       0.000   0.000   0.000 
  dev2: down       0.000   0.000   0.000 


What could've gone wrong?

regards
Rajan

[Robin H. Johnson]

On Fri, Nov 06, 2009 at 12:50:28PM +0530, rajan chandi wrote:
> more commands looks like below.
>
> mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0
> --trackers=mglfs1_srv:6001 host list
> mogilestorage [1]: down
> IP: 188.138.19.80:7500
>
> mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0
> --trackers=mglfs1_srv:6001 device list
> mogilestorage [1]: down
> used(G) free(G) total(G)
> dev1: down 0.000 0.000 0.000
> dev2: down 0.000 0.000 0.000
>
> What could've gone wrong?

Did you mark the host as down or is it down because it's not available?

Try to mark the host as alive first, if that fails, check your mogstored
running on the host.

--
Robin Hugh Johnson
Gentoo Linux: Developer, Trustee & Infrastructure Lead
E-Mail : rob...@gentoo.org
GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85

[rajan chandi]

Thanks Robin. Marked the host alive and devices shows the status alive too.
Mogstored is also running.

mglfs1_srv = tracker + storage (place where I am getting errors)
mglfs0_srv = tracker + storage (one mglfs1_srv is successful)
db0_srv = database (mogilefs database is successfully created after commenting bind-address and uncommenting skip-innodb in my.conf of mysql)

mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0 --trackers=mglfs1_srv:6001 check     
Checking trackers...
  mglfs1_srv:6001 ... OK

Checking hosts...

  [ 1] mogilestorage ... REQUEST FAILURE

No devices found on tracker(s).

Mogstored and mogilefsd are alive and running. also devices are there.

mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0 --trackers=mglfs1_srv:6001 device list

mogilestorage [1]: alive
                   used(G) free(G) total(G)
  dev1: alive      0.000   0.000   0.000 
  dev2: alive      0.000   0.000   0.000

What could be wrong?

Regards
Rajan

[sanados]

You mention you have migrated your database.
Did you adjust the ip addresses / name resolution for the host aswell?

For example the tracker will find 127.0.0.1 when running on localhost.
but it won't when the tracker runs on a different server than the
mogstored run.

lg
Jürgen

> > IP: 188.138.19.80:7500 <http://188.138.19.80:7500>

> >
> > mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0
> > --trackers=mglfs1_srv:6001 device list
> > mogilestorage [1]: down
> > used(G) free(G) total(G)
> > dev1: down 0.000 0.000 0.000
> > dev2: down 0.000 0.000 0.000
> >
> > What could've gone wrong?
> Did you mark the host as down or is it down because it's not
> available?
>
> Try to mark the host as alive first, if that fails, check your
> mogstored
> running on the host.
>
>
> --
> Robin Hugh Johnson
> Gentoo Linux: Developer, Trustee & Infrastructure Lead

> E-Mail : rob...@gentoo.org <mailto:rob...@gentoo.org>

[rajan chandi]

Tracker and Mogstored are both running on the same machine.
The database is on other machine.

I modified the mogilefsd.conf file to point to the right database.

It also created tables in the destination database. Trackers/Mogstored are running.

The only major thing that concerns me is this:-

Checking hosts...
 [ 1] mogilestorage ... REQUEST FAILURE
No devices found on tracker(s).

There is some relationship between the devices and trackers.
There is no table in database for the trackers it seems.
Not sure how to configure "devices on tracker"!

Regards
Rajan

[sanados]

http_port of the hosts and the port where mogstored ist listening are
the same?

Maybe this is an IO::AIO issue what we had some time ago.
(There was a posting from dormando a while ago)

Perhabs try and downgrade IO::AIO. and bring mogilefs source to the
latest svn.
I had similar issues with a version too.

>Hey,
>
>If your mogstored is acting up or leaking memory or whatever, check the
>version of IO::AIO you have installed. If it's 3.3, downgrade to 3.261 or
>older:
>http://backpan.perl.org/authors/id/M/ML/MLEHMANN/IO-AIO-3.261.tar.gz
>
>I'm not sure why it's like that, but it is. We'll see about getting it
>fixed or something.
>
>-Dormando

> <mailto:rob...@gentoo.org <mailto:rob...@gentoo.org>>> wrote:
>
>
> On Fri, Nov 06, 2009 at 12:50:28PM +0530, rajan chandi wrote:
> > more commands looks like below.
> >
> > mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0
> > --trackers=mglfs1_srv:6001 host list
> > mogilestorage [1]: down
> > IP: 188.138.19.80:7500

> <http://188.138.19.80:7500> <http://188.138.19.80:7500>

>
> >
> > mglfs1_srv:~# mogadm --lib=/usr/local/share/perl/5.10.0
> > --trackers=mglfs1_srv:6001 device list
> > mogilestorage [1]: down
> > used(G) free(G) total(G)
> > dev1: down 0.000 0.000 0.000
> > dev2: down 0.000 0.000 0.000
> >
> > What could've gone wrong?
> Did you mark the host as down or is it down because it's not
> available?
>
> Try to mark the host as alive first, if that fails, check your
> mogstored
> running on the host.
>
>
> --
> Robin Hugh Johnson
> Gentoo Linux: Developer, Trustee & Infrastructure Lead
> E-Mail : rob...@gentoo.org <mailto:rob...@gentoo.org>

> <mailto:rob...@gentoo.org <mailto:rob...@gentoo.org>>

[rajan chandi]

Thanks for the information.

mglfs1_srv:~# dpkg -l |grep 'aio'
ii  libio-aio-perl                  2.4-1+b1                 asynchronous IO module for Perl

May be I am facing something else!

Regards
Rajan

[rajan chandi]

The IP address in the host table needs to be same as IP address in the mogstored.conf file.
If you use 127.0.0.1 in the conf file and real IP address in the "add host" configuration - It doesn't help.

Regards
Rajan