ERROR: Reply from server is "Cannot add disk when pool Default master disk is offline "

[Bas van Weelde]

Hi,

When adding physical disks (logical volumes) on a raid to a storage pool I get this error message. How can i get the raid disk online so I can use the lv's I created? What does offline in this context mean anyway? With pvdisplay, lvdisplay and mdadm all seems to be fine.

I hope someone can answer me on this.

cheers,

[QUADStor Support]

More information would be helpful, such as diagnostics from the
"System -> Run Diagnostics" page, and information about which disk you
configured as physical storage.

When the service starts if a disk (logical/RAID/physical) configured
previously isn't found then it is marked as offline. The error you are
getting indicates that the master disk configured for a pool wasn't
found after a service restart. Does a rescan from the GUI help ? If so
then the quadstor service started before the disks were available,
which it seems to be the case for lvm volumes.

> --
> You received this message because you are subscribed to the Google Groups
> "QUADStor Storage Virtualization" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to quadstor-vir...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.

[JFM van Weelde]

Ok,

After another week fiddling with logical, RAID and physical disks, I still
cannot get Quadstor so fat to recognize the master disk.

Status until now:


Disk /dev/md1: 1000.1 GB, 1000070512640 bytes
2 heads, 4 sectors/track, 244157840 cylinders, total 1953262720 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x091397f7

Device Boot Start End Blocks Id System
/dev/md1p1 2048 51202047 25600000 8e Linux LVM
/dev/md1p2 51202048 102402047 25600000 8e Linux LVM
/dev/md1p3 102402048 153602047 25600000 8e Linux LVM
/dev/md1p4 153602048 1953262719 899830336 8e Linux LVM

Disk /dev/mapper/backup-backup1: 48.3 GB, 48318382080 bytes
255 heads, 63 sectors/track, 5874 cylinders, total 94371840 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

Disk /dev/mapper/backup-backup1 doesn't contain a valid partition table

Disk /dev/mapper/backup-backup2: 48.3 GB, 48318382080 bytes
255 heads, 63 sectors/track, 5874 cylinders, total 94371840 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

Disk /dev/mapper/backup-backup2 doesn't contain a valid partition table


ID Vendor Model Serial Number Name Pool Size Used
N/A LVM LV GEN00000000000205144439 backup-backup1 N/A
45.00 GB N/A Add
N/A LVM LV GEN00000000001432815815 backup-backup2 N/A
45.00 GB N/A Add
1 RAID raid1 N/A Unknown N/A N/A


The thing is: how do I get /dev/md1 so far it will be seen and make it
online?

This is really frustrating, sorry.


Regards,

Van Weelde

[QUADStor Support]

So the error "Cannot add a disk. when pool Default master disk.." indicates
a) A disk was earlier configured and added to the Default pool.
Which disk was this ? Path to the disk ?
b) Is the disk online ?

Since you mention /dev/md1 lets assume that /dev/md1 is the answer to
the question above.
In that case when you configured /dev/md1 did it already contain
/dev/md1p1, /dev/md1p2 etc. Unlikely since then you would not have
been able to configure /dev/md1 but the partitions /dev/md1p1,
/dev/md1p2 etc. But if you were then its a bug. Was this the case ?

What is the output of the following command

pvs

[JFM van Weelde]

Hi,

Well, I think the reason is that /dev/md1, the master disk is a hardware
raid with lvm on it. These disks are perfectly recognized by quadstor, but
it seems that I have to get a software raid on dev/md1 to make it recognized
by quadstor.
So that's a software raid on top of a hardware raid...


Anyway: the output of pvs is:

pvs
PV VG Fmt Attr PSize PFree
/dev/md1p1 lvm2 a-- 24.41g 24.41g
/dev/md1p2 backup lvm2 a-- 24.41g 24.41g
/dev/md1p3 backup lvm2 a-- 24.41g 24.41g
/dev/md1p4 backup lvm2 a-- 858.14g 768.14g

Regards,

[QUADStor Support]

From the output you sent previously

>> 1 RAID raid1 N/A Unknown N/A N/A

It seems that you added a /dev/md device and as per your
configuration, but your pvs output shows that all the md partitions
are used by lvm

> Anyway: the output of pvs is:
>
> pvs
> PV VG Fmt Attr PSize PFree
> /dev/md1p1 lvm2 a-- 24.41g 24.41g
> /dev/md1p2 backup lvm2 a-- 24.41g 24.41g
> /dev/md1p3 backup lvm2 a-- 24.41g 24.41g
> /dev/md1p4 backup lvm2 a-- 858.14g 768.14g
>

The question still remains. Which md device did you configure as
physical storage ? /dev/md1 or some other /dev/md? device

[JFM van Weelde]

Hi,

I configured /dev/md1 as physical storage. But this is not seen as the
master disk in the system. Maybe it is better to remove all lvm's anyway.

Regards,





-----Original Message-----
From: quadst...@googlegroups.com [mailto:quadst...@googlegroups.com]
On Behalf Of QUADStor Support
Sent: woensdag 6 november 2013 10:56
To: quadstor-virt
Subject: Re: [quadstor-virt] ERROR: Reply from server is "Cannot add disk
when pool Default master disk is offline "

[QUADStor Support]

No it wont work. Looking back it seems that you did the following steps.
1. Configured /dev/md1 as physical storage
2. Then partitioned /dev/md1 into four partitions and assigned them as
physical volumes to LVM.

So in effect when you did (2), that step would have overwritten any
metadata we have stored on /dev/md1. Think of it as a filesystem.
You created a file system on /dev/md1, then partitioned /dev/md1
created partitions assigned to LVM and then you try to mount the
filesystem on /dev/md1 => Wont work in most cases (depends on which
blocks were overwritten)

The error you get when trying to add disks to the storage pool is like
a safety mechanism. Unless errors related to disks in the pool are
corrected you would not be able to add/delete disks to that pool.

To fix your current situation
1. Run diagnostics from the web ui
2. Untar the file
3. Locate a file called cdisks.lst

Now in cdisks.lst is in an xml format starting with <disk> and ending
with </disk> This is for each configured disk stored in the database
whether online or offline.
Locate the following entry
<online>0</online>
The above indicates which disk is offline. Now for this disk under the
<disk> tag there is another entry called bid: , for example bid: 1 or
bid: 2 etc.
This is a unique identifier for each disk configured. So for bid: 1
the bid value is 1, bid:2 the bid value is 2 and so on.

With information do the following
su root
cd /quadstor/pgsql/bin
su scdbuser
./psql qsdb
delete from physstor where bid=<bid value>
ctrl + d

<bid value> is what you determined from bid: above

Essentially you are removing an entry for that disk from the database.
This should be done only if you really know what you are doing :-)

Also if you by any chance bring this disk back online and run a
database recovery, then disk gets added back to the database with
other side effects.

After you do the steps above restart the quadstor service and you
should be able configured disks.

[JFM van Weelde]

Hi,

There's no such option as diagnostics in the web gui. I would like to follow
these steps but in this way I can't.
What about I do a complete removere/reinstall of the packages

[QUADStor Support]

Can you list down the package file names you installed ?

Yes you can do a fresh installed since in your case there hasn't been
any additional disks configured.

[JFM van Weelde]

Hi,

I installed:

quadstor-vtl-core-2.2.13-debian7-x86_64.deb
quadstor-vtl-itf-2.2.13-debian7-x86_64.deb

[QUADStor Support]

On Wed, Nov 6, 2013 at 5:22 PM, JFM van Weelde <jfmvan...@gmail.com> wrote:
> Hi,
>

> I installed:
>
> quadstor-vtl-core-2.2.13-debian7-x86_64.deb
> quadstor-vtl-itf-2.2.13-debian7-x86_64.deb

Ok, you are working with the vtl product. Most of the steps remain
the same, except there is no option to generate diagnostics. For now
you can start from scratch again as in your case that is easier. If
you face any other issues post in the vtl group at
https://groups.google.com/forum/#!forum/quadstor-vtl

[JFM van Weelde]

Ok thanks so far.
If something shows up I will post it.

Regards

-----Original Message-----
From: quadst...@googlegroups.com [mailto:quadst...@googlegroups.com]
On Behalf Of QUADStor Support
Sent: woensdag 6 november 2013 12:03
To: quadstor-virt
Subject: Re: [quadstor-virt] ERROR: Reply from server is "Cannot add disk
when pool Default master disk is offline "