[Issue] Many Reinstated messages

[BriK]

Hi there !

I got a question regarding thoses messages on a multipathed iscsi initiator (using an IET target) :

Aug 19 11:20:55 s_local@mta1 multipathd: 8:48: reinstated

Aug 19 11:21:00 s_local@mta1 multipathd: 8:16: reinstated

Aug 19 11:21:00 s_local@mta1 multipathd: 8:48: reinstated

Aug 19 11:21:05 s_local@mta1 multipathd: 8:16: reinstated

Aug 19 11:21:05 s_local@mta1 multipathd: 8:48: reinstated

My "multipath -ll" output shows weird active paths and is changing, what should I tune ?

Fri Aug 19 10:27:36 CEST 2011

mpath1 (149455400000000006c6670772e62616c7300000000000000) dm-5 IET,VIRTUAL-DISK

[size=3.1T][features=0][hwhandler=0]

\_ round-robin 0 [prio=1][active]

 \_ 7:0:0:0  sdd 8:48  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 8:0:0:0  sde 8:64  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 10:0:0:0 sdg 8:96  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 12:0:0:0 sdi 8:128 [active][ready]

mpath2 (149455400000000006c6670772e636f6e6600000000000000) dm-4 IET,VIRTUAL-DISK

[size=100G][features=0][hwhandler=0]

\_ round-robin 0 [prio=1][active]

 \_ 5:0:0:0  sdb 8:16  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 6:0:0:0  sdc 8:32  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 9:0:0:0  sdf 8:80  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 11:0:0:0 sdh 8:112 [active][ready]

Fri Aug 19 10:28:04 CEST 2011

mpath1 (149455400000000006c6670772e62616c7300000000000000) dm-5 IET,VIRTUAL-DISK

[size=3.1T][features=0][hwhandler=0]

\_ round-robin 0 [prio=1][active]

 \_ 7:0:0:0  sdd 8:48  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 8:0:0:0  sde 8:64  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 10:0:0:0 sdg 8:96  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 12:0:0:0 sdi 8:128 [active][ready]

mpath2 (149455400000000006c6670772e636f6e6600000000000000) dm-4 IET,VIRTUAL-DISK

[size=100G][features=0][hwhandler=0]

\_ round-robin 0 [prio=1][enabled]

 \_ 5:0:0:0  sdb 8:16  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 6:0:0:0  sdc 8:32  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 9:0:0:0  sdf 8:80  [active][ready]

\_ round-robin 0 [prio=1][enabled]

 \_ 11:0:0:0 sdh 8:112 [active][ready]

iscsid.conf :

node.startup = manual

node.session.timeo.replacement_timeout = 5

node.conn[0].timeo.login_timeout = 5

node.conn[0].timeo.logout_timeout = 15

node.conn[0].timeo.noop_out_interval = 5

node.conn[0].timeo.noop_out_timeout = 15

node.session.err_timeo.abort_timeout = 15

node.session.err_timeo.lu_reset_timeout = 20

node.session.initial_login_retry_max = 8

node.session.cmds_max = 128

node.session.queue_depth = 32

node.session.iscsi.InitialR2T = No

node.session.iscsi.ImmediateData = Yes

node.session.iscsi.FirstBurstLength = 262144

node.session.iscsi.MaxBurstLength = 16776192

node.conn[0].iscsi.MaxRecvDataSegmentLength = 131072

discovery.sendtargets.iscsi.MaxRecvDataSegmentLength = 32768

node.session.iscsi.FastAbort = Yes

Any help appreciated !!

BriK

[Mike Christie]

On 08/19/2011 04:29 AM, BriK wrote:
> Hi there !
>
> I got a question regarding thoses messages on a multipathed iscsi initiator
> (using an IET target) :
>
> Aug 19 11:20:55 s_local@mta1 multipathd: 8:48: reinstated
> Aug 19 11:21:00 s_local@mta1 multipathd: 8:16: reinstated
> Aug 19 11:21:00 s_local@mta1 multipathd: 8:48: reinstated
> Aug 19 11:21:05 s_local@mta1 multipathd: 8:16: reinstated
> Aug 19 11:21:05 s_local@mta1 multipathd: 8:48: reinstated
>
> My "multipath -ll" output shows weird active paths and is changing, what
> should I tune ?

You need to send the /var/log/messages so I can see what is going on at
the iscsi layer. The path could have gone down because of a connection
problem or a device issue or something else.