Gerry McHugh
unread,Jan 6, 2014, 12:38:54 PM1/6/14You do not have permission to delete messages in this group
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to
Hi Everyone,
I have a problem when trying to Live migrate one of the VM's in my cluster from 1 node to the other. I have over 20 VM's but this is the only one that will not Live migrate - and of course it's probably the most important!
I have read that removing it from the clustered services and re-adding should solve it but unfortunately I can't power it off to do this. It will be a couple months before I can power down this system, as it's part of our production network.
I have generated the cluster log - but I have not been able to notice anything that could be causing it, but hopefully someone here may be able to point me in the right direction.
I have ran the cluster validation, and apart from a few warnings for templates we have turned off - there is nothig there.
Here is an excerpt from the cluster log file:
000011f4.0000121c::2014/01/06-16:34:12.811 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: Current state 'MigrationTargetSetup', event 'Started'
000011f4.0000121c::2014/01/06-16:34:12.811 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: State change 'MigrationTargetSetup' -> 'MigrationTargetStart'
00000880.000009c0::2014/01/06-16:35:15.103 INFO [RCM] rcm::RcmGum::GroupMoveOperation(EDG08VM31 - Informance Server,2)
00000880.00000b70::2014/01/06-16:35:15.103 INFO [RCM] TransitionToState(Virtual Machine Configuration EDG08VM31) Offline-->OnlineCallIssued.
00000880.00000b70::2014/01/06-16:35:15.103 INFO [RCM] rcm::RcmGroup::UpdateStateIfChanged: (EDG08VM31 - Informance Server, BringingToPersistentState --> Pending)
00000880.00000b70::2014/01/06-16:35:15.103 INFO [RCM] rcm::RcmResource::Online: Virtual Machine EDG08VM31's provider 'Virtual Machine Configuration EDG08VM31' is already coming online (state is OnlineCallIssued).
00000880.00000b70::2014/01/06-16:35:15.103 INFO [RCM] TransitionToState(Virtual Machine EDG08VM31) Offline-->WaitingToComeOnline.
000011f4.00000e0c::2014/01/06-16:35:15.119 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: Current state 'Offline', event 'Online'
000011f4.00000e0c::2014/01/06-16:35:15.119 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: State change 'Offline' -> 'OnlinePending'
00000880.0000153c::2014/01/06-16:35:15.119 INFO [RCM] HandleMonitorReply: ONLINERESOURCE for 'Virtual Machine Configuration EDG08VM31', gen(0) result 997.
00000880.0000153c::2014/01/06-16:35:15.119 INFO [RCM] TransitionToState(Virtual Machine Configuration EDG08VM31) OnlineCallIssued-->OnlinePending.
000011f4.00001220::2014/01/06-16:35:15.134 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: Current state 'OnlinePending', event 'ConfigRegistered', result 0x00000000
000011f4.00001220::2014/01/06-16:35:15.134 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: State change 'OnlinePending' -> 'Online'
00000880.00000614::2014/01/06-16:35:15.134 INFO [GUM] Node 2: Processing RequestLock 2:136
00000880.00000ac8::2014/01/06-16:35:15.134 INFO [GUM] Node 2: Processing GrantLock to 2 (sent by 1 gumid: 348783)
000011f4.00000ea8::2014/01/06-16:35:15.228 INFO [RHS] Resource Virtual Machine Configuration EDG08VM31 has come online. RHS is about to report status change to RCM
00000880.0000153c::2014/01/06-16:35:15.228 INFO [RCM] HandleMonitorReply: ONLINERESOURCE for 'Virtual Machine Configuration EDG08VM31', gen(0) result 0.
00000880.0000153c::2014/01/06-16:35:15.228 INFO [RCM] TransitionToState(Virtual Machine Configuration EDG08VM31) OnlinePending-->Online.
00000880.000016f8::2014/01/06-16:35:15.228 INFO [RCM] TransitionToState(Virtual Machine EDG08VM31) WaitingToComeOnline-->OnlineCallIssued.
000011f4.00000e0c::2014/01/06-16:35:15.228 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: Current state 'MigrationTargetStart', event 'Online'
000011f4.00000e0c::2014/01/06-16:35:15.228 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: State change 'MigrationTargetStart' -> 'OnlinePending'
00000880.00000614::2014/01/06-16:35:15.228 INFO [RCM] HandleMonitorReply: ONLINERESOURCE for 'Virtual Machine EDG08VM31', gen(1) result 997.
00000880.00000614::2014/01/06-16:35:15.228 INFO [RCM] TransitionToState(Virtual Machine EDG08VM31) OnlineCallIssued-->OnlinePending.
000011f4.00000ea8::2014/01/06-16:35:15.228 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: 'Virtual Machine Configuration EDG08VM31' successfully registered the configuration for the virtual machine.
000011f4.0000121c::2014/01/06-16:35:15.509 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: Current state 'OnlinePending', event 'StartupResult', result 0x80004005
000011f4.0000121c::2014/01/06-16:35:15.509 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: State change 'OnlinePending' -> 'Failed'
000011f4.00001b78::2014/01/06-16:35:15.509 ERR [RES] Virtual Machine <Virtual Machine EDG08VM31>: 'Virtual Machine EDG08VM31' failed to start.
Live migration of 'EDG08VM31' did not succeed. (Virtual machine ID 59084762-EE97-4F1D-B80A-3C858AA4CB0A)
'EDG08VM31' Microsoft Synthetic Ethernet Port (Instance ID {22921D27-BF6B-4DA7-A361-B50444373FE9}): Failed to restore with Error 'The system cannot find the path specified.' (0x80070003). (Virtual machine ID 59084762-EE97-4F1D-B80A-
000011f4.00001b78::2014/01/06-16:35:15.509 ERR [RHS] Online for resource Virtual Machine EDG08VM31 failed.
00000880.00000c54::2014/01/06-16:35:15.509 WARN [RCM] HandleMonitorReply: ONLINERESOURCE for 'Virtual Machine EDG08VM31', gen(1) result 5018.
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] TransitionToState(Virtual Machine EDG08VM31) OnlinePending-->ProcessingFailure.
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] rcm::RcmGroup::UpdateStateIfChanged: (EDG08VM31 - Informance Server, Pending --> Failed)
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] Group move for 'EDG08VM31 - Informance Server' has completed.
00000880.00000c54::2014/01/06-16:35:15.509 ERR [RCM] rcm::RcmResource::HandleFailure: (Virtual Machine EDG08VM31)
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] resource Virtual Machine EDG08VM31: failure count: 2, restartAction: 2.
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] Greater than restartPeriod time has elapsed since first failure, resetting failureTime and failureCount.
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] TransitionToState(Virtual Machine EDG08VM31) ProcessingFailure-->[WaitingToTerminate to Failed].
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] rcm::RcmGroup::UpdateStateIfChanged: (EDG08VM31 - Informance Server, Failed --> Pending)
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] TransitionToState(Virtual Machine EDG08VM31) [WaitingToTerminate to Failed]-->[Terminating to Failed].
000011f4.00001b78::2014/01/06-16:35:15.509 ERR [RES] Virtual Machine <Virtual Machine EDG08VM31>: 'Virtual Machine EDG08VM31' live migration did not succeed at the destination.
'Virtual Machine EDG08VM31' failed to start.
Live migration of 'EDG08VM31' did not succeed. (Virtual machine ID 59084762-EE97-4F1D-B80A-3C858AA4CB0A)
'EDG08VM31' Microsoft Synthetic Ethernet Port (Instance ID {22921D27-BF6B-4DA7-A361-B50444373FE9}): Failed to restore with Error 'The system cannot find
00000880.00000c54::2014/01/06-16:35:15.509 INFO [RCM] Resource Virtual Machine EDG08VM31 is causing group EDG08VM31 - Informance Server to failover. Posting worker thread.
00000880.0000153c::2014/01/06-16:35:15.509 INFO [RCM] rcm::RcmGroup::Failover: (EDG08VM31 - Informance Server)
000011f4.00000630::2014/01/06-16:35:15.509 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: Current state 'Failed', event 'Terminate'
000011f4.00000630::2014/01/06-16:35:15.509 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: State change 'Failed' -> 'Terminated'
000011f4.0000121c::2014/01/06-16:35:19.580 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: Current state 'Terminated', event 'Shutdown'
000011f4.00000630::2014/01/06-16:35:20.080 INFO [RES] Virtual Machine <Virtual Machine EDG08VM31>: State change 'Terminated' -> 'Offline'
00000880.000016f8::2014/01/06-16:35:20.080 INFO [RCM] HandleMonitorReply: TERMINATERESOURCE for 'Virtual Machine EDG08VM31', gen(2) result 0.
00000880.000016f8::2014/01/06-16:35:20.080 INFO [RCM] TransitionToState(Virtual Machine EDG08VM31) [Terminating to Failed]-->Failed.
00000880.000016f8::2014/01/06-16:35:20.080 INFO [RCM] rcm::RcmGroup::UpdateStateIfChanged: (EDG08VM31 - Informance Server, Pending --> Failed)
00000880.0000153c::2014/01/06-16:35:20.095 INFO [RCM] time since last failure is greater than failover period; resetting failoverCount to 1.
00000880.0000153c::2014/01/06-16:35:20.095 WARN [RCM] Failing over group EDG08VM31 - Informance Server, failoverCount 1, last time 2014/01/06-16:35:20.095.
00000880.0000153c::2014/01/06-16:35:20.095 INFO [RCM] rcm::RcmGroup::Move: (EDG08VM31 - Informance Server, 1)
00000880.0000153c::2014/01/06-16:35:20.095 INFO [RCM] rcm::RcmGroup::Move: Bringing group 'EDG08VM31 - Informance Server' offline first...
00000880.0000153c::2014/01/06-16:35:20.095 INFO [RCM] TransitionToState(Virtual Machine Configuration EDG08VM31) Online-->OfflineCallIssued.
00000880.0000153c::2014/01/06-16:35:20.095 INFO [RCM] rcm::RcmGroup::UpdateStateIfChanged: (EDG08VM31 - Informance Server, Failed --> Pending)
000011f4.00000630::2014/01/06-16:35:20.095 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: Current state 'Online', event 'Offline'
000011f4.00000630::2014/01/06-16:35:20.095 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: State change 'Online' -> 'OfflinePending'
00000880.00000c28::2014/01/06-16:35:20.095 INFO [RCM] HandleMonitorReply: OFFLINERESOURCE for 'Virtual Machine Configuration EDG08VM31', gen(0) result 997.
00000880.00000c28::2014/01/06-16:35:20.095 INFO [RCM] TransitionToState(Virtual Machine Configuration EDG08VM31) OfflineCallIssued-->OfflinePending.
000011f4.00001220::2014/01/06-16:35:20.095 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: Current state 'OfflinePending', event 'ConfigDeleted', result 0x00000000
000011f4.00001220::2014/01/06-16:35:20.095 INFO [RES] Virtual Machine Configuration <Virtual Machine Configuration EDG08VM31>: State change 'OfflinePending' -> 'Offline'
000011f4.00001850::2014/01/06-16:35:20.095 INFO [RHS] Resource Virtual Machine Configuration EDG08VM31 has come offline. RHS is about to report resource status to RCM.
00000880.00000bc0::2014/01/06-16:35:20.095 INFO [RCM] HandleMonitorReply: OFFLINERESOURCE for 'Virtual Machine Configuration EDG08VM31', gen(0) result 0.
00000880.00000bc0::2014/01/06-16:35:20.095 INFO [RCM] TransitionToState(Virtual Machine Configuration EDG08VM31) OfflinePending-->OfflineSavingCheckpoints.
00000880.00001844::2014/01/06-16:35:20.095 INFO [RCM] TransitionToState(Virtual Machine Configuration EDG08VM31) OfflineSavingCheckpoints-->Offline.
00000880.00001844::2014/01/06-16:35:20.095 INFO [RCM] rcm::RcmGroup::UpdateStateIfChanged: (EDG08VM31 - Informance Server, Pending --> Failed)
00000880.00000164::2014/01/06-16:35:20.095 INFO [RCM] rcm::RcmGum::GroupMoveOperation(EDG08VM31 - Informance Server,1)
00000880.00001390::2014/01/06-16:35:20.111 WARN [RCM] rcm::RcmApi::GetResourceState: retrying: EDG08VM31 - Informance Server, 5908.
00000880.00001954::2014/01/06-16:35:20.111 ERR [RCM] s_RcmRpcGetGroupState: ERROR_CLUSTER_GROUP_MOVING(5908)' because of ''EDG08VM31 - Informance Server' is owned by node 1, not 2.'
00000880.00001954::2014/01/06-16:35:20.111 ERR [RCM] s_RcmRpcGetGroupState: ERROR_CLUSTER_GROUP_MOVING(5908)' because of ''EDG08VM31 - Informance Server' is owned by node 1, not 2.'
00000880.00001954::2014/01/06-16:35:20.111 ERR [RCM] s_RcmRpcGetGroupState: ERROR_CLUSTER_GROUP_MOVING(5908)' because of ''EDG08VM31 - Informance Server' is owned by node 1, not 2.'
00000880.00001954::2014/01/06-16:35:20.111 ERR [RCM] s_RcmRpcGetGroupState: ERROR_CLUSTER_GROUP_MOVING(5908)' because of ''EDG08VM31 - Informance Server' is owned by node 1, not 2.'
00000880.00000ac8::2014/01/06-16:35:22.794 INFO [GUM] Node 2: Processing RequestLock 1:3020
00000880.00000ac8::2014/01/06-16:35:22.794 INFO [GUM] Node 2: Processing GrantLock to 1 (sent by 2 gumid: 348787)
00000880.000009c0::2014/01/06-16:35:23.262 ERR mscs::GumAgent::ExecuteQueuedUpdate: ERROR_FILE_NOT_FOUND(2)' because of '::RegDeleteKey( handle, name.c_str() )'(Resources\58bdae75-33d0-4d3e-b2fe-cc5951c8ed5e\Internal\VmPrivateRestartAction)
00000880.000009c0::2014/01/06-16:35:23.293 ERR mscs::GumAgent::ExecuteQueuedUpdate: ERROR_FILE_NOT_FOUND(2)' because of '::RegDeleteKey( handle, name.c_str() )'(Resources\58bdae75-33d0-4d3e-b2fe-cc5951c8ed5e\Internal\VmPrivateRestartThreshold)
00000880.000009c0::2014/01/06-16:35:23.325 ERR mscs::GumAgent::ExecuteQueuedUpdate: ERROR_FILE_NOT_FOUND(2)' because of '::RegDeleteKey( handle, name.c_str() )'(Resources\58bdae75-33d0-4d3e-b2fe-cc5951c8ed5e\Internal\ConfigPrivateRestartAction)
00000880.000009c0::2014/01/06-16:35:23.340 ERR mscs::GumAgent::ExecuteQueuedUpdate: ERROR_FILE_NOT_FOUND(2)' because of '::RegDeleteKey( handle, name.c_str() )'(Resources\58bdae75-33d0-4d3e-b2fe-cc5951c8ed5e\Internal\ConfigPrivateRestartThreshold)
00000880.000009c0::2014/01/06-16:35:23.356 INFO [RCM] rcm::RcmGum::SetGroupPreferredOwners(EDG08VM31 - Informance Server,<vector len='0'>
00000880.000009c0::2014/01/06-16:35:23.356 INFO </vector>
00000880.000009c0::2014/01/06-16:35:23.356 INFO )
Any help would be greatly appreiated,
Regards,
Gerry