Isilon x400 NVRAM battery 1 has failed

[Sayeed Syed]

Dear Experts,

We have x400 isilon, OneFS Version: 8.0.0.6 and we don't have support.

We received notification "NVRAM battery 1 has failed" & "NVRAM battery 2 has failed"   found the red lights  backside of the Node on the try.

After that we replaced both the new battery's then run the manual test command : /usr/bin/isi_hwtools/isi_ipmicmc -B -V -p r -i 1

" WARNING - unsupported configuration ".

Kindly advise.

Event Group Causes
HW_SYSTEM_BATTERY_FAIL: NVRAM battery 1 has failed
HW_SYSTEM_BATTERY_FAIL: NVRAM battery 2 has failed


I followed below link for run the manual test but got the below command output.
Link : https://www.youtube.com/watch?v=DvBfhzMYxeo

--------------------------------------------

Isilon-3# /usr/bin/isi_hwtools/isi_ipmicmc -B -V -p r -i 1
WARNING - unsupported configuration
Failed lib_init_ipmi() call


Isilon-3# /usr/bin/isi_hwtools/isi_ipmicmc -B -V -p r -i 2
WARNING - unsupported configuration
Failed lib_init_ipmi() call

---------------------------------------------

Isilon-3# isi batterystatus list
Lnn Status1 Status2 Result1 Result2
--------------------------------------------
1 Good (10) Good (10) passed passed
2 Good (10) Good (10) passed passed
3 ERROR ERROR failed failed
4 Good (10) Good (10) passed passed
5 Good (10) Good (10) passed passed
6 Good (10) Good (10) passed passed
7 Good (10) Good (10) passed passed
8 Good (10) Good (10) passed passed
9 Good (10) Good (10) passed passed
--------------------------------------------

--------------------------------------------------------

Isilon-3# isi batterystatus view --node-lnn=3
Lnn: 3
Status1: ERROR
Status2: ERROR
Result1: failed
Result2: failed
Last Test Time1: Thu Mar 4 20:47:39 2021
Next Test Time1: Mon May 3 20:47:39 2021
Last Test Time2: Thu Mar 4 20:03:21 2021
Next Test Time2: Mon Mar 2 03:59:59 1970
Supported: Yes
Present: Yes
---------------------------------------------------------

IsilonBarajoun-3# tail /var/log/nvram.xml
<test_result>Tue Dec 31 21:14:22 2019 : passed - battery tested good [ 3.997 3.978 2133.339]</test_result>
<test_result>Mon Mar 2 07:15:13 2020 : passed - battery tested good [ 3.997 3.978 2124.451]</test_result>
<test_result>Sat May 2 17:13:31 2020 : passed - battery tested good [ 3.997 3.978 2128.035]</test_result>
<test_result>Fri Jul 3 03:10:10 2020 : passed - battery tested good [ 3.997 3.978 2117.400]</test_result>
<test_result>Wed Sep 2 13:02:43 2020 : passed - battery tested good [ 3.997 3.978 2123.429]</test_result>
<test_result>Mon Nov 2 22:56:05 2020 : passed - battery tested good [ 3.997 3.978 2128.872]</test_result>
<test_result>Sun Jan 3 08:47:36 2021 : passed - battery tested good [ 3.997 3.978 2128.872]</test_result>
<test_result>Thu Mar 4 20:47:39 2021 : failed - battery didn't recharge [ 0.000 0.000 0.000]</test_result>
</battery_1>
</nvram>





  

[mandar kolhe]

Is node still up and running? As both batteries are failed ? If both are failed it should be down, can we restet bmc and cmc 3 times and run battery test again ? After running battery test command did you notice that test has started in hwmon.log ? Of that node

--
You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/isilon-user-group/222dd37e-1c04-498b-acef-416be07f00efn%40googlegroups.com.

[Sayeed Syed]

Thank you for your reply.

Node still up and running without any issue, and  After replacing the both the batteries I ran the manual test command but i didn't work.

 Did not executed test command  :  /usr/bin/isi_hwtools/isi_ipmicmc -B -V -p r -i 1

     " WARNING - unsupported configuration ".

hwmon log file is empty  :  /var/log/isi_hwmon.log

Please guide me how do we restet bmc and cmc 3 time  ?

[Sayeed Syed]

Hi Kolhem,

Cloud you please confirm that is the below commands  for reset the bmc & cmc ?

Do we need to run these commands on all the nodes or just one node

Reset BMC/CMC
- To reset the BMC on all nodes in the cluster, run the following command:
# isi_for_array -s /usr/bin/isi_hwtools/isi_ipmicmc -c -a bmc

- When this completes, reset the CMC on all nodes in the cluster by running the following command:
# isi_for_array -s /usr/bin/isi_hwtools/isi_ipmicmc -c -a cmc

On Friday, 11 June 2021 at 08:36:40 UTC+4 kolhem...@gmail.com wrote:

[mandar kolhe]

Hello Sayeed,

Yes commands are right run this both commands on problematic node three times each take few seconds gap

To view this discussion on the web visit https://groups.google.com/d/msgid/isilon-user-group/6873f1ee-f259-4554-890e-5b144427ffaan%40googlegroups.com.

[Cibin Varghese]

If the issue is on Node 35 use below

cold reset CMC which is a non-disruptive process. Below is the command to perform the same:

# isi_for_array -n35 /usr/bin/isi_hwtools/isi_ipmicmc -c -a cmc

Please perform the same thrice on node 35 (by checking the status after each attempt). The status can be checked using the below command:

# isi_for_array -n35 /usr/bin/isi_hwtools/isi_ipmicmc -d -V -a cmc

Thanks & Regards,

Cibin Varghese
+91 974 207 2200

www.cibinvarghese.com

_______________________________________________________________________________

To view this discussion on the web visit https://groups.google.com/d/msgid/isilon-user-group/CAJH3o5G9eQpf1V2%2Brv3RivOu0SdBn8HbVwojKrsB%2Bvqb9nUMPA%40mail.gmail.com.

[mandar kolhe]

Make sure you reset both bmc and cmc

To view this discussion on the web visit https://groups.google.com/d/msgid/isilon-user-group/CAOhQtfb-RzBdbh1OFiDkh-LgO17pdJK%2BY%3Da6BfpWcj2q%2BX3tOw%40mail.gmail.com.

[Farmer Technology67]

Hi Mandar,

After running this command we getting below out on status and view please help (Isilon X210 Onefs 8.1.2)

Battery Test Failed (0x4F) Good (10)  failed   failed

 Thanks,