MR3-UI shows wrong time

38 views
Skip to first unread message

xiang chen

unread,
Mar 11, 2021, 3:07:03 AM3/11/21
to MR3
I use MR3 1.2.0  Timeline Server and Hive Server and MR3-UI 1.0. I found that in MR3 UI, start time and end time show 1970.

mr3-ui.jpg
In Hive master pod log, I found that
```
2021-03-11T05:26:17,010  INFO [HistoryLogger] HistoryLogger: HistoryLogger sending VertexStateEvent(vertex_99309448_0000_11_01, Succeeded, 778580534, Some(778579208), Map 1)
2021-03-11T05:26:17,018  INFO [HistoryLogger] HistoryLogger: HistoryLogger sending VertexStateEvent(vertex_99309448_0000_11_02, Killed, 778580537, Some(778579032), ShuffleHandler_1)
2021-03-11T05:26:17,025  INFO [HistoryLogger] HistoryLogger: HistoryLogger sending DAGStateEvent(dag_99309448_0000_11, Succeeded, 778580541, Some(778579035), appattempt_99309448_0000_000000, root_20210311052614_ba944c87-aa7b-44c3-91a6-16534c0b2b35:11)
```

Sungwoo Park

unread,
Mar 11, 2021, 4:10:43 AM3/11/21
to MR3
From your screenshot, it looks like the system clock in your system is incorrect. MR3-UI is working correctly because 778580534 is equivalent to about 9 days (since Jan 1, 1970). So, could you check the system clock of the master Pod?

Cheers,

--- Sungwoo

xiang chen

unread,
Mar 11, 2021, 8:30:35 AM3/11/21
to MR3
I run it in OKD4. I checked container and check time:
```
# date
Thu Mar 11 13:27:21 UTC 2021
```
Are there any other settings in docker?

Sungwoo Park

unread,
Mar 11, 2021, 9:36:12 AM3/11/21
to MR3
I have found that it is a bug in MR3. Previously MR3 used org.apache.hadoop.yarn.util.SystemClock, but MR3 1.0 switched to org.apache.hadoop.yarn.util.MonotonicClock, which seems to return the time elapsed since the system restarted. (Did you happen to reboot your cluster about 10 days ago?)

Let me fix it in the next release of MR3. If you would like to use a working version before the release, please let me know.

Thanks a lot for reporting the bug.

Cheers,

--- Sungwoo

xiang chen

unread,
Mar 11, 2021, 9:57:25 AM3/11/21
to MR3
Thank you for your reply!

I'm trying to do some work about  hive on k8s (from hive on yarn). At present, I'm trying to integrate `mr3-ui` and `ats` with helm and add ingress. If this part is finished, I plan to try to open a pr to share my work.

I was just wondering if it is the system restart time :) , but I haven't verified it yet. 

xiang chen

unread,
Mar 11, 2021, 10:01:59 AM3/11/21
to MR3
I don't know when the next version will be released. If I can, I really want a working version, and then I will rebuild it myself in docker and test it. 
Hive on mr3 is a great project and I'd like to help in some ways.

xiang chen

unread,
Mar 11, 2021, 10:04:37 AM3/11/21
to MR3
By the way, my email is cdmik...@hotmail.com . If you can provide the working version, you can send it to my email, and I will test it tomorrow.
Reply all
Reply to author
Forward
0 new messages