measuring power/energy on POWER9

76 views
Skip to first unread message

khuck

unread,
Jun 18, 2019, 1:35:59 PM6/18/19
to ptools-perfapi
Heike -

Thanks for the NVML component in 5.7.0 - it works great.  Is there any way to measure power/energy consumption of CPU/memory on POWER9 systems using PAPI?

Thanks -
Kevin

Heike Jagode

unread,
Jun 19, 2019, 9:14:02 AM6/19/19
to khuck, ptools-perfapi
Hi Kevin,

Currently we only have power/energy monitoring support in PAPI for Intel CPUs, AMD CPUs and GPUs, as well as NVIDIA GPUs. We would be interesting in adding support for IBM POWER9 systems but haven’t started yet. Do you have any pointers that could help us to get started on this?

Thanks,
Heike


--
You received this message because you are subscribed to the Google Groups "ptools-perfapi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ptools-perfap...@icl.utk.edu.
To view this discussion on the web visit https://groups.google.com/a/icl.utk.edu/d/msgid/ptools-perfapi/c3b776bf-ea57-4c97-8cf0-b0c0cb764ab9%40icl.utk.edu.
--
______________________________________
Heike Jagode, Ph.D., Research Asst. Professor
Innovative Computing Laboratory, University of Tennessee Knoxville
http://icl.utk.edu/~jagode/

Kevin Huck

unread,
Jun 19, 2019, 12:10:45 PM6/19/19
to Heike Jagode, ptools-perfapi
Heike -

Thanks for your reply.  I have a vague idea where to start.  The only information that I have been able to find is from the OpenPOWER foundation...but it is from a few years ago:  https://openpowerfoundation.org/wp-content/uploads/2016/11/Todd-Rosedahl-Measuring-and-Managing-Power-Consumption.pdf

There is an OCC (on chip controller) that should(?) provide the data:

And a library:

I was hoping that PAPI already integrated this or something equivalent.  :)

Thanks -
Kevin


--
Kevin Huck, PhD
Research Associate / Computer Scientist
OACISS - Oregon Advanced Computing Institute for Science and Society
University of Oregon







lorenzo chelini

unread,
Jun 19, 2019, 1:49:20 PM6/19/19
to Kevin Huck, Heike Jagode, ptools-perfapi
Hi Kevin,

Hope it will help you.

Best regards,
Lorenzo Chelini.


Heike Jagode

unread,
Jun 19, 2019, 2:09:29 PM6/19/19
to Kevin Huck, ptools-perfapi
Thanks much, Kevin, for the pointers! We will look into it and see if
we can put together a PAPI component.

Heike

Heike Jagode

unread,
Aug 6, 2019, 2:54:51 PM8/6/19
to Kevin Huck, ptools-perfapi
Kevin,

Has someone followed up with you on this??

If not, here are a couple of details:

PAPI has the lmsensors component, which was one of the very first PAPI
components we developed and released back in 2009/2010.
Two of my team members (Tony Castaldo and Rizwan Ashraf) have tested
the PAPI lmsensors component on Summit. They confirm that it works
out-of-the-box for monitoring power/energy on IBM Power9. Below is a
small list of events related to power consumption you can monitor on
Power9.

+++ Total power consumption of the node:
lm_sensors:::ibmpowernv-isa-0000.System.power11_input

+++ Power consumption of the CPU:
lm_sensors:::ibmpowernv-isa-0000.Chip 0 .power5_input

+++ Power consumption for CPU memory:
lm_sensors:::ibmpowernv-isa-0000.Chip 0 Memory.power3_input

+++ Power consumption of GPUs on a socket:
lm_sensors:::ibmpowernv-isa-0000.Chip 0 GPU.power1_input

+++ Power consumption of CPU cores (vdd):
lm_sensors:::ibmpowernv-isa-0000.Chip 0 Vdd.power6_input

+++ Power consumption of CPU NEST (aka uncore) resources (e.g. on-chip
network and memory controllers):
lm_sensors:::ibmpowernv-isa-0000.Chip 0 Vdn.power7_input


Please let us know if and how this works for you.
Thanks,
Heike


On Wed, Jun 19, 2019 at 12:10 PM Kevin Huck <kh...@cs.uoregon.edu> wrote:
>
> Heike -
>
> Thanks for your reply. I have a vague idea where to start. The only information that I have been able to find is from the OpenPOWER foundation...but it is from a few years ago: https://openpowerfoundation.org/wp-content/uploads/2016/11/Todd-Rosedahl-Measuring-and-Managing-Power-Consumption.pdf
>
> There is an OCC (on chip controller) that should(?) provide the data:
> Understanding Power Measurement Capabilities on Zaius Power9https://www.thinkmind.org/download.php?articleid=infocomp_2018_5_20
> https://link.springer.com/chapter/10.1007/978-3-319-67630-2_21
>
> And a library:
> https://github.com/open-power/occ
> https://github.com/open-power/docs/blob/master/occ/OCC_ipmitool_sensors.pdf
>
> I was hoping that PAPI already integrated this or something equivalent. :)
>
> Thanks -
> Kevin
>
> On Jun 19, 2019, at 6:13 AM, Heike Jagode <jag...@icl.utk.edu> wrote:
>
> Hi Kevin,
>
> Currently we only have power/energy monitoring support in PAPI for Intel CPUs, AMD CPUs and GPUs, as well as NVIDIA GPUs. We would be interesting in adding support for IBM POWER9 systems but haven’t started yet. Do you have any pointers that could help us to get started on this?
>
> Thanks,
> Heike
>
>
> On Tue, Jun 18, 2019 at 7:36 PM khuck <kh...@cs.uoregon.edu> wrote:
>>
>> Heike -
>>
>> Thanks for the NVML component in 5.7.0 - it works great. Is there any way to measure power/energy consumption of CPU/memory on POWER9 systems using PAPI?
>>
>> Thanks -
>> Kevin


--

Kevin Huck

unread,
Aug 26, 2019, 12:28:52 PM8/26/19
to Heike Jagode, ptools-perfapi
Heike -

I can confirm that both the LMSensors and NVML components work well on Summit, thanks!

I added some other code to TAU to support reading files from the /proc virtual filesystem, and it occurred to me that they would be useful component additions to the PAPI library - for example, reading CPU utilization stats from /proc/stat.  What’s the process for integrating something like that (similar to the net component that is already in PAPI, and reads from /proc/net/dev)?

(assuming I have time to write such a component for PAPI, that is… :)

Thanks -
Kevin

Heike Jagode

unread,
Aug 26, 2019, 1:57:19 PM8/26/19
to Kevin Huck, ptools-perfapi
Kevin,

Thanks for your feedback on the lmsensors and nvml components on Summit!

As for a new component, we can certainly help with that. If you could
share more details on what exactly you are looking for then we can
crank up the development of a new component. For instance, you
mentioned CPU utilization stats. What other events are important? The
more details you can share the better, so that we get the full
picture.

Thanks,
Heike

Phil Mucci

unread,
Aug 27, 2019, 8:01:56 AM8/27/19
to Heike Jagode, Kevin Huck, ptools-perfapi
Hi you two!

I use code that does this all the time and often think it would be great to have in PAPI. papiex needed this stuff as well …  I honestly don’t know how we’ve gotten along without it. A wrapper would work nicely, at least for integer and FP data. We could probably then kill our memory_info hack for a /proc based one. 

FWIW Heike, one may want to think of it more like ‘which files’ rather than ‘which fields’. There are a lot of fields buried in there and the number can grow between kernel versions, but the definitions largely stay the same. I personally use stat/io/schedstat under proc/pid/task/N quite a bit. 

I’ll toss our code into the fray as well…

Best

Phil


-- 
You received this message because you are subscribed to the Google Groups "ptools-perfapi" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ptools-perfap...@icl.utk.edu.
Reply all
Reply to author
Forward
0 new messages