Filtering Jobs Using Shared Resources

[Tianyi Wu]

Dear Google cluster data researchers,

We are doing research on the effects of job interference and I was wondering if it is possible to filter jobs using the same resources. 

The current thought is to look at all jobs under the same machine id and find jobs running at the same time by looking at run time. Is there a more efficient way to do so?

Thank you for your time! Looking forward to hearing from you.

Best,

Tianyi

[Md Ehtesam Haque]

"using the same resources" I assume you meant while running on the same machine.

Yes, your approach would be the most precise option. You can also use the resource usage table. Each usage entry includes collection id, index and machine id for the following 5 minutes. So, you can aggregate by machine id.

Best Regards.

--
You received this message because you are subscribed to the "Google cluster data - discussions" group. To post to this group, send email to googlecluste...@googlegroups.com. To unsubscribe from this group, send email to googleclusterdata-...@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/googleclusterdata-discuss?hl=en-US.
---
You received this message because you are subscribed to the Google Groups "Google cluster data - discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to googleclusterdata-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/3668c5b8-d2de-4659-8273-5adba0c38e42n%40googlegroups.com.

[Tianyi Wu]

Hi,

Thank you so much for your response. I do mean running on the same machine with "using the same resources".

I just have a quick clarification question: With resource usage table, do you mean the "instance_usage table" in the 2019 trace data? If so, I had some difficulties finding usage entries.

Thank you so much for your help.

Best,

Tianyi

[Nan Deng]

Yes. He meant instance_usage table. Can you clarify your problem with finding usage entries? It's there in every data entry, cpu and memory.