Google cluster dataset 2019 traces

[Priyanka H]

Hi,

Please can you provide me with 2019 Google cluster traces so that it will be helpful for me to complete my PhD? I'm using cloudsim tool to conduct experiments. I have already used PlanetLab datasets which is present in the cloudsim. Now I'm looking for new datasets. Please help me

--

Regards,

Priyanka H

[Dimuth Lasantha Senarath Pathirane Rajapakshalage]

Hi Priyanka,

I have attached the relevant document from https://github.com/google/cluster-data/blob/master/ClusterData2019.md and highlighted the specific part. I think it will help you.

Cheers,

-Dimuth

--
You received this message because you are subscribed to the "Google cluster data - discussions" group. To post to this group, send email to googlecluste...@googlegroups.com. To unsubscribe from this group, send email to googleclusterdata-...@googlegroups.com. For more options, visit this group at https://groups.google.com/d/forum/googleclusterdata-discuss?hl=en-US.
---
You received this message because you are subscribed to the Google Groups "Google cluster data - discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to googleclusterdata-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAKFJJfYnCq8X6mPGY4JaxPO4HvxCFsCk-TL%3DDXPfFfFJri4qXQ%40mail.gmail.com.

[Priyanka H]

Thank you, sir

I actually want the data sets. I'm unable to download it. I have the document.

The datasets is in Google Bigquery where I'm unable to download. Please help me in getting datasets

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAAVoVvVYEOcv2qL27ZyMrFaBjrGsx%3DeZUR9SQ0_UzSXagfzoCw%40mail.gmail.com.

--

Regards,

Priyanka H

[Dimuth Lasantha Senarath Pathirane Rajapakshalage]

Hi Priyanka, What if you download it as JSON and then convert it whatever format you want. For that you do not need to use Bigquery.

Use the gsutil and the highlighted command in the document. You will have the dataset then. :)

Cheers,

-Dimuth

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAKFJJfZWE_aK5tax0pvNi0gCyfC-cQP%2BK98X3tt9mnGokgCTMQ%40mail.gmail.com.

[Priyanka H]

Sir,

Please tell me the steps for downloading. Gsutil is software that needs to be installed for downloading json datasets? I'm sorry I'm troubling you.

Please tell me the steps.

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAAVoVvXSKBmOpEYqnGbf7aYmvw2cSUkACQs-vZS6uqAChhhZow%40mail.gmail.com.

--

Regards,

Priyanka H

[Priyanka H]

Sir please help me to convert json file to text file. How to do that? Please help me.

[Souvik Sengupta]

Hi Priyanka,

Check out the following link:

https://www.geeksforgeeks.org/python-convert-json-to-string/

Hope that will help you to resolve your problem.

Cheers!!!

[Priyanka H]

Can I get converted google dataset so that I can use it directly in cloudsim like PlanetLab datasets? Please share with me if anybody has it.

It would be a  great help for me to continue with my research.

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/9488eab2-c165-40a8-9f65-d8b3fe0de938n%40googlegroups.com.

--

Regards,

Priyanka H

[Priyanka H]

The file size is very large, I'm unable to convert json format file it to normal size.please help me on getting normal CPU usage file. Thank you

[Dimuth Lasantha Senarath Pathirane Rajapakshalage]

Hi Priyanka, 

I am sorry that I am not able to understand your question fully, High Computing power is essential to process this dataset and High Performance Computer (HPC) is recommended. 

Cheers,

-Dimuth

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAKFJJfaFNh%2BBeLRnbvV2k%3DwR014X3x2PeC3i5-dSwoLGzeJX9A%40mail.gmail.com.

[Priyanka H]

Thank you sir. Can I use dataset traces in simulation? Can I use these datasets in Cloudsim simulation tool. Actually you have guided me to download json format dataset traces. I want it in text format so that I can use it in simulation tool. I want specifically CPU usage data to use in cloudsim sim tool. Please guide me sir

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAAVoVvVWYZcbU01jp6CU9bU27Hf3UtE%3D8B-hVXU%3Dbu0wjb4QYA%40mail.gmail.com.

[Manoel Campos]

PlanetLab has a simplistic structure. It's just a file where each line contains the CPU utilization for a given time.

Google datasets are way more complex and CloudSim Plus has support for them.

Check feature #2 at https://cloudsimplus.org/#2-main-exclusive-features

And please don't forget to give the project a star at GitHub to help us.

Manoel Campos da Silva Filho Software Engineer

Computer Science and Engineering Ph.D. Student at University of Beira Interior (Portugal)

Professor at Federal Institute of Education, Science and Technology of Tocantins (Brazil)

http://manoelcampos.com

 about.me

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAKFJJfaJ0eV7rCm6XFA6zjKOYY%2BaoA5XqPguSkcgyO5Lkrb7%3DQ%40mail.gmail.com.

[Priyanka H]

Thank you sir.

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAEPNnK1-qe2YPpqy%2BKodFMjLpvKG1sESHWE7s3ev59p-kC_Q0w%40mail.gmail.com.

[Priyanka H]

Sir,

I just want to know if there are 29 days trace in google cluster dataset 2019? 

Please reply sir

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAEPNnK1-qe2YPpqy%2BKodFMjLpvKG1sESHWE7s3ev59p-kC_Q0w%40mail.gmail.com.

--

Regards,

Priyanka H

[john wilkes]

Hi. Please read the documentation! Most of these questions are answered there.

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAKFJJfYv4FdTdbuvfAxybKggZJRxiNWd-vqwup%3D9d-%2BHqZLEzA%40mail.gmail.com.

[Priyanka H]

Hi.. 

Please can any one give me the 2019 google datasets? I want CPU and memory usage of the host details from the datasets. Can anyone pls help me with this?

To view this discussion on the web visit https://groups.google.com/d/msgid/googleclusterdata-discuss/CAEvynS20wsaN2tQeE%2BUWD6uQr%3DPPCPjeuqFEzCduR8cMBd4Esw%40mail.gmail.com.