Interested in working on Live profile view project (Coz)

[Shivam Khandelwal]

Hello,
I am Shivam Khandelwal, pursuing my B.Tech + MS from IIIT, Hyderabad, India. I read on “Live profile view” (Coz), offered by PLASMA-UMass. I am interested in working on this project, I also went through technical difficulties which I found quite challenging, but I am confident that can solve those while project development.

I have been working with web technologies since last 2 years, which include Python (Django), PHP (Core-PHP, Drupal, Moodle), Ruby on Rails for the back-end, and js, jQuery, Ember.js (framework), for the front-end.

Please help me in getting started. I have started reading more on Coz meanwhile.

Can I know more on this project ?
Also if there is any starter task related to this project, I would wish to work on that.

Thanking You
Shivam Khandelwal
+91-9457777788
http://shivamkhandelwal.in/

[Charlie Curtsinger]

Hi Shivam,

Yes, I just posted a starter task for coz. You can find directions here: https://github.com/plasma-umass/coz/wiki/Coz-Starter-Task-1-(GSoC-2015)

You can read more about what coz does and how it works in our technical report: https://web.cs.umass.edu/publication/details.php?id=2372

Please let me know if you have any issues or questions as you get started.

- Charlie

--
You received this message because you are subscribed to the Google Groups "PLASMA at UMass: Google Summer of Code" group.
To unsubscribe from this group and stop receiving emails from it, send an email to plasma-umass-g...@googlegroups.com.
To post to this group, send email to plasma-u...@googlegroups.com.
Visit this group at http://groups.google.com/group/plasma-umass-gsoc.
To view this discussion on the web visit https://groups.google.com/d/msgid/plasma-umass-gsoc/82dc1a8c-b785-46ee-b80e-d2c33a7dc54e%40googlegroups.com.

[shiva...@gmail.com]

Hi
After some problems for few times I was able to collect profile data.
Please review the results and the process I have followed.

If it is right, I would move to Bonus part too, and try to get it finished as soon as possible.

Process followed :
1. Forked and built coz.
2. Downloaded pbzip2.
3. Edited pbzip2.cpp, added header file, and one causal progress point. (one for threaded compress, and other non-threaded.)
4. Slightly changed pbzip2 MakeFile as -dl was needed for causal.h
5. Make pbzip2.
6. Wrote an .sh to run this command 200 times.
./coz run --- ./pbzip2 -qk master.zip -f
7. Manually verified them in profile.coz

Have uploaded the above work on GitHub too, which can be verified.
Complete work
https://github.com/skbly7/coz/tree/coz-test/profile-collect/pbzip

Profile sample created
https://github.com/skbly7/coz/blob/coz-test/profile-collect/pbzip/profile.coz

Thanking You
Shivam Khandelwal
+91-9457777788
http://shivamkhandelwal.in/

[Charlie Curtsinger]

Hi Shivam,

It looks like your progress point is not being executed. You can run the program without coz and set a breakpoint on the line where you put the progress point to see if it actually runs at all. Your runs have very few samples per-run. You should compress a larger file to make individual runs last longer.

- Charlie

To view this discussion on the web visit https://groups.google.com/d/msgid/plasma-umass-gsoc/8146e929-3cca-43d7-b553-9462b6960d08%40googlegroups.com.

[skb...@gmail.com]

Hello sir,

I debugged the issue, and found problem in my commit.
I think I have possibly solved properly now by modifying my MakeFile, and changing progress point location in the code.

I ran ./coz run, on 1GB file, for 11 times (took approx 1 hour for run), after which I was able to generate profile, which can be found here :
http://goo.gl/jlyKwa (was unable to upload that 1G file on git due to size limit, but have added a script "get_large_file" which randomly download a new sample file)

Also have generated a plot using ./coz plot as suggested in teaser task, which can be found here :
http://goo.gl/zvFzCm (quite messy maybe because of large data set, I am assuming)

Have also put the complete procedure, and code which I have followed in my repo.
https://github.com/skbly7/coz/tree/coz-test

Please review and give some feedback the work done.

Thanking You
Shivam Khandelwal
+91-9457777788
http://shivamkhandelwal.in/

[Shivam Khandelwal]

Sir,

I am little confused in Bonus marks step which says :

"Collect and graph another causal profile for pbzip2, this time including potential optimizations in libbz2 instead of just the pbzip2 executable."

"including potential optimizations" means to add new progress points inside source code of libbz2, or it mean to edit libbz2 and find places where by doing changed, library can be made even more faster ?

Thanking You
Shivam Khandelwal
+91-9457777788
http://shivamkhandelwal.in/

[Charlie Curtsinger]

Shivam,

You should not need to insert progress points inside of libbz2. Just use coz's "scope" arguments to tell the profiler to consider possible optimizations inside of libbz2. This will find places in libbz2 where improving performance would make pbzip2 run faster. Does that make sense?

- Charlie