Structure of Award System & Prize Sponsorship Expectation

[Ben Ramsey]

TL;DR: There’s a lot here, but I need your help and input, so please take time to read and respond.

I’m forwarding Khayrattee’s message below from the sponsors mailing list, since I’d like everyone else on this list to be able to participate in this discussion.

First, a few updates:

• I am behind on things I wanted to have ready by September 1.
• I’m working on a way to share and contribute slides for PHP TestFest presentations so that group leaders are able to present without much preparation. That is a work-in-progress in this branch here: <https://github.com/phpcommunity/phptestfest.org/tree/slides-setup/slides>.
• In our last Google Hangouts session, Sara proposed the idea of a points system for awarding prizes. What follows is a rough outline of how I think that should work. **I would like feedback.**
• We need a tutorial/presentation clearly outlining the steps to create and submit tests for consideration in PHP TestFest. The following notes also talk a little bit about this process.

SUBMISSION PROCESS AND POINTS SYSTEM (needs feedback)

• We will need reviewers who have the expertise needed to review phpt tests and judge whether they are good and useful tests.
• Sara Golemon and Joe Watkins have volunteered as reviewers. We need a few more.
• General test submissions for PHP TestFest must be made as PRs to the phptestfest-2017-master branch at this repo: <https://github.com/phpcommunity/phptestfest-php-src>
• Bug test submissions (for bugs logged at <https://bugs.php.net/>) must be made against the appropriate PHP version branch at the same repo (phptestfest-2017-PHP-7.2, phptestfest-2017-PHP-7.1, or phptestfest-2017-PHP-7.0).
• Each pull request should include only one test file. This makes reviewing and awarding points simpler.
• Reviewers will have access to review these PRs and will award points to submissions.
• Points could be awarded, as follows:
• 1 point for each valid submission
• Extra points for a test that verifies a bug from <https://bugs.php.net/>
• Extra points for a particularly meaningful test
• 5 points for a submitter who has never contributed to core
• 10 points for finding a bug and opening a new bug report
• Extra points for improving an existing test to make it run faster or not fail intermittently
• Each point counts as an entry in the raffle, so the more points you have, the higher your chances of winning a prize
• In addition to the raffle, the reviewers will pick three submitters whose work stands out from the rest. These three will receive “big” prizes (what do we want to consider “big?”).
• The group whose members receive the most total points will win a prize. What kind of prize would be good for a group?
• Could we give away something like a sticker pack to all who participated?

As for tracking the points, submissions, and groups, I am working on a site that integrates with GitHub and can help us keep track of these things.

Okay, that’s enough brain dump for now. I want to hear from you. Khayrattee’s message follows. He needs feedback, as well.

Cheers,

Ben

Begin forwarded message:

From: Khayrattee Wasseem
Subject: [ThinkTank Session] - Structure of Award System & Prize Sponsorship Expectation..etc
Date: August 30, 2017 at 10:15:13 AM CDT
To: PHP TestFest Sponsorships

Hi Ben,

following my first batch of email request to potential sponsors (I reached out to 23 companies & other individuals), it came to mind about the below:


1) What are we expecting from Sponsors?

i) Are we expecting them to "propose what they can offer" 
ii) or do we actually want them to "buy in & provide" what we actually want them to provide.


To a couple of them, I have said that we currently do not have any kind of package, we are still working on an approach. And they could just propose what they can offer, for e.g any kind of subscriptions, vouchers, tools, tool licenses or ebooks - that could actually be useful to any (dev) participant and hence serve nicely as "prize raffles".


2) How will the sponsor get their name out there to the crowd? The places of exposure where sponsors will be listed..etc


3) A rough number of participants - so sponsors can better propose how much to actually provide..etc


4) Featuring Sponsors on our TestFest website - details we need from them:
i) Logo or banner (what acceptable sizes?)
ii) A bio or just the title of their company?
iii) Will we allow them to put a small marketing message as well?
iv) And I guess we should also let them display contact points - Main contact person, email or social pointers..etc ?


Would be great if we can all agree on finalising 'way-forward' to the above and I can better address/communicate with potential sponsors to convince them.

Anything I missed or you have (had) in mind?

PS: Let me know anything else in terms of expectation from me, so I can help further.

Let's Rock This PHP TestFest!
cheers
7PHP

[Joel Clermont]

First of all, thanks to Ben, Khayrattee, and all the others working hard to organize this and make it easier for groups to participate.

Having prizes is a fun way to get people excited to participate, and I agree that having a well-defined way to award those prizes is also important. What you've outlined below is really good so far, but I do have some additional comments and questions:

* What constitutes a "valid submission"? 

* If 10 people submit an identical test, do all 10 get the points? If not, does it go to the first submitter? Or the first person per time zone? Something else?

* Will there be any kind of task board to prevent overlap of work? For example, do we want people to say "Hey I'm working on writing a repro test for Bug #75000" so others can be aware and efforts can be de-duplicated?

* If someone finds a bug and opens a new report, but it turns out to be a duplicate bug report, would they still get 10 points? What if it's closed as "Wont fix" or "not a bug"?

* How will we confirm an improved test is actually faster or doesn't fail intermittently? Is there some sort of performance improvement threshold to qualify?

As for identifying "big" prizes, I'd do it two different ways: If something is unique/one of a kind (elephant signed by php core members, etc) it should be considered a big prize. The other way might be based on monetary value, though I'm not sure what the exact value would be without seeing a list of available prizes. Maybe the top X most valuable prizes depending on how many "big" prizes we want to award?

As for what would be a good group prize, I'd say any prize could qualify. The group could turn around and raffle it off to those that participated. There might also be some prizes that would be specifically for a group: free year of Meetup fees, or something like what NomadPHP did with a care package for user groups with a video presentation, swag, and prizes. Maybe we could even get a couple PHP core people to volunteer a "remote user group presentation" as a group prize?

Joel Clermont

414-852-6221

--
You received this message because you are subscribed to the Google Groups "PHP TestFest" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testfest+u...@phpcommunity.org.
To post to this group, send email to test...@phpcommunity.org.
Visit this group at https://groups.google.com/a/phpcommunity.org/group/testfest/.
To view this discussion on the web visit https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/5A49F975-6C3F-4E07-AF4F-2B62827E9EF1%40benramsey.com.

[Michelangelo van Dam]

Ben, others,

If none of you have done so already, I'd love to create a few slides that UG's can use to inform their peers about what to do, how to do it and who to inform.

I love to be a reviewer, even though I'm not super fluent in C. I guess my previous experiences with PHPTestFest '09 & '12 gave me enough understanding what is required during TestFestPHP.

In regards to sponsorships mentioned by Khayrattee I think local sponsorships would work out better for shirts, mugs, general swag and so on. Given the idea of a leaderboard and such, maybe finding sponsors for 1st, 2nd and 3rd spot prizes would be really awesome.

Michelangelo

[Ben Ramsey]

> On Aug 30, 2017, at 11:49 AM, Michelangelo van Dam <drag...@gmail.com> wrote:
>
> If none of you have done so already, I'd love to create a few slides that UG's can use to inform their peers about what to do, how to do it and who to inform.

I would love help creating slides. I’ve pointed Mark Railton to this branch in the repo, since he just gave a presentation at the Dublin group last night, but I’d love some collaboration here:

https://github.com/phpcommunity/phptestfest.org/tree/slides-setup/slides

It’s very simple to get set up with Hovercraft (the presentation generator), but if you have questions, let me know. We can start a new thread or discuss on IRC, etc.

> I love to be a reviewer, even though I'm not super fluent in C. I guess my previous experiences with PHPTestFest '09 & '12 gave me enough understanding what is required during TestFestPHP.

This would be great! I’ll start another thread to discuss reviewing and what that entails.

> In regards to sponsorships mentioned by Khayrattee I think local sponsorships would work out better for shirts, mugs, general swag and so on. Given the idea of a leaderboard and such, maybe finding sponsors for 1st, 2nd and 3rd spot prizes would be really awesome.
>

We can definitely have a points leaderboard generated by this site I’m building. Once I have more of the foundation in place, I’ll push up the app and open it for contributions.

-Ben

[Eric Poe]

How does one note which UG they belong to so that groups can generate points?

--
You received this message because you are subscribed to the Google Groups "PHP TestFest" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testfest+u...@phpcommunity.org.
To post to this group, send email to test...@phpcommunity.org.
Visit this group at https://groups.google.com/a/phpcommunity.org/group/testfest/.

To view this discussion on the web visit https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/2D9B38D8-26C1-4529-804A-770EEA433884%40benramsey.com.

[John Congdon]

As for determining "big" prizes.  

 

Since you can determine 3 standouts, do you think you could determine a 1st, 2nd, 3rd place by vote of some committee?

If so, what about just having a list of all of the prizes, and those 3 winners are given a choice of prizes?  Then we are determining value, or choosing what someone would want.  The signed elephpant for example may mean more to one person than another.

--

John Congdon

CEO

DiegoDev Group, LLC

Privacy and Confidentiality Notice:

The information contained in this electronic mail message is CONFIDENTIAL and is intended for the named recipient(s) only. It may contain privileged and confidential information. If you are not an intended recipient, you must not copy, forward, distribute or take action in reliance on it. If you have received this electronic mail message in error, please notify the sender immediately.

On Wed, Aug 30, 2017 at 12:37 PM Eric Poe <eric...@gmail.com> wrote:

How does one note which UG they belong to so that groups can generate points?

--

John Congdon

CEO

DiegoDev Group, LLC

Privacy and Confidentiality Notice:

The information contained in this electronic mail message is CONFIDENTIAL and is intended for the named recipient(s) only. It may contain privileged and confidential information. If you are not an intended recipient, you must not copy, forward, distribute or take action in reliance on it. If you have received this electronic mail message in error, please notify the sender immediately.

To view this discussion on the web visit https://groups.google.com/a/phpcommunity.org/d/msgid/testfest/CAC2L_85Z95JTRR3_W_Co2cq9b2yf_gxOhf1dNZoKbJd4a9Dp1Q%40mail.gmail.com.

[Ben Ramsey]

> On Aug 30, 2017, at 2:37 PM, Eric Poe <eric...@gmail.com> wrote:
>
> How does one note which UG they belong to so that groups can generate points?
>

The tool I’m writing to help us track contributions and points will allow us to create groups and will let users specify which group they belong to.

-Ben