I'm glad Launchpad was down so I had time to actually research this. Based on the results of what I've found, here's my thoughts.
- We need to change our release policy. We will no longer beta test SDK changes for benign changes. Major changes and major releases should still remain as a beta SDK, since it's not that much more difficult to add those in.
- We should delete 1.1.6 betas entirely along with 1.2 betas.
We have 4 pretty benign changes to the framework. To be honest if it weren't for the fact that we're a system framework basically, I wouldn't care about betas at all, I'd just hand it out to a few people who are really good at feedback and see what they thought, then release. In fact if we had 4 or 8 really good feedback people to give us a full list of their feedback, we may not even need beta testing as much as
However, I don't think we should change things just based on conjecture. My thoughts are typically that you weigh things out and the most convincing item wins.
Facts
- We also can't determine the actual amount of people who use the beta framework, we can only determine download counts. (this is true for Growl itself)
- We need better statistics so that we know what's out there, especially with 1.3 coming up.
- We need to get 1.2.1 changes out shortly.
- We need to be confident that the framework works to the best of our ability.
- Here are download numbers from Cachefly year to date:
Here are the GCH numbers:
The downloads here are the most telling from the Growl server:
1 ..
1 Growl-1.1.3b2.dmg
1 Growl-1.1.3b4-SDK.dmg
1 Growl-1.1.5b1.dmg
1 Growl-1.1.5b2-SDK.dmg
1 Growl-1.1.5b2.dmg
1 Growl-1.1.5b3-SDK.dmg
1 Growl-1.1.5b3.dmg
1 Growl-1.1.6b1-SDK.dmg
1 Growl-1.1.6b1.dmg
1 Growl-1.1.6b2-SDK.dmg
1 Growl-1.1.6b2.dmg
1 Growl-1.1.6b3-SDK.dmg
1 Growl-1.1.6b3.dmg
1 Growl-1.1.6b4-SDK.dmg
1 Growl-1.1.6b4.dmg
1 Growl-1.2b1-SDK.dmg
1 Growl-1.2b2-SDK.dmg
1 Growl-1.2b4-SDK.dmg
1 Growl-1.2b5-SDK.dmg
1 Growl-1.2b6-SDK.dmg
1 Growl-1.2b7-SDK.dmg
1 Growl-1.2b7.dmg
1 files
1 growl-0.7.6.dmg
1 growl-1.1.6.dmg
2 Growl-1.1.3b4.dmg
2 Growl-1.1.4b1.dmg
2 Growl-1.1.4b2-SDK.dmg
2 Growl-1.1.5b1-SDK.dmg
2 Growl-1.2b3-SDK.dmg
2 Growl-1.2b6.dmg
3 Growl-1.1.1.dmg
3 Growl-1.1.4b1-SDK.dmg
3 Growl-1.1.4b2.dmg
3 Growl-1.2b1.dmg
4 Growl-1.1.1-SDK.dmg
4 Growl-1.2b2.dmg
5 Growl-1.2b5.dmg
9 Growl-1.2b3.dmg
22 Growl-1.2b4.dmg
28 11-03_ChatBubble.dmg
39 07-21_MasterShake.dmg
42 09-13_jewelcase_v1.dmg
44 07-21_Meatwad.dmg
69 Growl-0.7.6.dmg
1060
1275 Growl-1.1.6.dmg
I didn't want to spend more time trying to figure out the right syntax to grab every line, however everyone should be able to tell that very few people download beta sdk disk images.
- Another fact is that we have no structured release dates that Developers would hold their releases on in order to include updates to our framework, and no data to back up the need to continue pushing sdk releases. However, I think we get testing of the SDK based on people using it in their applications, in our own Extras, and in general based on how Growl is architected basically.
- It is my opinion that Developers are slow to adopt updated versions of our frameworks. With good reason.
Conclusions
Based on these facts, I think I'm fine with just releasing 1.2.1. I do not believe that anyone specifically pushes their release plans based on our release plans. Also, 1.2 was out for at least a month with nobody catching the 10.4 issue really until this thread means I think that we're better off release it and letting people test it with their beta testers and provide feedback and continue to test through Extras.
I think we need to change our whole release policy, create a release policy wiki page, and publish it.
I think the 1200+ SDK downloads on the GCH page is a misnomer. We do not have 1200+ app devs using Growl. We also don't see those numbers reflected in the beta SDK download, even if the final SDK download number is fully legitimate.