Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Collecting Install Statistics
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  Messages 1 - 25 of 101 - Collapse all  -  Translate all to Translated (View all originals)   Newer >
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Chad Windnagle  
View profile  
 More options Jun 3 2012, 12:42 am
From: Chad Windnagle <drmmr...@gmail.com>
Date: Sat, 2 Jun 2012 21:42:03 -0700 (PDT)
Local: Sun, Jun 3 2012 12:42 am
Subject: Collecting Install Statistics

Hello JoomlaSphere:

I'd like to open an discussion about what the thoughts and positions the
community would have on enabling some statistic collection on Joomla
installs that the project can collect and tabulate.

We frequently have discussions on this and other lists about how we think
or believe Joomla site users "use" Joomla. For example:

   - Hosting Environment
   - Number of Installs
   - Number of Updates

And I'm sure, many other bits of data as well. I think most commonly is the
"hosting environment" situation. Wherein, the CMS and Platform developers
are continually discussing what users are doing "now days". A perfect
example of this is the current discussion on whether we should retain MySQL
support in CMS 3.0. Other examples could be:

   - Server operating system
   - PHP version
   - Database Driver Used

And the lists goes on.

Perhaps rather than guessing and only getting feedback from developers, who
probably have a much different usage and operating environment than the
more-common Joomla user does, we can enable a utility that sends data back
to a collection server. This of course would be optional to send, kept
private, and not contain any sensitive server data to retain security.

*Possible Concerns*
The idea has some very real and possibly idea-killing concerns that I have
identified already, and I'm sure that there are more:

   - Security
   - Privacy
   - Legal Ramifications
   - License Compliance (Not sure if this sort of functionality conflicts
   with the GPL)

*Possible Benefits*
I see the benefits of this, assuming it can be done successfully navigating
the above concerns, as solving a great deal of many problems and questions
we have to ask ourselves when making changes. Specifically we can actually
answer questions like "what version of PHP are users most commonly
installing Joomla on?" or "Do users install using MySQL or MySQLi?".

Again, it's important to note that this would be an entirely *optional,
opt-in* data collection program that administrators must enable,
understanding what they are doing.

There are some examples of software that does this already. Many operating
systems and browsers (chrome, firefox) do this. I think that it could be a
valuable asset to the community.

I'd appreciate some thoughts on this. Thanks all for your time.

-Chad


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
elin  
View profile  
 More options Jun 3 2012, 3:48 pm
From: elin <elin.war...@gmail.com>
Date: Sun, 3 Jun 2012 12:48:27 -0700 (PDT)
Local: Sun, Jun 3 2012 3:48 pm
Subject: Re: Collecting Install Statistics

GPL has no relationship to this except that people who redistribute Joomla
have the right to remove or add to or modify or study the functionality.

I think it would be a really great idea to add this even if just to start
it is the environment that the initial install occurs in. Of course users
should be able to opt out

 To me database type and version, php version, and server would be the most
important baseline pieces of information.

Elin


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Mark Dexter  
View profile  
 More options Jun 3 2012, 5:00 pm
From: Mark Dexter <dextercow...@gmail.com>
Date: Sun, 3 Jun 2012 14:00:07 -0700
Local: Sun, Jun 3 2012 5:00 pm
Subject: Re: [jcms] Re: Collecting Install Statistics
I agree that collecting some stats would be very helpful. If possible,
it would be great to also get a snapshot each time people do an auto
update (again, of course with an opt in). It could be very useful for
example to know what extensions are being used in a site and what
version of Joomla is being used. Mark


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Radek Suski  
View profile  
 More options Jun 4 2012, 4:58 am
From: Radek Suski <suski.ra...@googlemail.com>
Date: Mon, 4 Jun 2012 01:58:34 -0700 (PDT)
Local: Mon, Jun 4 2012 4:58 am
Subject: Re: Collecting Install Statistics

We had something similar in one version of Sobi2.
We asked Sobi2 users to send (from backend) as an auto-generated XML file
with the environment data.
And then we published this data at: http://www.sigsiu.net/statistics/

Basically we needed these data to find out the best requirements
for SobiPro at that time.
But people keep asking us even today if we are going to repeat this action
because many Joomla! users and developers are very interested in such
statistics.

So I think this is very good idea.

Regards,
Radek


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
brian teeman  
View profile  
 More options Jun 4 2012, 6:21 am
From: brian teeman <jooml...@googlemail.com>
Date: Mon, 4 Jun 2012 03:21:44 -0700 (PDT)
Local: Mon, Jun 4 2012 6:21 am
Subject: Re: Collecting Install Statistics

For best practice this should be :
1. Entirely optional opt-in only
2. The data sent should be displayed to the user before it is sent and confirmation again required before it is sent
3. the explanation of how, where, when and why the data is being collected and who it will be used for MUST be in simple language and NOT legalese and of course translated into all languages
4. It must be completely anonymous
 (the latter condition might effect where in Joomla the data collection can take place ie the installation is not truly translated in many languages)


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Chris Davenport  
View profile  
 More options Jun 4 2012, 6:23 am
From: Chris Davenport <chris.davenp...@joomla.org>
Date: Mon, 4 Jun 2012 11:23:38 +0100
Local: Mon, Jun 4 2012 6:23 am
Subject: Re: [jcms] Re: Collecting Install Statistics

I think this is basically a good idea and is something that has been
suggested many times before.  I'd like to suggest that people interested in
moving the idea forwards should form a working group that will

1. Define how it will work.  Questions to be answered include how the
opt-in/out mechanism will work, what data will be gathered, how security
and privacy issues will be addressed, what infrastructure will be needed,
and so on.
2. Write the code for inclusion in Joomla.
3. Write the code that will gather the data and present the statistics.

This is not a trivial exercise but I do agree that it will be very
worthwhile if you can pull it off.

Chris.

On 4 June 2012 09:58, Radek Suski <suski.ra...@googlemail.com> wrote:

--
Chris Davenport
Joomla Leadership Team - Production Working Group
Joomla Documentation Coordinator

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Radek Suski  
View profile  
 More options Jun 4 2012, 6:43 am
From: Radek Suski <suski.ra...@googlemail.com>
Date: Mon, 4 Jun 2012 03:43:23 -0700 (PDT)
Local: Mon, Jun 4 2012 6:43 am
Subject: Re: [jcms] Re: Collecting Install Statistics

I fully agree with Brian in each point. However it would be necessary to
have a unique id for each Server.
This is a sample XML file we
used: https://cloud.sobi.pro/apps/files_sharing/get.php?token=d7f97c379863a...

It would be also necessary to define which data we want to collect. For
example available libraries which we normally not using but maybe we could
(i.e Spell checkers etc)

Regards,
Radek


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Victor Drover  
View profile  
 More options Jun 4 2012, 7:43 am
From: Victor Drover <ad...@anything-digital.com>
Date: Mon, 4 Jun 2012 06:43:45 -0500
Local: Mon, Jun 4 2012 7:43 am
Subject: Re: [jcms] Re: Collecting Install Statistics
As Brian's post indicates, privacy is a big concern here. Tagging individual servers with IDs seems like a slippery slope unless that server is tagged temporarily and, again, leaves the user and server completely anonymous.

Honestly, this feels a bit intrusive despite my personally wanting these statistics.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Jon Neubauer  
View profile  
 More options Jun 4 2012, 7:47 am
From: Jon Neubauer <jon.neuba...@community.joomla.org>
Date: Mon, 4 Jun 2012 04:47:47 -0700 (PDT)
Local: Mon, Jun 4 2012 7:47 am
Subject: Re: [jcms] Re: Collecting Install Statistics

If any tracking, tagging, or identifying were done solely during
installation (we may want to expand that in the future, but it sounds like
that's a good start) that information could easily be removed on that final
step of removing the installation directory.  Obviously personally
identifiable information wouldn't be collected at all to begin with.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Radek Suski  
View profile  
 More options Jun 4 2012, 7:58 am
From: Radek Suski <suski.ra...@googlemail.com>
Date: Mon, 4 Jun 2012 04:58:58 -0700 (PDT)
Local: Mon, Jun 4 2012 7:58 am
Subject: Re: [jcms] Re: Collecting Install Statistics

> Tagging individual servers with IDs seems like a slippery slope unless
> that server is tagged temporarily and, again, leaves the user and server
> completely anonymous.

This id was fully anonymous and cannot be back-followed.
If you have better idea how to prevent duplicating reports from the same
server/sites then let us know :)

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Victor Drover  
View profile  
 More options Jun 4 2012, 8:11 am
From: Victor Drover <ad...@anything-digital.com>
Date: Mon, 4 Jun 2012 07:11:14 -0500
Local: Mon, Jun 4 2012 8:11 am
Subject: Re: [jcms] Re: Collecting Install Statistics
If it's anonymous, that's the most important. But rather then considering them duplicate reports, perhaps this info would be good for understanding how many times a user installs on the same server as a rough measure of failure rate?

-V


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Matt Thomas  
View profile  
 More options Jun 4 2012, 8:16 am
From: Matt Thomas <m...@betweenbrain.com>
Date: Mon, 4 Jun 2012 08:16:17 -0400
Local: Mon, Jun 4 2012 8:16 am
Subject: Re: [jcms] Re: Collecting Install Statistics

This sounds like a great idea to me as well. There's no doubt that the more
information we have to base decisions on is better.

Some sort of random unique ID to prevent duplicate reports is fully
understandable, especially if it can't be traced back to the originator.

I fully agree with Brian's points, especially that the data sent should be
displayed to the user before it is sent.

@Chad, can you explain what you mean by "kept private"? Are you suggesting
that this data not be shared with everyone, or that it be anonymous?

Best,

Matt Thomas
Founder betweenbrain <http://betweenbrain.com/>™
Lead Developer Construct Template Development
Framework<http://construct-framework.com/>
Phone: 203.632.9322
Twitter: @betweenbrain
Github: https://github.com/betweenbrain

On Mon, Jun 4, 2012 at 7:58 AM, Radek Suski <suski.ra...@googlemail.com>wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Chad Windnagle  
View profile  
 More options Jun 4 2012, 8:50 am
From: Chad Windnagle <drmmr...@gmail.com>
Date: Mon, 4 Jun 2012 08:50:07 -0400
Local: Mon, Jun 4 2012 8:50 am
Subject: Re: [jcms] Re: Collecting Install Statistics

> For best practice this should be :
> 1. Entirely optional opt-in only
> 2. The data sent should be displayed to the user before it is sent and
> confirmation again required before it is sent
> 3. the explanation of how, where, when and why the data is being collected
> and who it will be used for MUST be in simple language and NOT legalese and
> of course translated into all languages
> 4. It must be completely anonymous
>  (the latter condition might effect where in Joomla the data collection
> can take place ie the installation is not truly translated in many
> languages)

I totally agree with this. In my mind I was picturing displaying the exact
record data to the admin with the "send" button. This way they could review
the exact amount of data being sent, and if something came up they were
uncomfortable with they could cancel at any time.

@Radek, thanks for your comments. Actually your implementation of this on
SOBI has been my reference point for the idea so far, so I appreciate your
comments as you've actually done this!

As Brian's post indicates, privacy is a big concern here. Tagging

> individual servers with IDs seems like a slippery slope unless that server
> is tagged temporarily and, again, leaves the user and server completely
> anonymous.

Vic I totally agree with you--the problem is, I don't know how else to do
it. I was thinking of exactly what Radek posted, which is kind of a hashed
up tag of some sort. An idea that crossed my mind is perhaps the "secret"
param in the CMS config file.

The reason I think that this would be a nice-to-have is because then after
an install, if someone does an update we can re-check (with permission!)
and update the record. This would provide more metrics like, how many
people after their first install actually keep the site updated.

As far as backward-tracing, I don't think that will be possible. We won't
be checking or recording IPs that will allow us to "go back" and find where
that server is.

@Chad, can you explain what you mean by "kept private"? Are you suggesting

> that this data not be shared with everyone, or that it be anonymous?

Rethinking what I said here, "kept private" isn't really what I meant :D I *
do* think it's important to make this information available. Extension
developers, blog-post-writers, media, etc... all deserve access to this. I
think a front-end somewhere which allows people to report on the data would
be important.

By kept private I was trying to say that we would ensure that the reporting
servers would be kept private, anonymous, and untraceable.

-Chad

Regards,
Chad Windnagle
Fight SOPA <https://www.google.com/landing/takeaction/>


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Beat  
View profile  
 More options Jun 5 2012, 2:49 am
From: Beat <beat...@gmail.com>
Date: Mon, 4 Jun 2012 23:49:02 -0700 (PDT)
Local: Tues, Jun 5 2012 2:49 am
Subject: Re: Collecting Install Statistics
Great idea. That would give us a precise picture, plus people not
participating can only blame to themselves that their config is not
taken in account in future support.

While I agree with Brian, I wouldn't make the privacy issue a big one
in this case.

The upgrades-checker would typically be a good place to give back only
the information that truly matters but that doesn't really affect
privacy of users:
1) joomla version (actually, it's implicitely given back already!)
2) PHP version
3) Database type and version
4) identification by IP address (that's already the case) since you
want to track servers evolution.

Advantage would be that there is already the upgrade checker, that it
already has a service, and that there would be a single point of
service and of decision, and that 2 out of the basic 4 infos are
already disclosed there. Plus it's a good incentive: "Want service ?
ok, then please help us improve it"

Additionally, depending on PHP and SQL versions, not only Joomla
itself, but also extensions providers would get same info, and could
serve specific upgrades or NOT depending on the versions. Thus admin
would not discover AFTER upgrade that he doesn't match new pre-
requisites, but BEFORE upgrade.....

Plus, it's super-easy to add the missing info there.

My 2 cents :)
Beat


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Scoop  
View profile  
 More options Jun 5 2012, 10:30 am
From: Scoop <imscoo...@gmail.com>
Date: Tue, 5 Jun 2012 07:30:16 -0700 (PDT)
Local: Tues, Jun 5 2012 10:30 am
Subject: Re: Collecting Install Statistics

To maintain better anonymity, perhaps identification could be through a
hash of unique variables associated with the installation…just an idea. An
IP Address is not exactly anonymous.

Data collection can be a touchy subject and all of the points Brian made
are good ones.
Scott


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Daniele Rosario  
View profile  
 More options Jun 5 2012, 10:33 am
From: Daniele Rosario <realskullb...@gmail.com>
Date: Tue, 5 Jun 2012 16:33:05 +0200
Local: Tues, Jun 5 2012 10:33 am
Subject: Re: [jcms] Re: Collecting Install Statistics

Totally agreed. The Ip adress should not be stored imho. That's
backtrackable and could lead to information disclosure.

Daniele Rosario


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Chad Windnagle  
View profile  
 More options Jun 5 2012, 10:39 am
From: Chad Windnagle <drmmr...@gmail.com>
Date: Tue, 5 Jun 2012 10:39:38 -0400
Local: Tues, Jun 5 2012 10:39 am
Subject: Re: [jcms] Re: Collecting Install Statistics

Just to reiterate, my original post doesn't suggest storing an IP address.
The idea is to be anonymous / nontracable. If you check Radek's post you'll
see an example of a hashed index that is anonymous.

That said, I think that the hash needs to come from the "client" (the
server / Joomla Instance) sending the information. This means we can update
the record later. If we don't have some sort of unique (unique doesn't mean
traceable) identifier, we can't look at things again later when the Joomla
Instance is installing an upgrade.

In fact, with this requirement using an IP address would be a bad idea
because in the case where several Joomla instances are from the same server
and IP address, there would be some data integrity issues. So most
definitely, the IP address idea is out (and was never really "in").

-Chad

Regards,
Chad Windnagle
Fight SOPA <https://www.google.com/landing/takeaction/>

On Tue, Jun 5, 2012 at 10:33 AM, Daniele Rosario <realskullb...@gmail.com>wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Scoop  
View profile  
 More options Jun 5 2012, 11:22 am
From: Scoop <imscoo...@gmail.com>
Date: Tue, 5 Jun 2012 08:22:22 -0700 (PDT)
Local: Tues, Jun 5 2012 11:22 am
Subject: Re: [jcms] Re: Collecting Install Statistics

I think it's fine -- and a good idea to use the IP address as one of the
"variables" I mentioned to be hashed (it was intentionally plural). But I
think you're right that alone, it's not sufficiently unique.

Scott


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Radek Suski  
View profile  
 More options Jun 5 2012, 11:42 am
From: Radek Suski <suski.ra...@googlemail.com>
Date: Tue, 5 Jun 2012 08:42:07 -0700 (PDT)
Local: Tues, Jun 5 2012 11:42 am
Subject: Re: [jcms] Re: Collecting Install Statistics

IP Address + Live Site URL -> md5 :)
I think it's unique enough and not possible to track back.

Regards,
Radek


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Matt Thomas  
View profile  
 More options Jun 5 2012, 11:45 am
From: Matt Thomas <m...@betweenbrain.com>
Date: Tue, 5 Jun 2012 11:45:29 -0400
Local: Tues, Jun 5 2012 11:45 am
Subject: Re: [jcms] Re: Collecting Install Statistics

If someone was to obtain, or intercept that data, couldn't they decrypt it?

Best,

Matt Thomas
Founder betweenbrain <http://betweenbrain.com/>™
Lead Developer Construct Template Development
Framework<http://construct-framework.com/>
Phone: 203.632.9322
Twitter: @betweenbrain
Github: https://github.com/betweenbrain

On Tue, Jun 5, 2012 at 11:42 AM, Radek Suski <suski.ra...@googlemail.com>wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Sam Moffatt  
View profile  
 More options Jun 5 2012, 11:46 am
From: Sam Moffatt <pasa...@gmail.com>
Date: Tue, 5 Jun 2012 08:46:59 -0700
Local: Tues, Jun 5 2012 11:46 am
Subject: Re: [jcms] Re: Collecting Install Statistics
Decrypt the hash?

Sam Moffatt
http://pasamio.id.au


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Radek Suski  
View profile  
 More options Jun 5 2012, 11:48 am
From: Radek Suski <suski.ra...@googlemail.com>
Date: Tue, 5 Jun 2012 08:48:59 -0700 (PDT)
Local: Tues, Jun 5 2012 11:48 am
Subject: Re: [jcms] Re: Collecting Install Statistics

As far I know, md5 hash still cannot be decoded.
It's basically the main functionality of a hash.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Matt Thomas  
View profile  
 More options Jun 5 2012, 11:49 am
From: Matt Thomas <m...@betweenbrain.com>
Date: Tue, 5 Jun 2012 11:49:17 -0400
Local: Tues, Jun 5 2012 11:49 am
Subject: Re: [jcms] Re: Collecting Install Statistics

Sorry, reverse MD5 hash lookup like http://tools.benramsey.com/md5/.

Best,

Matt Thomas
Founder betweenbrain <http://betweenbrain.com/>™
Lead Developer Construct Template Development
Framework<http://construct-framework.com/>
Phone: 203.632.9322
Twitter: @betweenbrain
Github: https://github.com/betweenbrain


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Daniele Rosario  
View profile  
 More options Jun 5 2012, 11:51 am
From: Daniele Rosario <realskullb...@gmail.com>
Date: Tue, 5 Jun 2012 17:51:55 +0200
Local: Tues, Jun 5 2012 11:51 am
Subject: Re: [jcms] Re: Collecting Install Statistics

Sha1 or whatever non-reversable method you know :)

Daniele Rosario


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Radek Suski  
View profile  
 More options Jun 5 2012, 11:54 am
From: Radek Suski <suski.ra...@googlemail.com>
Date: Tue, 5 Jun 2012 08:54:06 -0700 (PDT)
Local: Tues, Jun 5 2012 11:54 am
Subject: Re: [jcms] Re: Collecting Install Statistics

Matt,

I may be wrong but this is either a database of most common used passwords
and not really a de-coder.

Regards,
Radek


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Messages 1 - 25 of 101   Newer >
« Back to Discussions « Newer topic     Older topic »