help us (re)organize MDN's content

[Ali Spivak]

hello MDN list!

As you (hopefully) know, MDN is in the process of undergoing a redesign, and we are seeking your help to make it happen. As part of figuring out how to organize the site content, we're asking developers to participate in a sorting activity. This is where we need help - we'd like MDN contributors as well as members of your network of web developers to help out. We would optimally like as wide a range of participants as possible - contributors, super users, web developers who have barely heard of MDN, etc.

The way this works is pretty simple. First of all, go to the screener: http://bit.ly/dev-eco-2 Answer some questions & if you qualify, you’ll be taken to a card sorting exercise. You’ll get a list of items and be asked to group them, then give each group a name. The activity should take 15–20 minutes to complete, and, if you wish, we will send a $25 Amazon gift card as a thanks.

Questions? Please email me if you want to know know more about why we are doing the exercise in this way, or the redesign as a whole. Tony Santos or Bram Pitoyo can answer any questions about the sort itself.

Please feel free to cut and paste parts of this email, or use the version below, to send to other developers.

thanks!


ali spivak
MDN Product Manager, Mozilla
408-859-8260
asp...@mozilla.com


hello,

As a web and/or app developer, you (hopefully) know about the Mozilla Developer Network site. Right now, we are in the process of undergoing a redesign, and we are seeking your help to make the site even more awesome. As part of figuring out how to reorganize the site content, we're asking developers to participate in a sorting activity. The way this works is pretty simple. First of all, go to the screener: http://bit.ly/dev-eco-2 Answer some questions & if you qualify, you’ll be taken to a card sorting exercise. You’ll get a list of items and be asked to group them, then give each group a name. The activity should take 15–20 minutes to complete, and, if you wish, we will send a $25 Amazon gift card as a thanks.
Have questions about our research before you start? Send Bram Pitoyo <br...@mozilla.com> an email, and I’ll be more than happy to answer it.

[Ali Spivak]

Hi Sabniveesu,

of course we want you to participate in and contribute to MDN! There actually is an error in the screener form that we are in process of fixing, which should solve the issue of qualified people not being allowed through.

I'll let you know when it is fixed!

ali

----- Original Message -----

From: "Sabniveesu Shashank" <shasha...@gmail.com>
To: "Ali Spivak" <asp...@mozilla.com>
Cc: "dev-mdc" <dev...@lists.mozilla.org>, "Bram Pitoyo" <br...@mozilla.com>, "Anthony Santos" <asa...@mozilla.com>
Sent: Wednesday, June 5, 2013 11:23:25 AM
Subject: Re: help us (re)organize MDN's content

_______________________________________________
dev-mdc mailing list
dev...@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-mdc



Hi ! I just completed the exercise. Say I don't qualify in it; Shouldn't I participate in contributing to MDN?

[Jeremie Patonnier]

Hi,

People I pinged <https://twitter.com/MDNfr/status/342200177924374528> to
complete the survey this morning report me that it is closed.
Is it on purpose? A 24h to complete the survey after its announcement looks
like a very short period.
Is it plan to reopen it?
What can I said to people who ask about?

++
Jérémie



2013/6/4 Ali Spivak <asp...@mozilla.com>

> pretty simple. First of all, go to the screener: http://bit.ly/dev-eco-2Answer some questions & if you qualify, you’ll be taken to a card sorting

> exercise. You’ll get a list of items and be asked to group them, then give
> each group a name. The activity should take 15–20 minutes to complete, and,
> if you wish, we will send a $25 Amazon gift card as a thanks.
> Have questions about our research before you start? Send Bram Pitoyo <
> br...@mozilla.com> an email, and I’ll be more than happy to answer it.
>
>
>
>
>
>
>
> _______________________________________________
> dev-mdc mailing list
> dev...@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-mdc
>

--
Jeremie
.............................
Web : http://jeremie.patonnier.net
Twitter : @JeremiePat <http://twitter.com/JeremiePat>

[Sabniveesu Shashank]

On Wed, Jun 5, 2013 at 12:42 AM, Ali Spivak <asp...@mozilla.com> wrote:

[Ali Spivak]

We apparently had a record number of responses and closed out the survey within a few hours! We'll review the results and possibly do another round to verify...


----- Original Message -----

From: "Jeremie Patonnier" <jeremie....@gmail.com>
To: "Ali Spivak" <asp...@mozilla.com>
Cc: "dev-mdc" <dev...@lists.mozilla.org>, "Bram Pitoyo" <br...@mozilla.com>, "Anthony Santos" <asa...@mozilla.com>
Sent: Wednesday, June 5, 2013 12:41:17 PM
Subject: Re: help us (re)organize MDN's content

Hi,


People I pinged to complete the survey this morning report me that it is closed.

Is it on purpose? A 24h to complete the survey after its announcement looks like a very short period.
Is it plan to reopen it?
What can I said to people who ask about?


++
Jérémie





2013/6/4 Ali Spivak < asp...@mozilla.com >

hello MDN list!

As you (hopefully) know, MDN is in the process of undergoing a redesign, and we are seeking your help to make it happen. As part of figuring out how to organize the site content, we're asking developers to participate in a sorting activity. This is where we need help - we'd like MDN contributors as well as members of your network of web developers to help out. We would optimally like as wide a range of participants as possible - contributors, super users, web developers who have barely heard of MDN, etc.

The way this works is pretty simple. First of all, go to the screener: http://bit.ly/dev-eco-2 Answer some questions & if you qualify, you’ll be taken to a card sorting exercise. You’ll get a list of items and be asked to group them, then give each group a name. The activity should take 15–20 minutes to complete, and, if you wish, we will send a $25 Amazon gift card as a thanks.

Questions? Please email me if you want to know know more about why we are doing the exercise in this way, or the redesign as a whole. Tony Santos or Bram Pitoyo can answer any questions about the sort itself.

Please feel free to cut and paste parts of this email, or use the version below, to send to other developers.

thanks!


ali spivak
MDN Product Manager, Mozilla
408-859-8260
asp...@mozilla.com


hello,

As a web and/or app developer, you (hopefully) know about the Mozilla Developer Network site. Right now, we are in the process of undergoing a redesign, and we are seeking your help to make the site even more awesome. As part of figuring out how to reorganize the site content, we're asking developers to participate in a sorting activity. The way this works is pretty simple. First of all, go to the screener: http://bit.ly/dev-eco-2 Answer some questions & if you qualify, you’ll be taken to a card sorting exercise. You’ll get a list of items and be asked to group them, then give each group a name. The activity should take 15–20 minutes to complete, and, if you wish, we will send a $25 Amazon gift card as a thanks.

Have questions about our research before you start? Send Bram Pitoyo < br...@mozilla.com > an email, and I’ll be more than happy to answer it.







_______________________________________________
dev-mdc mailing list
dev...@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-mdc

[Jeremie Patonnier]

Hi :)


2013/6/5 Tony Santos <asa...@mozilla.com>

> Hi Jeremie,
>
> The card sort study is in fact closed. We hit our maximum number of
> participants in record time. Because an open card sort is not like a
> survey, we set the maximum number of participants to 60 people. After the
> email went out last night from Ali we very quickly hit that number. If
> you'd like to read more about why we only used a sample size of 60, there
> is a very good (and fairly short) article written by Jakob Nielsen on card
> sorting methodology at:
> http://www.nngroup.com/articles/card-sorting-how-many-users-to-test/
>
> The tl;dr version of the article is: the similarity scores of a sample
> size of 60 strongly correlate (r= +0.98) with the similarity scores of a
> study with a much larger sample.
>

Oh right... I completely forgot about this (my colleagues will kill me when
they'll read that).


> This is not the last study we will run, so keep an eye out for future
> studies (some of them will have much larger sample sizes, some of them
> smaller, it just depends on the kind of study we're running). Unfortunately
> part of having such an engaged and active community is that we hit the
> maximum number of participants we need to optimize analysis time with
> accurate results very very quickly. This is fantastic because it means we
> can learn quickly and make changes based on that learning quickly.
>

\o/ (to say the least)


> The downside is not everyone gets to participate in the research.
>

Yes, in that case, a general "call to arms" on mailing lists is maybe not
the best approach. Maybe building a list of people who are interested
participating in such studies in the future could help lower the
frustration of not being able to participate (but I wonder if it would not
introduce a bias in the studies).


> I encourage anyone who has opinions on the changes to the site to keep
> sharing them with us, in future research studies and in the other forums
> you use to communicate with us.
>

To provide such "free" feedback, did the UX team have some entry points we
could spread about? (Mailing list, blog, twitter account, dedicated web
sites, etc.)


> We are absolutely listening and appreciative of your feedback. I'd also
> like to personally thank everyone who participated and everyone who tried
> to participate. I have rarely seen the kind of response we got in my
> career, and I'm very excited to be working with such an awesome community
> of people.
>

Yeah \o/ (again)


> I hope that answers your questions :)
>

Definitely, thank you very much :)

Best,

--
Jeremie
.............................
Web : http://jeremie.patonnier.net

Twitter : @JeremiePat <http://twitter.com/JeremiePat>

[Tony Santos]

Hi Jeremie,

The card sort study is in fact closed. We hit our maximum number of participants in record time. Because an open card sort is not like a survey, we set the maximum number of participants to 60 people. After the email went out last night from Ali we very quickly hit that number. If you'd like to read more about why we only used a sample size of 60, there is a very good (and fairly short) article written by Jakob Nielsen on card sorting methodology at: http://www.nngroup.com/articles/card-sorting-how-many-users-to-test/

The tl;dr version of the article is: the similarity scores of a sample size of 60 strongly correlate (r= +0.98) with the similarity scores of a study with a much larger sample.

This is not the last study we will run, so keep an eye out for future studies (some of them will have much larger sample sizes, some of them smaller, it just depends on the kind of study we're running). Unfortunately part of having such an engaged and active community is that we hit the maximum number of participants we need to optimize analysis time with accurate results very very quickly. This is fantastic because it means we can learn quickly and make changes based on that learning quickly. The downside is not everyone gets to participate in the research.

I encourage anyone who has opinions on the changes to the site to keep sharing them with us, in future research studies and in the other forums you use to communicate with us. We are absolutely listening and appreciative of your feedback. I'd also like to personally thank everyone who participated and everyone who tried to participate. I have rarely seen the kind of response we got in my career, and I'm very excited to be working with such an awesome community of people.

I hope that answers your questions :)

Cheers,
Tony Santos
Mozilla UX