Gmail Calendar Documents Reader Web more »
Recently Visited Groups | Help | Sign in
Google Groups Home
Discussions > Beyond the Basics > How to split test
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  3 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Jezze  
View profile  
 More options Jan 12 2006, 2:46 am
From: Jezze
Date: Wed, 11 Jan 2006 23:46:52 -0800
Local: Thurs, Jan 12 2006 2:46 am
Subject: How to split test
I want to test two adverts with different copy but same destination
URL.

I read somewhere that there is something called split testing where I
keep changing two adverts when one of them has 30 or more clicks than
the other advert on the same group.

But I'm not sure how to to that.

In other words, lets say that one advert has 60 clicks and the other
has 30 clicks more (90 click). I delete the advert with the 60 clicks
and write a different one which hopefully will beat the advert with the
90 clicks. Now I don't want to delete the good performing advert, the
one with the 90 clicks, because it will stop my campaign and none of
the adds will generate impressions and clicks..

Question:
Is there a way to reset both adverts so both start with zero clicks
that way days later I can check which advert has the most clicks?

Now from what I understand, just changing one letter on any advert will
mean that  it will stop showing until google does a review on it, right?


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
jtara  
View profile  
 More options Jan 12 2006, 6:07 am
From: jtara
Date: Thu, 12 Jan 2006 03:07:09 -0800
Local: Thurs, Jan 12 2006 6:07 am
Subject: Re: How to split test
Don't use clicks to compare ads - use CTR.  There's therefore no need
to reset the clicks.

Make sure that you turn "optimized serving" off. You want both ads to
be served equally.

30 clicks is a good rule of thumb. A more accurate way is to use
statistical confidence. There's a handy statistical confidence
calculator for AdWords here;

    http://splittester.com/

You enter the # of clicks and CTR for each of the two ads, and it will
calculate a confidence level.

Changing just one letter of an ad will trigger a review. However, the
ad will continue to run on Google Search. It will stop running on
Search Network and Content Network.

It would seem to be a good idea to run your ad only on Google Search
until you have optimized it. If you run on Search Network, in
particular, you muddy things up considerably. First of all, you will
see a blended CTR that includes both Google Search and Search Network.
But Adwords uses only Google Search to determine quality score.

Further, the review delay will skew the results. You may find, as I
have, that Search Network gives a lower CTR than Google Search. You
will notice that a new ad starts out strong, and then the CTR drops
once Search Network kicks-in.

I've done some testing that I believe I've found a way to isolate
Google Search and Search Network CTRs. In the particular case of the ad
campaign that I am testing, Search Network appears to be giving about
1/2 the CTR of Google Search. Now, tell me how you can accurately
compare ads when there is a variable, unknown delay between when an ad
is created and when it is reviewed and starts running on Search
Network?

(One way to improve accuracy is to pause the campaign until the ad has
been reviewed. Of course, you have no way of knowing when it has been
reviewed in this case, other than calling a Google rep and bugging
them.)

If you don't pause the campaign, you have to wait until your ads are
serving 50/50, and then still wait a few more days before comparing
CTRs, and even then it is not perfect. It seems to me if you EVER turn
on Search Network, then you've made it impossible to accurately compare
CTRs. Part of the time your ad was running on Google Search only, and
part of the time it was running on Google Search and Search Network.
You don't even know exactly when the ad was reviewed and started
running on Search Network (unless a rep tells you).

So, you don't know how much your changes to your ad contributed to the
difference in CTR, and how much having the ad running on Search Network
once it was reviewed contributed to the difference.

This has led me astray, and I'm sure has led others astray. The net
result is that it can lead you to conclude that the inferior ad is
actually the better one! This is because it is the OLDER ad, and thus
has run more on Google Search than the newer ad.

I am guessing that the big players constantly open seperate accounts
strictly for testing purposes. If you want to do a legitimate test, I
don't see how you can do it without opening a new account and starting
from scratch. Even your account history contributes to performance, to
some degree. But that figure is constantly changing, so the only way to
do an accurate test is to do it in a virgin account.


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
brad - eWhisper  
View profile  
(2 users)  More options Jan 12 2006, 7:38 am
From: brad - eWhisper
Date: Thu, 12 Jan 2006 04:38:45 -0800
Local: Thurs, Jan 12 2006 7:38 am
Subject: Re: How to split test
Here's an article on split testing with AdWords and how to set it all
up:
http://www.visibilitygenie.com/blog/ab-split-testing-with-adwords/

    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2010 Google