AB Testing using remoteconfig

88 views
Skip to first unread message

David Montiel

unread,
Jun 6, 2016, 6:21:47 PM6/6/16
to Firebase Google Group


hi! has anyone used remote config to create an AB Test? I want to make sure 1/3 of users get version A, 1/3 of users get version B and the other third the default value.
but it seems like thats not possible
you can say, i want 30% of the users to get version A which means 30% of the requests will send me version A, thats fine.

But how do i make the version B hit the people who are not on version A?
It will just see it as another experiment and respond with version B 30% of the time, which is not what I want

Kato Richardson

unread,
Jun 7, 2016, 2:52:05 PM6/7/16
to Firebase Google Group
Hi David,

(Channeling some internal discussions into the mailing list here. None of this is my own wisdom.)

It looks like the basics for this are documented here. It's not extremely detailed for this use case yet, sorry. We're working on some improvements.

The gist is that you can set up multiple conditions for the same value. Remote config will go through each value in order (from top to bottom) until it comes across one that's true. So you create a condition that's for 33% of your users, and a second condition that holds true for 66% of your users. Kinda like this.



Since users in the 0-33% range are already matched by A, then B would only match 33.000...1 to 66%. Anything above this would be caught by C.

I hope that helps! 

☼, Kato


--
You received this message because you are subscribed to the Google Groups "Firebase Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firebase-tal...@googlegroups.com.
To post to this group, send email to fireba...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/firebase-talk/cf55bcc8-4d11-436a-9407-d698cea70ca9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.



--

Kato Richardson | Developer Programs Eng | kato...@google.com | 775-235-8398

Reply all
Reply to author
Forward
0 new messages