Failures in Unit test suite - Joomla! bug Squad

The old Google Groups will be going away soon, but your browser is incompatible with the new version.

« Groups Home

Joomla! bug Squad

Home

Discussions

+ new post

About this group

Join this group

Message from discussion Failures in Unit test suite

Mark Dexter

View profile

More options Jul 2 2010, 12:07 am

From: Mark Dexter <dextercow...@gmail.com>

Date: Thu, 1 Jul 2010 21:07:21 -0700

Local: Fri, Jul 2 2010 12:07 am

Subject: Re: Failures in Unit test suite

Print | View thread | Show original | Report this message | Find messages by this author

For that reason, it is better to use a different db for the unit tests. That
way it doesn't affect your site. You can change the config.php to point to a
different db than your normal one for the J! instance. Mark

On Thu, Jul 1, 2010 at 9:01 PM, Andrew Eddie <mambob...@gmail.com> wrote:
> Actually, it would seem that data is blown away after the tests are
> run, which is far from ideal.

> Regards,
> Andrew Eddie
> http://www.theartofjoomla.com - the art of becoming a Joomla developer

> On 2 July 2010 13:56, Ian MacLennan <ian.maclen...@joomla.org> wrote:
> > We really shouldn't be relying on sample data for the unit tests. We
> should
> > have XML files (or CSV) that contains the necessary data sets for the
> tests.
> > If you have a dataset that is appropriate you can send it to me and I
> can
> > create that (specify also the required tables). Once I've done it a time
> or
> > two I'll try to write docs on how it is done.
> > Ian

> > On Thu, Jul 1, 2010 at 9:38 PM, Andrew Eddie <mambob...@gmail.com>
> wrote:

> >> Ok, thanks.

> >> Regards,
> >> Andrew Eddie
> >> http://www.theartofjoomla.com - the art of becoming a Joomla developer

> >> On 2 July 2010 11:28, Amy Stephen <amystep...@gmail.com> wrote:
> >> > Beta 4 did not have the asset records for the new "Not a category"
> >> > categories if you did not use Sample Data.

> >> > Those missing records were recently added to the SVN.

> >> > On Thu, Jul 1, 2010 at 8:23 PM, Andrew Eddie <mambob...@gmail.com>
> >> > wrote:

> >> >> I reinstalled and the tests all pass now. I must have had some
> screwy
> >> >> sample data.

> >> >> Regards,
> >> >> Andrew Eddie
> >> >> http://www.theartofjoomla.com - the art of becoming a Joomla
> developer

> >> >> 2010/7/2 Rune V. Sjøen <rvsj...@gmail.com>:
> >> >> > This comes as a continuation of the comments in

> http://joomlacode.org/gf/project/joomla/tracker/?action=TrackerItemEd...
> >> >> > I am having consistent behavior like described there.

> >> >> > If I do a fresh joomla install into database joomla_16, and then
> use
> >> >> > phpmyadmin to copy the database into joomla_ut.
> >> >> > Then run the full unit test suite I get these failures

> --------------------------------------------------------------------------- ---------------------------------------
> >> >> > There were 3 failures:

> >> >> > 1) JAccessTest::testGetAssetRules
> >> >> > Failed asserting that two strings are equal.
> >> >> > --- Expected
> >> >> > +++ Actual
> >> >> > @@ @@

> -{"core.login.site":{"6":1,"2":1},"core.login.admin":{"6":1},"core.admin":{ "8":1,"7":1},"core.manage":{"7":1,"6":1},"cor

> e.create":{"6":1,"3":1},"core.delete":{"6":1},"core.edit":{"6":1,"4":1},"co re.edit.state":{"6":1,"5":1}}

> +{"core.login.site":{"6":1,"2":1},"core.login.admin":{"6":1},"core.admin":{ "8":1,"7":1},"core.manage":{"7":1,"10":1,"6":

> 1},"core.create":{"6":1},"core.delete":{"6":1},"core.edit":{"6":1},"core.ed it.state":{"6":1}}

> >> >> > 2) JAccessTest::testGetAuthorisedViewLevels
> >> >> > Failed asserting that two arrays are equal.
> >> >> > --- Expected
> >> >> > +++ Actual
> >> >> > @@ @@
> >> >> > Array
> >> >> > (
> >> >> > [0] => 1
> >> >> > - [1] => 2
> >> >> > - [2] => 3
> >> >> > - [3] => 4
> >> >> > + [1] => 3
> >> >> > )

> >> >> > 3) JUserTest::testAuthorisedLevels with data set "Normal" (0,
> >> >> > array(1, 3))
> >> >> > Failed for user 42
> >> >> > Failed asserting that two arrays are equal.
> >> >> > --- Expected
> >> >> > +++ Actual
> >> >> > @@ @@
> >> >> > Array
> >> >> > (
> >> >> > [0] => 1
> >> >> > - [1] => 3
> >> >> > + [1] => 2
> >> >> > + [2] => 3
> >> >> > + [3] => 4
> >> >> > )

> >> >> > FAILURES!
> >> >> > Tests: 2279, Assertions: 2095, Failures: 3, Incomplete: 995,
> Skipped:
> >> >> > 29.

> --------------------------------------------------------------------------- ---------------------------------------

> >> >> > If I run the test suite several times after wards I do not get
> these
> >> >> > failures anymore.Now, if I make another copy of joomla_16 into
> >> >> > joomla_ut
> >> >> > and
> >> >> > re-run the test the failures appear again. So this is consistent
> with
> >> >> > the
> >> >> > very first run of the complete test suite against a fresh install.
> >> >> > And
> >> >> > leads
> >> >> > me to believe that one or more unit tests do not reset the database
> >> >> > to a
> >> >> > consistent state after running.

> >> >> > Is anyone else able to confirm this behavior ?

> >> >> > Cheers,
> >> >> > Rune

> >> >> > --
> >> >> > You received this message because you are subscribed to the Google
> >> >> > Groups
> >> >> > "Joomla! bug Squad" group.
> >> >> > To post to this group, send email to
> joomlabugsquad@googlegroups.com.
> >> >> > To unsubscribe from this group, send email to
> >> >> > joomlabugsquad+unsubscribe@googlegroups.com<joomlabugsquad%2Bunsubscribe@go oglegroups.com>
> .
> >> >> > For more options, visit this group at
> >> >> > http://groups.google.com/group/joomlabugsquad?hl=en.

> >> >> --
> >> >> You received this message because you are subscribed to the Google
> >> >> Groups
> >> >> "Joomla! bug Squad" group.
> >> >> To post to this group, send email to joomlabugsquad@googlegroups.com
> .
> >> >> To unsubscribe from this group, send email to
> >> >> joomlabugsquad+unsubscribe@googlegroups.com<joomlabugsquad%2Bunsubscribe@go oglegroups.com>
> .
> >> >> For more options, visit this group at
> >> >> http://groups.google.com/group/joomlabugsquad?hl=en.

> >> > --
> >> > You received this message because you are subscribed to the Google
> >> > Groups
> >> > "Joomla! bug Squad" group.
> >> > To post to this group, send email to joomlabugsquad@googlegroups.com.
> >> > To unsubscribe from this group, send email to
> >> > joomlabugsquad+unsubscribe@googlegroups.com<joomlabugsquad%2Bunsubscribe@go oglegroups.com>
> .
> >> > For more options, visit this group at
> >> > http://groups.google.com/group/joomlabugsquad?hl=en.

> >> --
> >> You received this message because you are subscribed to the Google
> Groups
> >> "Joomla! bug Squad" group.
> >> To post to this group, send email to joomlabugsquad@googlegroups.com.
> >> To unsubscribe from this group, send email to
> >> joomlabugsquad+unsubscribe@googlegroups.com<joomlabugsquad%2Bunsubscribe@go oglegroups.com>
> .
> >> For more options, visit this group at
> >> http://groups.google.com/group/joomlabugsquad?hl=en.

> > --
> > You received this message because you are subscribed to the Google Groups
> > "Joomla! bug Squad" group.
> > To post to this group, send email to joomlabugsquad@googlegroups.com.
> > To unsubscribe from this group, send email to
> > joomlabugsquad+unsubscribe@googlegroups.com<joomlabugsquad%2Bunsubscribe@go oglegroups.com>
> .
> > For more options, visit this group at
> > http://groups.google.com/group/joomlabugsquad?hl=en.

> --
> You received this message because you are subscribed to the Google Groups
> "Joomla! bug Squad" group.
> To post to this group, send email to joomlabugsquad@googlegroups.com.
> To unsubscribe from this group, send email to
> joomlabugsquad+unsubscribe@googlegroups.com<joomlabugsquad%2Bunsubscribe@go oglegroups.com>
> .
> For more options, visit this group at
> http://groups.google.com/group/joomlabugsquad?hl=en.

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy

Account Options