No interruption in a chain of dependent methods running
15 views
Skip to first unread message
Rice
Nov 2, 2009, 3:45:41 AM11/2/09
to testng-users
Hi,
I have 3 test classes, T1, T2, and T3. All the methods in each of
these test classes are sequentially dependent, where configuration
settings, which are mostly ThreadLocal variables, is set up in the
first method. I find the running of each chain of methods in these
test classes are interleaved to each other. This causes ThreadLocal
variables setting changed. Is there a way to make sure no interruption
in a chain of dependent methods running? The following is an
illustration for my problem.
T1.method1
T1.method2
T2.method1 <-- interrupting the running of methods in T1.
T2.method2
T1.method3
T3.method1
T3.method2
Regards,
Rice
I have 3 test classes, T1, T2, and T3. All the methods in each of
these test classes are sequentially dependent, where configuration
settings, which are mostly ThreadLocal variables, is set up in the
first method. I find the running of each chain of methods in these
test classes are interleaved to each other. This causes ThreadLocal
variables setting changed. Is there a way to make sure no interruption
in a chain of dependent methods running? The following is an
illustration for my problem.
T1.method1
T1.method2
T2.method1 <-- interrupting the running of methods in T1.
T2.method2
T1.method3
T3.method1
T3.method2
Regards,
Rice
Cédric Beust ♔
Nov 2, 2009, 11:07:12 AM11/2/09
to testng...@googlegroups.com
Hi Rice,
I don't quite follow, can you be more specific? What order of execution are you seeing? What do you think it should be? Also, can you post your (trimmed down) source that would allow me to reproduce this?
--
Cédric
I don't quite follow, can you be more specific? What order of execution are you seeing? What do you think it should be? Also, can you post your (trimmed down) source that would allow me to reproduce this?
--
Cédric
Tomás Pollak
Nov 2, 2009, 1:26:31 PM11/2/09
to testng...@googlegroups.com
Hi,
this is similar to the problem I reported recently. See:
http://groups.google.com/group/testng-users/browse_thread/thread/12891791105a9a07
There's a test case attached there.
It's the same problem, except my tests interfere with each other through the database, while Rice's do through ThreadLocal variables.
Regards,
Tomás
this is similar to the problem I reported recently. See:
http://groups.google.com/group/testng-users/browse_thread/thread/12891791105a9a07
There's a test case attached there.
It's the same problem, except my tests interfere with each other through the database, while Rice's do through ThreadLocal variables.
Regards,
Tomás
2009/11/2 Cédric Beust ♔ <cbe...@google.com>
Pranav
Nov 2, 2009, 5:59:06 PM11/2/09
to testng...@googlegroups.com
List,
Can somebody point me to some documentation/sample code .....on how to
change testcase name in report while running a @factory. right now i
have a factory which runs like 70-80 odd testcases, and in report they
have all same name, so its kindda tough to understand, I can add some
specific log message to debug, and if nothing works out may be I will
have to create my own custom report , but was just wondering this should
be a common problem for most of @factory users, and there should be some
standard way to solve it. I tried but was unable to find anything on
this forum mail archive or on net . any help/suggestion will be
appreciated,
Best,
Pranav
Cédric Beust ♔
Nov 2, 2009, 6:01:43 PM11/2/09
to testng...@googlegroups.com
Pranav
Nov 2, 2009, 7:12:41 PM11/2/09
to testng...@googlegroups.com
This looks intresteing, so I implemented ITest in my testcase class,
something like this
public class SuperTest implements Itest{
private String testName ;
public SuperTest (String name){
this.testName = name;
}
@Test
public void testSomething() {
<test code >
}
public String getTestName() {
return this.testName;
}
}
this had no impact on my test report,
Actually it never calls getTestName , am I doing somethign wrong here ?
Best,
Pranav
Cédric Beust ♔ wrote:
> Hi Pranav,
>
> Did you take a look at the ITest interface
> <http://testng.org/javadocs/org/testng/ITest.html>?
something like this
public class SuperTest implements Itest{
private String testName ;
public SuperTest (String name){
this.testName = name;
}
@Test
public void testSomething() {
<test code >
}
public String getTestName() {
return this.testName;
}
}
this had no impact on my test report,
Actually it never calls getTestName , am I doing somethign wrong here ?
Best,
Pranav
Cédric Beust ♔ wrote:
> Hi Pranav,
>
> Did you take a look at the ITest interface
Cédric Beust ♔
Nov 2, 2009, 7:21:25 PM11/2/09
to testng...@googlegroups.com
I just tested and it's working for me:
public class A implements ITest {
public String getTestName() {
return "This is test A";
}
}
and my HTML report says:
Which report are you looking at?
public class A implements ITest {
public String getTestName() {
return "This is test A";
}
}
and my HTML report says:
| Test method | Instance | Time (seconds) | Exception |
| g1 Test class:This is test A |
test.tmp.A@46b6db | 0 | |
| g2 Test class:This is test A |
test.tmp.A@46b6db | 0 |
Which report are you looking at?
Pranav
Nov 2, 2009, 7:43:22 PM11/2/09
to testng...@googlegroups.com
Your report looks perfect , just what i want.
I am using 5.8 jar, running it through eclipse ( right clicking
testng.xml , and click on "Run as testng suite"), and checking the
report in test-output/index.html
intrestingly, I dont see any instance column in my report.
any ideas?
Cédric Beust ♔ wrote:
> I just tested and it's working for me:
>
> public class A implements ITest {
> public String getTestName() {
> return "This is test A";
> }
> }
>
> and my HTML report says:
>
> *g1*
> Test class:This is test A test.tmp.A@46b6db 0
> *g2*
> Test class:This is test A test.tmp.A@46b6db 0
>
>
> Which report are you looking at?
>
> --
> **/*Cédric*
>
>
> Which report are you looking at?
>
> --
> /
Cédric Beust ♔
Nov 2, 2009, 8:16:00 PM11/2/09
to testng...@googlegroups.com
This is the right report, can you try 5.10?
On Nov 2, 2009 4:43 PM, "Pranav" <pranav...@gmail.com> wrote:
Your report looks perfect , just what i want.
I am using 5.8 jar, running it through eclipse ( right clicking
testng.xml , and click on "Run as testng suite"), and checking the
report in test-output/index.html
intrestingly, I dont see any instance column in my report.
any ideas?
Cédric Beust ♔ wrote: > I just tested and it's working for me: > > public class A implements ITest ...
> <mailto:pranav...@gmail.com>> wrote: > > > This looks intresteing, so I implemented ITest i...
> > <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>>
> wrote: > > > > > > List, > > > > Can somebody point me to some doc...
Pranav
Nov 2, 2009, 8:26:32 PM11/2/09
to testng...@googlegroups.com
I just tried with 5.10
these are my classes
package com.factory;
import org.testng.annotations.Factory;
import com.test.MyTest;
public class MyFactory {
@Factory
public Object[] createTests(){
int num = 5;
Object[] result = new Object[num];
for(int i=0;i<num;i++){
MyTest obj = new MyTest("Test" + i);
result[i] = obj;
}
return result;
}
}
package com.test;
import org.testng.Assert;
import org.testng.ITest;
import org.testng.annotations.Test;
public class MyTest implements ITest {
private String name;
public String getTestName() {
// TODO Auto-generated method stub
return this.name;
}
public MyTest(String name){
this.name = name;
}
@Test
public void someTest(){
Assert.assertEquals(true, false);
}
}
this is my testng.xml
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd" >
<suite name="testSuite" verbose="1" >
<test verbose="2" name="ItestDemo">
<classes>
<class name="com.factory.MyFactory"/>
</classes>
</test>
</suite>
please find the html report (ItestDemo.html) attached with this mail.
( Btw if it matters I am on MAC, JRE 1.5 )
Best,
pranav
Cédric Beust ♔ wrote:
>
> This is the right report, can you try 5.10?
>
>> On Nov 2, 2009 4:43 PM, "Pranav" <pranav...@gmail.com
these are my classes
package com.factory;
import org.testng.annotations.Factory;
import com.test.MyTest;
public class MyFactory {
@Factory
public Object[] createTests(){
int num = 5;
Object[] result = new Object[num];
for(int i=0;i<num;i++){
MyTest obj = new MyTest("Test" + i);
result[i] = obj;
}
return result;
}
}
package com.test;
import org.testng.Assert;
import org.testng.ITest;
import org.testng.annotations.Test;
public class MyTest implements ITest {
private String name;
public String getTestName() {
// TODO Auto-generated method stub
return this.name;
}
public MyTest(String name){
this.name = name;
}
@Test
public void someTest(){
Assert.assertEquals(true, false);
}
}
this is my testng.xml
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd" >
<suite name="testSuite" verbose="1" >
<test verbose="2" name="ItestDemo">
<classes>
<class name="com.factory.MyFactory"/>
</classes>
</test>
</suite>
please find the html report (ItestDemo.html) attached with this mail.
( Btw if it matters I am on MAC, JRE 1.5 )
Best,
pranav
Cédric Beust ♔ wrote:
>
> This is the right report, can you try 5.10?
>
>> On Nov 2, 2009 4:43 PM, "Pranav" <pranav...@gmail.com
>> <mailto:pranav...@gmail.com>> wrote:
>>
>>
>>
>> Your report looks perfect , just what i want.
>>
>> I am using 5.8 jar, running it through eclipse ( right clicking
>> testng.xml , and click on "Run as testng suite"), and checking the
>> report in test-output/index.html
>>
>> intrestingly, I dont see any instance column in my report.
>>
>> any ideas?
>>
>> Cédric Beust ♔ wrote: > I just tested and it's working for me: > >
>> public class A implements ITest ...
>>
>> > <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>>
>>
>>
>>
>> Your report looks perfect , just what i want.
>>
>> I am using 5.8 jar, running it through eclipse ( right clicking
>> testng.xml , and click on "Run as testng suite"), and checking the
>> report in test-output/index.html
>>
>> intrestingly, I dont see any instance column in my report.
>>
>> any ideas?
>>
>> Cédric Beust ♔ wrote: > I just tested and it's working for me: > >
>> public class A implements ITest ...
>>
>> wrote: > > > This looks intresteing, so I implemented ITest i...
>>
>> > > <mailto:pranav...@gmail.com
>> <mailto:pranav...@gmail.com> <mailto:pranav...@gmail.com
>>
>> > > <mailto:pranav...@gmail.com
Cédric Beust ♔
Nov 2, 2009, 8:46:03 PM11/2/09
to testng...@googlegroups.com
Can you try your code with TestNG on the command line? (without Eclipse)
--
Cedric
--
--
Cedric
ItestDemo
(Hover the method name to see the test class name)
Tests passed/Failed/Skipped: 0/5/0 Started on: Mon Nov 02 17:21:46 PST 2009 Total time: 0 seconds (49 ms) Included groups: Excluded groups:
FAILED TESTS Test method Time (seconds) Exception someTest 0 someTest 0 someTest 0 someTest 0 someTest 0
--
Cédric
Rice
Nov 2, 2009, 9:48:24 PM11/2/09
to testng-users
Hi Tomas,
Yes, my problem is same as yours.
Regards,
Rice
> this is similar to the problem I reported recently. See:http://groups.google.com/group/testng-users/browse_thread/thread/1289...
Yes, my problem is same as yours.
Regards,
Rice
> this is similar to the problem I reported recently. See:http://groups.google.com/group/testng-users/browse_thread/thread/1289...
> There's a test case attached there.
>
> It's the same problem, except my tests interfere with each other through the
> database, while Rice's do through ThreadLocal variables.
>
> Regards,
> Tomás
>
> 2009/11/2 Cédric Beust ♔ <cbe...@google.com>
>
> > Hi Rice,
>
> > I don't quite follow, can you be more specific? What order of execution
> > are you seeing? What do you think it should be? Also, can you post your
> > (trimmed down) source that would allow me to reproduce this?
>
> > --
> > Cédric
>
>
> It's the same problem, except my tests interfere with each other through the
> database, while Rice's do through ThreadLocal variables.
>
> Regards,
> Tomás
>
> 2009/11/2 Cédric Beust ♔ <cbe...@google.com>
>
> > Hi Rice,
>
> > I don't quite follow, can you be more specific? What order of execution
> > are you seeing? What do you think it should be? Also, can you post your
> > (trimmed down) source that would allow me to reproduce this?
>
> > --
> > Cédric
>
Pranav
Nov 3, 2009, 3:08:39 AM11/3/09
to testng...@googlegroups.com
Cedric,
testng through commandline creates perfect report. So the problem is
with eclipse TestNG plugin.
I tried maven surefire too, that also like eclipse plugin does not
create the intended report, and just ignores ITest implementation.
anybody any ideas to make it work on eclipse/maven ( specially for maven
surefire ) ?
Best,
Pranav
P.S : Cedric, I really appreciate your quick replies, thanks for all the
support.
> return this.name <http://this.name>;
> }
>
> public MyTest(String name){
>
> this.name <http://this.name> = name;
> *FAILED TESTS*
> *Test method* *Time (seconds)* *Exception*
> Click to show all stack frames <#124b7a6f6da3b068_>
> Click to show all stack frames <#124b7a6f6da3b068_>
> Click to show all stack frames <#124b7a6f6da3b068_>
> Click to show all stack frames <#124b7a6f6da3b068_>
> **/*Cédric*
> /
>
>
> >
testng through commandline creates perfect report. So the problem is
with eclipse TestNG plugin.
I tried maven surefire too, that also like eclipse plugin does not
create the intended report, and just ignores ITest implementation.
anybody any ideas to make it work on eclipse/maven ( specially for maven
surefire ) ?
Best,
Pranav
P.S : Cedric, I really appreciate your quick replies, thanks for all the
support.
> }
>
> public MyTest(String name){
>
> this.name <http://this.name> = name;
> }
>
> @Test
> public void someTest(){
>
> Assert.assertEquals(true, false);
> }
>
>
>
> }
>
>
> this is my testng.xml
>
> <!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd" >
>
> <suite name="testSuite" verbose="1" >
>
> <test verbose="2" name="ItestDemo">
>
> <classes>
> <class name="com.factory.MyFactory"/>
>
> </classes>
> </test>
> </suite>
>
> please find the html report (ItestDemo.html) attached with this mail.
>
> ( Btw if it matters I am on MAC, JRE 1.5 )
>
> Best,
> pranav
>
>
>
>
> Cédric Beust ♔ wrote:
> >
> > This is the right report, can you try 5.10?
> >
> >> On Nov 2, 2009 4:43 PM, "Pranav" <pranav...@gmail.com
> <mailto:pranav...@gmail.com>
>
> @Test
> public void someTest(){
>
> Assert.assertEquals(true, false);
> }
>
>
>
> }
>
>
> this is my testng.xml
>
> <!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd" >
>
> <suite name="testSuite" verbose="1" >
>
> <test verbose="2" name="ItestDemo">
>
> <classes>
> <class name="com.factory.MyFactory"/>
>
> </classes>
> </test>
> </suite>
>
> please find the html report (ItestDemo.html) attached with this mail.
>
> ( Btw if it matters I am on MAC, JRE 1.5 )
>
> Best,
> pranav
>
>
>
>
> Cédric Beust ♔ wrote:
> >
> > This is the right report, can you try 5.10?
> >
> >> On Nov 2, 2009 4:43 PM, "Pranav" <pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> >> <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>>> wrote:
> >>
> >>
> >>
> >> Your report looks perfect , just what i want.
> >>
> >> I am using 5.8 jar, running it through eclipse ( right clicking
> >> testng.xml , and click on "Run as testng suite"), and checking the
> >> report in test-output/index.html
> >>
> >> intrestingly, I dont see any instance column in my report.
> >>
> >> any ideas?
> >>
> >> Cédric Beust ♔ wrote: > I just tested and it's working for me: > >
> >> public class A implements ITest ...
> >>
> >> > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com> <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>>> wrote:
> >>
> >>
> >>
> >> Your report looks perfect , just what i want.
> >>
> >> I am using 5.8 jar, running it through eclipse ( right clicking
> >> testng.xml , and click on "Run as testng suite"), and checking the
> >> report in test-output/index.html
> >>
> >> intrestingly, I dont see any instance column in my report.
> >>
> >> any ideas?
> >>
> >> Cédric Beust ♔ wrote: > I just tested and it's working for me: > >
> >> public class A implements ITest ...
> >>
> >> > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>>>>
> >> wrote: > > > This looks intresteing, so I implemented ITest i...
> >>
> >> > > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> >> <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>
> <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>
> >> <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>>>>
> >>
> >> > wrote: > > > > > > List, > > > > Can somebody point me to
> some doc...
> >>
> >
> > >
>
>
>
>
> ItestDemo
>
> Tests passed/Failed/Skipped: 0/5/0
> Started on: Mon Nov 02 17:21:46 PST 2009
> Total time: 0 seconds (49 ms)
> Included groups:
> Excluded groups:
>
> /(Hover the method name to see the test class name)/
> >> wrote: > > > This looks intresteing, so I implemented ITest i...
> >>
> >> > > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> >> <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>
> <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>
> >> <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>>>>
> >>
> >> > wrote: > > > > > > List, > > > > Can somebody point me to
> some doc...
> >>
> >
> > >
>
>
>
>
> ItestDemo
>
> Tests passed/Failed/Skipped: 0/5/0
> Started on: Mon Nov 02 17:21:46 PST 2009
> Total time: 0 seconds (49 ms)
> Included groups:
> Excluded groups:
>
> *FAILED TESTS*
> *Test method* *Time (seconds)* *Exception*
> someTest 0
>
> java.lang.AssertionError: expected:<false> but was:<true>
> at com.test.MyTest.someTest(MyTest.java:24)
> ... Removed 27 stack frames
>
> Click to show all stack frames <#124b7a6f6da3b068_>
>
> java.lang.AssertionError: expected:<false> but was:<true>
> at com.test.MyTest.someTest(MyTest.java:24)
> ... Removed 27 stack frames
>
> /
>
>
> >
Cédric Beust ♔
Nov 3, 2009, 10:13:53 AM11/3/09
to testng...@googlegroups.com
That's really odd. I would expect Maven/Eclipse to possibly remove the HTML reporter, but in this case, you wouldn't see any report at all.
Can you try to replace the Eclipse plugin's testng.jar with the 5.10 version?
--
Can you try to replace the Eclipse plugin's testng.jar with the 5.10 version?
--
Cédric
Zaphod
Nov 3, 2009, 12:55:31 PM11/3/09
to testng-users
This is exactly the same problem that I was having with 5.10 and
reported in my post,
Subject: ITest.getTestName() method from an @Factory => same name for
every test
on: 06-Oct-2009
Unfortunately nobody replied at the time :-(
Regards
Ed
reported in my post,
Subject: ITest.getTestName() method from an @Factory => same name for
every test
on: 06-Oct-2009
Unfortunately nobody replied at the time :-(
Regards
Ed
Pranav
Nov 3, 2009, 7:36:41 PM11/3/09
to testng...@googlegroups.com
for eclipse currently I have testng 5.9 jar in my plugin folder, I dont
know where to get a testng-eclipse jar v5.10, if you can gimme some
link, I can try it.
Btw one more weird thing, testng 5.10 jar does not show ITest testname
in report , if I call it through command line or surefire . It creates
the report but just ignores the getTestName method. I get proper report
if I use testng v5.8 or v5.9
Let me know if you want me to file a bug for v5.10?
Best,
Pranav
Cédric Beust ♔ wrote:
> /
> > }
> >
> > public MyTest(String name){
> >
> > this.name <http://this.name> <http://this.name> = name;
know where to get a testng-eclipse jar v5.10, if you can gimme some
link, I can try it.
Btw one more weird thing, testng 5.10 jar does not show ITest testname
in report , if I call it through command line or surefire . It creates
the report but just ignores the getTestName method. I get proper report
if I use testng v5.8 or v5.9
Let me know if you want me to file a bug for v5.10?
Best,
Pranav
Cédric Beust ♔ wrote:
> That's really odd. I would expect Maven/Eclipse to possibly remove
> the HTML reporter, but in this case, you wouldn't see any report at all.
>
> Can you try to replace the Eclipse plugin's testng.jar with the 5.10
> version?
>
> --
> **/*Cédric*
> the HTML reporter, but in this case, you wouldn't see any report at all.
>
> Can you try to replace the Eclipse plugin's testng.jar with the 5.10
> version?
>
> --
> /
>
>
>
> On Tue, Nov 3, 2009 at 12:08 AM, Pranav <pranav...@gmail.com
> <mailto:pranav...@gmail.com>> wrote:
>
>
> Cedric,
>
>
> testng through commandline creates perfect report. So the problem is
> with eclipse TestNG plugin.
>
> I tried maven surefire too, that also like eclipse plugin does not
> create the intended report, and just ignores ITest implementation.
>
> anybody any ideas to make it work on eclipse/maven ( specially for
> maven
> surefire ) ?
>
> Best,
> Pranav
>
> P.S : Cedric, I really appreciate your quick replies, thanks for
> all the
> support.
>
>
>
> Cédric Beust ♔ wrote:
> > Can you try your code with TestNG on the command line? (without
> Eclipse)
> >
> > --
> > Cedric
> >
> >
> > On Mon, Nov 2, 2009 at 5:26 PM, Pranav <pranav...@gmail.com
> <mailto:pranav...@gmail.com>
>
>
> On Tue, Nov 3, 2009 at 12:08 AM, Pranav <pranav...@gmail.com
> <mailto:pranav...@gmail.com>> wrote:
>
>
> Cedric,
>
>
> testng through commandline creates perfect report. So the problem is
> with eclipse TestNG plugin.
>
> I tried maven surefire too, that also like eclipse plugin does not
> create the intended report, and just ignores ITest implementation.
>
> anybody any ideas to make it work on eclipse/maven ( specially for
> maven
> surefire ) ?
>
> Best,
> Pranav
>
> P.S : Cedric, I really appreciate your quick replies, thanks for
> all the
> support.
>
>
>
> Cédric Beust ♔ wrote:
> > Can you try your code with TestNG on the command line? (without
> Eclipse)
> >
> > --
> > Cedric
> >
> >
> > On Mon, Nov 2, 2009 at 5:26 PM, Pranav <pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> > <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>>
> wrote:
> >
> > I just tried with 5.10
> >
> > these are my classes
> >
> > package com.factory;
> >
> > import org.testng.annotations.Factory;
> >
> > import com.test.MyTest;
> >
> >
> >
> > public class MyFactory {
> >
> >
> > @Factory
> > public Object[] createTests(){
> >
> > int num = 5;
> > Object[] result = new Object[num];
> > for(int i=0;i<num;i++){
> > MyTest obj = new MyTest("Test" + i);
> > result[i] = obj;
> > }
> > return result;
> > }
> >
> > }
> >
> >
> >
> > package com.test;
> >
> > import org.testng.Assert;
> > import org.testng.ITest;
> > import org.testng.annotations.Test;
> >
> > public class MyTest implements ITest {
> >
> > private String name;
> >
> > public String getTestName() {
> > // TODO Auto-generated method stub
> > return this.name <http://this.name> <http://this.name>;
> wrote:
> >
> > I just tried with 5.10
> >
> > these are my classes
> >
> > package com.factory;
> >
> > import org.testng.annotations.Factory;
> >
> > import com.test.MyTest;
> >
> >
> >
> > public class MyFactory {
> >
> >
> > @Factory
> > public Object[] createTests(){
> >
> > int num = 5;
> > Object[] result = new Object[num];
> > for(int i=0;i<num;i++){
> > MyTest obj = new MyTest("Test" + i);
> > result[i] = obj;
> > }
> > return result;
> > }
> >
> > }
> >
> >
> >
> > package com.test;
> >
> > import org.testng.Assert;
> > import org.testng.ITest;
> > import org.testng.annotations.Test;
> >
> > public class MyTest implements ITest {
> >
> > private String name;
> >
> > public String getTestName() {
> > // TODO Auto-generated method stub
> > }
> >
> > public MyTest(String name){
> >
> > this.name <http://this.name> <http://this.name> = name;
> > }
> >
> > @Test
> > public void someTest(){
> >
> > Assert.assertEquals(true, false);
> > }
> >
> >
> >
> > }
> >
> >
> > this is my testng.xml
> >
> > <!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd" >
> >
> > <suite name="testSuite" verbose="1" >
> >
> > <test verbose="2" name="ItestDemo">
> >
> > <classes>
> > <class name="com.factory.MyFactory"/>
> >
> > </classes>
> > </test>
> > </suite>
> >
> > please find the html report (ItestDemo.html) attached with
> this mail.
> >
> > ( Btw if it matters I am on MAC, JRE 1.5 )
> >
> > Best,
> > pranav
> >
> >
> >
> >
> > Cédric Beust ♔ wrote:
> > >
> > > This is the right report, can you try 5.10?
> > >
> > >> On Nov 2, 2009 4:43 PM, "Pranav" <pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> > <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>
> >
> > @Test
> > public void someTest(){
> >
> > Assert.assertEquals(true, false);
> > }
> >
> >
> >
> > }
> >
> >
> > this is my testng.xml
> >
> > <!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd" >
> >
> > <suite name="testSuite" verbose="1" >
> >
> > <test verbose="2" name="ItestDemo">
> >
> > <classes>
> > <class name="com.factory.MyFactory"/>
> >
> > </classes>
> > </test>
> > </suite>
> >
> > please find the html report (ItestDemo.html) attached with
> this mail.
> >
> > ( Btw if it matters I am on MAC, JRE 1.5 )
> >
> > Best,
> > pranav
> >
> >
> >
> >
> > Cédric Beust ♔ wrote:
> > >
> > > This is the right report, can you try 5.10?
> > >
> > >> On Nov 2, 2009 4:43 PM, "Pranav" <pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> > <mailto:pranav...@gmail.com <mailto:pranav...@gmail.com>>
> > >> <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>>>> wrote:
> > >>
> > >>
> > >>
> > >> Your report looks perfect , just what i want.
> > >>
> > >> I am using 5.8 jar, running it through eclipse ( right
> clicking
> > >> testng.xml , and click on "Run as testng suite"), and
> checking the
> > >> report in test-output/index.html
> > >>
> > >> intrestingly, I dont see any instance column in my report.
> > >>
> > >> any ideas?
> > >>
> > >> Cédric Beust ♔ wrote: > I just tested and it's working
> for me: > >
> > >> public class A implements ITest ...
> > >>
> > >> > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>> <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>>>> wrote:
> > >>
> > >>
> > >>
> > >> Your report looks perfect , just what i want.
> > >>
> > >> I am using 5.8 jar, running it through eclipse ( right
> clicking
> > >> testng.xml , and click on "Run as testng suite"), and
> checking the
> > >> report in test-output/index.html
> > >>
> > >> intrestingly, I dont see any instance column in my report.
> > >>
> > >> any ideas?
> > >>
> > >> Cédric Beust ♔ wrote: > I just tested and it's working
> for me: > >
> > >> public class A implements ITest ...
> > >>
> > >> > <mailto:pranav...@gmail.com
> <mailto:pranav...@gmail.com>
> > <mailto:pranav...@gmail.com
Cédric Beust ♔
Nov 7, 2009, 12:25:20 PM11/7/09
to testng...@googlegroups.com
Hi Tomás,
The order I get from the command line looks correct:
The Eclipse screen shot you included does show a different order, though, so something is wrong. Are you running Maven in Eclipse or was it just a pure Eclipse plug-in run?
Can you run your own example from the command line, just like I did? And then can you try with Maven from the command line?
I'd like to narrow down the problem and I strongly suspect a problem with Maven/Surefire.
The order I get from the command line looks correct:
*********** INVOKED METHODS
test.tmp.TestA.insertA() 12741398
test.tmp.TestA.testGetA() 12741398
test.tmp.TestA.testViewA_Details1() 12741398
test.tmp.TestA.testViewA_Details2() 12741398
test.tmp.TestA.testViewA_Details3() 12741398
test.tmp.TestA.testViewA_Details4() 12741398
test.tmp.TestB.insertB() 2592387
test.tmp.TestB.testGetB() 2592387
test.tmp.TestB.testViewB_Details1() 2592387
test.tmp.TestB.testViewB_Details2() 2592387
test.tmp.TestB.testViewB_Details3() 2592387
test.tmp.TestB.testViewB_Details4() 2592387
test.tmp.TestA.insertA() 12741398
test.tmp.TestA.testGetA() 12741398
test.tmp.TestA.testViewA_Details1() 12741398
test.tmp.TestA.testViewA_Details2() 12741398
test.tmp.TestA.testViewA_Details3() 12741398
test.tmp.TestA.testViewA_Details4() 12741398
test.tmp.TestB.insertB() 2592387
test.tmp.TestB.testGetB() 2592387
test.tmp.TestB.testViewB_Details1() 2592387
test.tmp.TestB.testViewB_Details2() 2592387
test.tmp.TestB.testViewB_Details3() 2592387
test.tmp.TestB.testViewB_Details4() 2592387
The Eclipse screen shot you included does show a different order, though, so something is wrong. Are you running Maven in Eclipse or was it just a pure Eclipse plug-in run?
Can you run your own example from the command line, just like I did? And then can you try with Maven from the command line?
I'd like to narrow down the problem and I strongly suspect a problem with Maven/Surefire.
Tomás Pollak
Nov 8, 2009, 4:06:56 PM11/8/09
to testng...@googlegroups.com
Hi Cédric,
The problem was with the eclipse plugin. I have now tested running the tests from the command line and from maven, and they both execute the tests in the expected order. So apparently the problem is only with the eclipse plugin.
I'll try to do more tests, but it will take me some time.
Meanwhile, I am attaching the sample project again. This time I have shared 3 launchers that run the tests from the 3 tools (command-line, maven, eclipse plugin).
Cheers,
Tomás
The problem was with the eclipse plugin. I have now tested running the tests from the command line and from maven, and they both execute the tests in the expected order. So apparently the problem is only with the eclipse plugin.
I'll try to do more tests, but it will take me some time.
Meanwhile, I am attaching the sample project again. This time I have shared 3 launchers that run the tests from the 3 tools (command-line, maven, eclipse plugin).
Cheers,
Tomás
2009/11/7 Cédric Beust ♔ <cbe...@google.com>
Reply all
Reply to author
Forward
0 new messages