Automated Testing Tools In Agile

[Dharmesh]

Hi,

We are a .Net shop and have been wanting to implement automated testing on a regular basis. We have used tools like Fitnesse, MbUnit, etc. but they have been better at testing data centric applications where we could compare tables, views, etc.

What are some of the tools that are being used in your environment? If you mention how you are using those tool that would be great.

The challenge we face is automated testing is not prioritized and assigned resources (BA/QA and Dev) to test drive them. Working on it.. 

Most of the times we have implemented automated testing in Regression but I would like to use it in every iteration.

Please advise.

Thanks,

Dharmesh

[Lee Brandt]

We use SpecFlow and Machine.Specifications for testing.

Mostly we use SpecFlow for Automated UI testing (Integration tests) then Machine.Specifications (with Machine.Fakes) for Context-Specifications.

Lee Brandt | Co-Leader, KC .Net User Group | Director, KC Developer Conference | INETA Mentor (KS/MO) | Microsoft MVP | 913.538.1327

--
You received this message because you are subscribed to the Google Groups "AgileKC" group.
To view this discussion on the web visit https://groups.google.com/d/msg/KC_Agile/-/1iLajAZy4OQJ.
To post to this group, send email to KC_A...@googlegroups.com.
To unsubscribe from this group, send email to KC_Agile+u...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/KC_Agile?hl=en.

[James Peckham]

Lee,
Do u recommend specflow to drive watin or selenium on the browser (or wpf ui automation or codedUI for winforms etc) or do you use mvp/mvc/mvvm and drive the presenter, controller, viewmodel respectively?

Thanks,

[Lee Brandt]

The simple answer is yes.

We use SpecFlow for driving WatiN or Selenium for automated UI tests, and THEN use Machine.Specifications for driving out MVC/MVP controllers, etc.

Thanks,

Lee Brandt | Co-Leader, KC .Net User Group | Director, KC Developer Conference | INETA Mentor (KS/MO) | Microsoft MVP | 913.538.1327

[Dharmesh]

@Lee - Thanks for your input. Is SpecFlow good for end to end integration tests?

To unsubscribe from this group, send email to KC_Agile+unsubscribe@googlegroups.com.

For more options, visit this group at http://groups.google.com/group/KC_Agile?hl=en.

--
You received this message because you are subscribed to the Google Groups "AgileKC" group.
To post to this group, send email to KC_A...@googlegroups.com.

To unsubscribe from this group, send email to KC_Agile+unsubscribe@googlegroups.com.

For more options, visit this group at http://groups.google.com/group/KC_Agile?hl=en.

--
You received this message because you are subscribed to the Google Groups "AgileKC" group.
To post to this group, send email to KC_A...@googlegroups.com.

To unsubscribe from this group, send email to KC_Agile+unsubscribe@googlegroups.com.

[Lee Brandt]

That's actually what it does best. :0)

Lee Brandt | Co-Leader, KC .Net User Group | Director, KC Developer Conference | INETA Mentor (KS/MO) | Microsoft MVP | 913.538.1327

To view this discussion on the web visit https://groups.google.com/d/msg/KC_Agile/-/DFiz07SPIN0J.

To post to this group, send email to KC_A...@googlegroups.com.

To unsubscribe from this group, send email to KC_Agile+u...@googlegroups.com.

[Dharmesh]

Sorry for the repeat question but may be I am not seeing how it is used for End to End.. Here's my example if you can help me connect the dots

Iteration testing

Scenario1: X data for instrument A from Application 1 is correctly loaded in the message

Given X data for instrument A is in the Application 1

When the message is published

Then the message is created for X data for instrument A from Application 1

Scenario2: XML is created for X data for instrument A from the message

Given the message for X data for instrument A is published

When the XML creator is run

Then the XML is created for X data for instrument A

Scenario3: X data for instrument A from the XML is loaded in Application 2

Given the XML for X data for instrument A is created

When the Application 2 import process is run

Then the X data for instrument A is loaded in Application 2

How will I use SpecFlow to test these 3 scenarios in end to end regression?

This is how I am thinking I can use SpecFlow..

Run SpecFlow for all 3 scenarios and then write a End to End Regression test like

RegressionScenario: X data for instrument A is sent from Application 1 to Application 2

Given X data for instrument A is in Application 1

When Application 2 import process is run

Then X data for instrument A in Application 1 is loaded in Application 2

Would this be correct?

Please advise.

[Lee Brandt]

It sounds like what you are testing is the import process. Assuming that is the case.

How about:

Given X data for Instrument A is in application 1

And the message has been published for application 1

When the Import is run for application 2

Then X data for instrument A is in Application 2

If you need tests for getting X Data for Instrument A into Application 1 that is another test suite.

After talking more to Troy, I don't think you'll find anything that will be able to test a chain of three applications talking to each other through service busses.

Lee Brandt | Co-Leader, KC .Net User Group | Director, KC Developer Conference | INETA Mentor (KS/MO) | Microsoft MVP | 913.538.1327

To view this discussion on the web visit https://groups.google.com/d/msg/KC_Agile/-/i67XbwLIdWoJ.

To post to this group, send email to KC_A...@googlegroups.com.

To unsubscribe from this group, send email to KC_Agile+u...@googlegroups.com.

[Dharmesh]

Yes ultimately I am testing the import process but also whether correct data is flowing through from the App1 to message to XML to App2.

My regression end to end test will be testing for the process as well as if the data is correct.

How would you test end to end in this case?

[Lee Brandt]

I wouldn't. I would test that Application 1 works, the import process for Application 2 works and Application 2 works. I don't know of any real good way to test end-to-end message bus applications. That might be a great question for one of the testing Google Groups.

Wish I could be more helpful.

Lee Brandt | Co-Leader, KC .Net User Group | Director, KC Developer Conference | INETA Mentor (KS/MO) | Microsoft MVP | 913.538.1327

To view this discussion on the web visit https://groups.google.com/d/msg/KC_Agile/-/rhyKW1GwM4cJ.

To post to this group, send email to KC_A...@googlegroups.com.

To unsubscribe from this group, send email to KC_Agile+u...@googlegroups.com.

[Dharmesh]

No problem. I am just trying to find out if it is possible. Don't want to miss out if there's something available. Appreciate all your help.

Thanks.

[Mark Randolph]

You could always test it in production...

 

:-)

 

Mark Randolph

To view this discussion on the web visit https://groups.google.com/d/msg/KC_Agile/-/t5HKtXdF4rQJ.

To post to this group, send email to KC_A...@googlegroups.com.

To unsubscribe from this group, send email to KC_Agile+u...@googlegroups.com.