I would like to send out an email notification from DBFit/Fitnesse when a test suite execution completes with some failed tests.
I am unable to find any working solution, has anyone got one?
How do you run your tests?
I run tests on a build server and have that e-mail me and my team when one or more tests fail.
I use FitNesse's jUnit runner to execute the tests as a project automatically. Build servers have standard features to detect failed jUnit tests and notify people of those.
Related
I have Selenium maven tests running in my release pipelines.
Now I want to automatically update the outcome results in test cases in test plans.
I know there is a way of doing this for C# based selenium tests with vstest step.
But could someone help with logic to do this for selenium maven tests?
I have a question that's very similar to what's discussed here:
Integration Test of REST APIs with Code Coverage
I deployed a war file that exposes the REST APIs to a web server and I'm using TestNG to write test cases for the REST APIs. I'm not unit testing - I'm only end-to-end / integration testing. Currently, I'm running test cases from eclipse in my machine.
My goal is to get coverage reports on the TestNG test cases.
Since the tests are local to my machine and the REST API is deployed in another server, EclEmma doesn't provide any meaningful data when I run the tests cases in my machine.
Is there a way to point EclEmma to the web server instead of my local machine and get the code coverage report?
Would it be better/possible to include the tests in the war file and run the tests from the web server? That should allow me to get the meaningful code coverage report, right?
The easiest way forward in cases like this is normally to start the web server inside of your IDE and run tests with coverage measuring in there. Even better to start the web server from within the tests - then a build tool like maven can also do code coverage reporting.
I have big website with many registered users and I need to create a looped test with automatically log-in and log-out my test user (one time per hour). It's very easy in Selenium IDE. But next thing is sending an email when logging in will not work. And I don't know how I have to do this. Can Selenium IDE send me an email after every unsuccessful log-in attempt in that test?
You should use a continuous integration tool for that type of thing. Check out Jenkins which is easy to install. Then within Jenkins you create a job that launch your Selenium IDE test (probably through a BATCH or SHELL script). And within this Jenkins job, you can configure to receive an email in case of failure.
Once you have this Jenkins CI in place, you will be able to use it to launch all sort of jobs. Not only the test, but also the build and other engineering automated tasks. That's become the backbone of your Engineering organisation along with your SCM and Issue Tracker.
As Laurent Said you can use Jenkins to email you when tests fail but you will have to use Seleniumhq instead of Selenium-ide.
The good news is that you can still write your tests in selenium-ide and then transfer them across to seleniumhq and let Jenkins take it from there.
If you have NUnit integration tests that test access to the database, how do I run those tests on a build machine where the target database is on a different server.
It's almost like I want to run the integration tests from the build server (using CruiseControl) but have the tests run on the target server so I can exercise the database in question.
I think the simples way is to expose database via network.
NUnit tests can be run from c#/vb.net code.
So according to that, you can create page for running tests, page would be calling codebehind code which then call your tests and you can see results of your tests, remotely.
This should get you started:
http://nunit.net/blogs/?p=23
I am running nightly builds using cc.net 1.4.2. I am also using nunit2.4.8. If I force the build manually it works fine but most of my nightly schduled builds fails saying testfixture setup failed. Is this some bug in nunit2.4.8 or something othert thing as I cant find out the reason
Is it the same cc.net project being forced that is scheduled to run nightly? If not, there may be a difference in how they are configured. If they are the same, I would suggest adding some logging to the test fixture setup code to see if you can track down the problem. Perhaps there is a nightly task running on the server (backup or virus scan perhaps) that is causing the issue. Another possibility is a task running on another server (taking a database offline for example.) I don't believe this is a bug in NUnit.