Software QA and Load Testing Solutions? 23
tekiegreg asks: "I've been asked by the boss to evaluate Load Testing and QA solutions for use by our company. Google Searches have yielded TestComplete and Mercury's solutions. However prices are very steep. Has anything in the Open Source world even come close to this level of functionality in a testing suite? Searches of Sourceforge and Freshmeat reveal nil. Are there any other solutions that people have tried, out there?"
JRunner (Score:2, Informative)
Re:JRunner (Score:2)
People (and I won't say just Windows users, mind you) have a tendency to look at OS software and say: This doesn't do what I need, so I'll just buy the commercial product. It might be cheaper to write the extensions to jmeter.
Re:JRunner (Score:2, Insightful)
1) It could be possible that the organization might not have the resources to develop (not just money, but expertise) such extensions
2) The time to develop, test and deploy is probably going to be longer than a buy (or download) and implement. What is the time frame?
3) The cost to benefit might still be better in buying a commercial package
Re:JRunner (Score:1)
It might. But beware. If you don't have the source, then you'd better be doing something firmly within the envelope of what the designers expected.
JMeter (Score:2, Informative)
you need something like LoadRunner (Score:3, Informative)
Mercury is worth every dollar (Score:2)
Re:Mercury is worth every dollar (Score:2)
It's a very powerful tool but the essence of it is very simple.
I looked at OpenSTA, but it is simply not in the same league.
The Mercury licences cost many tens of thousans of pounds, but do note you can buy short-term licences which can help reduce costs. When you're working with multi-million-pound projects, the costs are well worth it.
Uhmm, perl? (Score:3, Insightful)
Re:Uhmm, perl? (Score:1)
For example, witness that paradigm of open-source code, slashcode, tested by hundreds of thousands of users every day. Quel joie!
Not open source.... (Score:2)
Rational? (Score:3, Informative)
Rational Robot does automated testing. I'm pretty sure they have load and performance tools too.
http://www-306.ibm.com/software/rational/ [ibm.com]
Do it yourself (Score:2, Interesting)
Get it over with and just write the software yourself. Most of the work is custom software anyways.
Log everything to an xml file and or a database.
Write your own front end to the whole test harness.
There really isn't very much good help available.
Even though nunit is good for unit tests, there is nothing that stops you from implementing load/stress and performance tests with it.
You can even use the nunit user interface as a testharness until you
Some Open Source Testing Tools (Score:3, Informative)
Watier [clabs.org]
The Grinder [sourceforge.net]
Selenium [thoughtworks.com]
Last January there was a workshop on open source web test tools [pettichord.com] in Austin.
Depends on Your Requirements (Score:1)
However if you need to be able to do regression testing, performance tuning, and code profiling then you will either need to drop some cash (Mercury can do all these things) or spend some considerable time doing your own development. My company developed something similar to Mercury's
Have you considered... (Score:1)
Emily Latilla might say (Score:2)
That's very different. Never mind.
At my last programming position (Score:1)
Write it yourself using Perl and IE (Score:3, Informative)
JMeter (Score:1)
Grinder (Score:2)