Ask Slashdot: Best Test Case Manager Plugin For JIRA? 70
Bomarc writes: I've been working with software testing ... for a few years now. And there seems to be a serious lack of QA — Test Case Management (TCM) tools. The company that I'm working for needs a good test case manager. Currently JIRA is the tool of choice for other aspects of project management. I'm not asking to jump ship from JIRA, but the Atlassian TCM "Zephyr" has several problems, some of the key ones include: It does not have (any) matrix capabilities, no test case suite capabilities, if you change one test case (including assignments) the system changes all of the runs from that test case, the integration between the defect tracker and the TCM is archaic (at best), the number of actions to pass/fail a step (or test case) are annoying (way to many). Whoever designed it doesn't use it. If you watch the "Introduction" for Zephyr – it is amusing to see how the person performing he demo skips over and fumbles when dealing with the flaws I've mentioned above.
I have used the product "TestLog" which is a well-thought-out product; has test matrix capabilities (and other good features); however it does not have any integration with JIRA. (Hint, hint: Atlassian, this is what you need!).
Is there any company that makes a "plug-in" for JIRA with a similar features to TestLog – test case management that is well thought out, not just an afterthought?
I have used the product "TestLog" which is a well-thought-out product; has test matrix capabilities (and other good features); however it does not have any integration with JIRA. (Hint, hint: Atlassian, this is what you need!).
Is there any company that makes a "plug-in" for JIRA with a similar features to TestLog – test case management that is well thought out, not just an afterthought?
Enterprise Tester (Score:5, Informative)
The last few places I've worked that use Jira for have used Enterprise Tester. Seems to do an okay job for the QA people.
http://catchsoftware.com/testi... [catchsoftware.com]
Re: (Score:1)
In what way is my post a "troll"?
Re: (Score:1)
Ah, troll mods roaming freely. Think nothing of it.
Re: (Score:2)
To paraphrase Ford Prefect, "Always know where your towel is and don't panic!" http://en.wikipedia.org/wiki/T... [wikipedia.org]
~~
Re: (Score:2)
you don get it. of course there are bugs. the aim is not a defect free system, but to avoid a total catastrophe in a system built and maintained by waves of replaceable monkeys. it's already remarkable that it works at all, but yes, this is the industry average. shrug.
Re: (Score:2)
Building systems by monkeys that require even armies of even lower IQ QAs is more expensive than doing it correctly in the first place, with real developers who have done it before, and have supported real products and services.
only if you can trust those developers to be available and loyal. for years. industry has a VERY hard time promoting loyalty, and panics at the sole idea of losing control. hence 'replaceable' professionals are the way to go.
it is also much easier to foster loyalty with a few key people who doesn't know jack shit about much anything (so they'll have a hard time finding an equivalent opportunity) than with a lot of developers who are in high demand in the industry.
The companies who wanted to lower costs didn't get it. Tough.
The rest of you have devalued technology jobs, and have created such a shit show it's hard to know where to start unpicking your poor planning and poor processes whilst we have deliveries in flight.
"Thanks"
don't get mad at me, you're totally right, b
Re: (Score:2)
The test cases support the latter and help to prevent future devs from blaming you for causing bugs (assuming they at least run the tests).
FTFY.
Make your own (Score:3, Informative)
Okay, Testlog looks like an awful proprietary Windows-native tool. But if you can find a TCM with your required feature set and a documented API, it shouldn't be too big of a deal to make an own Jira plugin that interacts with that hypothetical TCM.
Maybe Testrail has those features?
Re: (Score:1)
It might be proprietary and Windows-only, but a single license costs US$ 99, I doubt that this money (or even the money for a dozen of licenses) would cover the costs associated with developing a custom in-house tool.
Re: (Score:1)
I'm not talking about a whole tool, "just" an interface. Still, it'll be more than 99, definitely.
Parsing error (Score:3)
I have been testing TFS and got a parsing error at "(way to many)".
how about (Score:2, Offtopic)
EPAM Test Case Management plugin (Score:2)
Re: (Score:2)
TestRail (Score:4, Interesting)
We use TestRail (http://www.gurock.com/testrail/) with much success. It integrates with Jira (or not, up to you) and has a very simple and intuitive interface. I am a former Zephyr user and that experience is, in part, why I ended up with Testrail. I'm surprised it hasn't been mentioned yet.
Good luck.
Re: (Score:2)
Just a question on Jira stability (Score:2)
After a long break in research I've been doing client work again. This client is pretty big, a small European airline company. For some reason they have a lot of trouble getting the Jira suite of products to run stable. Stash is offline complete afternoons. I find this quite bizarre. But is this really the Jira software, or does it have to do with the client's sysadmin team?
Re: (Score:3)
We use JIRA at Apache for all the Apache projects. I wouldn't say it's the best software in the world, but it is better than most of the other ones I've personally used. They don't seem to have the stability issues you listed . Some of my direct clients use JIRA as well, and they have never mentioned stability issues with it either...
Re: (Score:1)
First off, it's not a either the software or the sysadmins. Lots of things can break in between, I suppose that's especially true when there are strict processes in place, as I imagine the workings of an airline company.
That said, I've worked with Atlassian products (lots of Jira, Confluence, and Fisheye, but only a little Stash), and while I'm not a big fan (I find them bloated), I can't complain about their stability. Our admin team wasn't especially large, one could say understaffed, so I doubt they coul
Re: (Score:2)
Re: (Score:2)
Not my experience with their wiki where searching and markups are a joke. Stash seems to work better but I would really like to ditch their wiki.
Re: (Score:2)
I've found Atlassian's products to be great, but the latency when used from Europe (at least Norway) is so bad that there is just no way for us to use it :-( It's not always slow, but at least for some hours of the day we're talking 4-20 seconds before a page refreshes. We have a confluence site up that nobody uses just because of this issue. I know we could host it ourselves, but I have neither the resources nor the patience (Jira seems to need a lot of tlc to keep running).
Here in the UK we don't have that same problem using their hosted JIRA, so probably this is local issue to you guys in Norway.
Re: (Score:1)
We use JIRA and Confluence OnDemand and Stash on-premise (to replace their subversion hosting we initially used).
We evaluated gitlab before deciding to go with Stash - based largely on JIRA reputation.
I found stash to need way more memory than they claimed was needed
I think the VM is configured for 16GB - it was 2GB initially.
We are using the built in database - primarily because I can't be bothered to worry about getting a real one setup.
Our main repository is about 800MB - ~8000 commits
Re: (Score:2)
We use JIRA & Confluence. I'd say they were pretty stable normally, but upgrades seem to have problems more often than I'd expect, particularly when you have a bunch of plugins installed.
Re: (Score:2)
Re: (Score:1)
I have had to run Atlassian products a few places. They're much better than some of the more proprietary packages on the market. The only problems I ever had were due to running on windows virtual machines, and an overtaxed db server. Pretty much all their stuff runs much better on real hardware, running Linux.
TestTrack TCM (Score:3)
I understand that TestTrack TCM [seapine.com] has been integrated with JIRA at some shops.
Full disclosure: I work on this product.
ReqTest (Score:1)
Try ReqTest. As a developer I mostly use their bug tracker, but their test management seem competent and it has Jira integration.
RMsis (Score:3)
We use RMsis [optimizory.com]; it's not the slickest interface in the whole world but it does everything we (medium size engineering company) want to do so far.
The people who support it are very good, and seem to be very amenable to requests for features and support.
YouTrack FTW.. (Score:2)
We switched a couple years ago to YouTrack from JIRA and have been quite happy with it. JIRA is a load of shit.
Re: (Score:1)
As someone who's had to support Jira at the backend, YouTrack looks a LOT more mature purely from the upgrade procedure on their website.
The Jira upgrade is generally a multipage spaghetti process which I have never seen someone get right the first time, and these are smart people who operate complex systems on a regular basis...
I just can't get my head around the prices (Score:1)
We use standalone Zephyr in conjunction with JIRA, Confluence (both hosted OnDemand) and Stash.
What I can't work out is the justification for their pricing.
I pay Atlasssian about $10 per user per month.
Zephyr wants $80 per user per month, others mentioned are $25 per user per month.
Is test management really worth 5-10times as much as I pay for bug and content management ? Or 1000 times as much as I pay for source code and code review ? (Stash is $10 for a year for 10 users)
No.
So we continue to use the Commu
Would be nice... (Score:2)
...if this Slashvertisement would tell us what the hell JIRA is!
Re: (Score:2)
Just go kill yourself. You'll feel better.
Re: (Score:2)
"They suffer from the fact that the test case itself may not catch all possible fault conditions of a function."
If we could determine all possible fault states of a function we could write flawless code.
"opened on bug trackers by automated QA being closed by project manager who aggressively push for WONTFIX and NOTABUG"
This is a personnel issue. I've been there and aggressively pushed for fixes. If I find the same bug closed and then it is logged as a new bug I make sure the earlier bug is reopened and the
Test Cases == Waste (Score:2)
While I do advocate some Scenario based testing, which usually are a single line like "Can you place an
Re: (Score:2)
How do you feel about Behave, Spock, Cucumber, and Thucydides? My experience is that they work well with behavior driven testing. We are testing both APIs and integrating with Selenium using these tool sets.
My major gripe with automated testing is that it is just regression testing. It does not give you new information. Automation and exploratory testing are often at odds with each other. And management wants pretty reports and test case numbers and so carve out little time for exploratory testing.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
But Agile doesn't need QA (Score:2)
Didn't you get the memo?
Re: (Score:2)
Klaros-Testmanagement (Score:1)