Another success with Katalon Studio

Previously I made mentioned that we migrated from one web platform to another and Katalon was instrumental in running hundreds of tests to ferret out where we had data or code issues.

Right on the heels of that migration, we needed to do an a framework upgrade. In essence we had to run the same validation tests again to confirm we didn’t have any code or data issues.

The test suite has grown and includes several new tests, but still takes less than 10 minutes to run. Plus, when using the data driven test case I discussed earlier, this can be run for dozens of passes, one after the other, and we just check the Reports folder to see if there were any problems.

At the customer site, their QA resource wanted a minimum of a week to confirm the framework upgrade. I have to admit, my jaw dropped. I didn’t understand why it would take so long to go through a dozen or so passes with a mixture of users.

Then it dawned on me. He needs to validate the site manually as they aren’t using any automated methods. He needs to click each page, fill in the forms, drill down through each subpage and confirm everything loads and is visible. He then needs to compare data on one page to the information on another and calculate the totals of multiple columns.

Based on other commitments, that may only be 1 or 2 validation passes per day. In order to feel comfortable, they would need to confirm at least a dozen, and the more the better. The time quickly adds up and a week might only get the bare minimum done.

With the help of Katalon and what we have in place, I can perform a dozen validations per day, while I work on other projects. The tasks can be run in the background, on another screen or even headless and I just have to check the reports.

Since I’ve run these tests dozens of times already, I know what the reports should look like, so I can easily pick out any anomalies.

We are continually developing and refining our tests, but the time investment is paying off with multiple hours saved per validation pass. At our current rate, we only need a couple of hours to validate 90% of the site. That last 10% is for validating against source data. But since so much time is saved up front, even with that manual 10%, we can do all our validation and be confident in what we deliver within a day.

Plus, our development time is getting shorter each iteration as the code gets better and tighter and common routines get grouped together. Katalon is making some serious strides for us and to be honest, I feel we’ve only scratched the surface. I’m very excited over what we will have in place 6 months from now.

Other articles of interest:

One Response to Another success with Katalon Studio

  • Mahesh Joshi says:

    Hi Don, I just started following your blog in regards to katalon.

    I want to introduce katalon studio at my work we do manual testing at work at the moment.

    What approach I should use for proof of concept with katalon for work. do you have sample test cases you can share?

    Regards,
    Mahesh

Leave a Reply

Your email address will not be published. Required fields are marked *

Recent Comments
  • How To Disable the Quicken Registration Prompt (18)
    • Susan Long: I have Quicken personal 2012 which I only use to enter and retrieve data. It suits my needs perfect. Now they have blocked my access and want me to re register. I don’t want to upgrade as it I am comfortable with this...
    • Stewart: I have been using Quicken 200 basic since it was introduced but I now have a new PC using windows 10 and can’t get rid of the registration prompt. I have tried the above control/shift trick but to no avail. Any ideas
    • Dave: Works for Quicken 2007 too. Thanks, Gina!
    • Charlie Fellenbaum: Yay, thanks, and that worked for Quicken 2006 as well.
    • Ken: This didn’t work for me. I have 2006. I installed on a new laptop. I must have registered before, don’t remember. I tried to register this time, but got an error message. I’d rather not registered, though. I use...
    • Neil Murphy: I discovered that early on. I’m using 2001.
  • Conditional Statements – IF .. ELSE IF in Katalon Studio (1)
    • Allyson: I used this : elementVisible=WebUI.verifyEle mentPresent… but it failed because “FAILED because (of) Unable to verify object ‘Object Repository/Homepage/b_vaolopho c’ is present (Root cause:...
  • Quasi Performance/Load Testing with Katalon Studio (1)
    • Anthony: I have done this with 100 plus machines at the same time and it worked well and provided some useful feedback.
  • A Try Catch example in Katalon Studio (3)
    • Venkatesh: Hi Don Pedro Can you share me sample project ….which consist of basic to advanced stuff…If your github or gitlab url aso present please share… As I am beginer to this I need to learn lot
    • Don Pedro: Hi Lucas. Thank you for the kind comments. I would be happy to help. Let me know how I could be of assistance.
    • Lucas: Thanks for sharing a lot of Katalon tips and tricks. The Katalon team highly appreciate your support and feedback. To make Katalon Studio better and be the best free automation solution for testing community, we wish to coordinate...
  • Securely storing passwords and login details with Set Encrypted Text in Katalon Studio (1)
    • Agus: Hi Don, Is there a way to set the encrypted text to be used in the ‘WebUI.authenticate̵ 7; method? Basically I am trying to encrypt the password that is passed to the ‘WebUI.authenticate̵ 7; method. Thank you.
  • Katalon Studio – Manual View – The start of a test script (2)
    • ben: Hello Don Great Website. Keep up the work. I learnt a lot. cheers Ben.
  • Another success with Katalon Studio (1)
    • Mahesh Joshi: Hi Don, I just started following your blog in regards to katalon. I want to introduce katalon studio at my work we do manual testing at work at the moment. What approach I should use for proof of concept with katalon for...
  • What went wrong with Crime City? (34)
    • G D: One thing I have noticed is the awkwardness of items and the attack points and how you can earn them. I was pretty pathetic with attack points and then I played that limited time boss and got weapons that had attack points in the...