First automation pass complete

The first pass of automation for the site is now complete. At this juncture I have been able to make framework tests for the major pieces of functionality. They are still somewhat hardcoded, and not every part of the site has automation, but the bulk of the work is complete.

The objects have been created, and there is working code to verify functionality. For example, data can be entered into forms and that information can be verified in the table of results. This has been repeated across multiple pages.

There are currently 21 tests, which is a rate of 1 test case completed per day since I started. They are quite straightforward, but perform the same actions I would take if verifying the pages manually. The goal was to get the automation up and running and build out the objects I am most interested in.

And for that reason, several pages have been ignored at this point. They are either too unpredictable in the information they contain, aren't used heavily in Production, or the amount of work to create a test exceeds the time it would take to test that portion manually. If something takes me 5-10 minutes to test by hand, and I only check it once a month, it's not worth doing yet. There are better time investments to make.

The next phase of the operation is to add error checking and make tests more dynamic. At this point I have added the code to count rows in a table, as well as to check for the existence of the table. Both of these will be used so the code can adjust to the found results.

Additionally, execution profiles will be created so values can be changed from a central location.

From there, additional code will be added to improve site navigation and timing mechanisms added so they can all be strung together. There will also be components to reset search criteria if needed.

The next phase will take about two weeks, probably less, depending on how busy I am with manual testing. By the end of May, the tests will be able to be run against Production for an after deployment smoke test, and within QA on a regular basis for functional testing.

It will also be during the functional testing where additional code will be added to adjust to corner cases or handle results that comes from larger data sampling. This is also when additional test ideas come to mind.

While these are not the most complex of tests, I feel the progress has been very good. It has gone from zero coverage, to more than 60%. But that 60% coverage accounts for 80%+ of where users spend their time.

Other articles of interest:

Leave a Reply

Your email address will not be published. Required fields are marked *

Recent Comments
  • How To Disable the Quicken Registration Prompt (30)
    • David: A BIG Thank you! I regularly reinstall Windows OS’s using different hardware configs. In short, Quicken 2011 (it’s March of 2020 as I write this) has been a program I’ve been very happy with and continue to use....
    • Karen L: Today I rang Reckon Australia again, got a different guy and he talked me through the process of getting me a new product key to enter since I already had the licence and it had been extended. Reckon have only extended it by 1...
    • Karen L: I have Australian Quicken 2008 on Windows 8.1. It keeps asking me to renew my licence which Reckon did for me however the activation won’t work. I tried this to disable the registration prompt however it did not stop the...
  • Parsing Strings in Katalon – Split, Substring and Readlines (6)
    • Don Pedro: String tempText=”Date Month January. Revenue $1,355,721.00″ println(tempText.split(“ \$”)[1]) You need to escape the $ with \$ The [1] on the split captures characters on the right of the split [0]...
    • Prasad: Hi, I need to get the substring from the below string ‘Date Month January. Revenue $1,355,721.00’ I want to extract text after $ value. Please help Thank you
  • Working with Dates and Date Formatting in Katalon Studio (15)
    • Sangeethaa: How to get previous day’s date(Yesterday’s date)? Actually I was using today.previous() before,it was working fine till today morning.Now its not retrieving right date. Can anyone please guide me on this.
    • Don Pedro: That could be a little tricky. First, is the text/format always going to be the same? You will need to do some parsing. Separate the first but of text at 2019. After that, split the text again to get rid of Central Standard...
    • Don Pedro: It should be of the same Date type as today. You could then do some calendar trickery with Calendar /*Calendar c = Calendar.getInstance(); //c.set(Calendar.MONTH, 1) //Set the month, 0=January, 11=December println...
    • josh: I’m testing a page with a string like “Updated November 21, 2019 16:25:32 PM Central Standard Time.” How might I capture the date and time and compare it to current time to verify that the update time was within...
    • zakir hussain: today = new Date() lastWeek = (today – 1.week) can u please help me in understanding what is the return type of lastweek? and I wanted to set nextyear date how can i do it
  • Output status messages and test information by writing to the Log File Viewer in Katalon Studio (6)
    • Saranya: Good One. Could you plz share link to access all your katalon related blogs. ThankQ
    • Rodrigo Calabretta: I’m using the KeywordUtil.markFailed or KeywordUtil.markError and my test stops is being shown as Error and If I use in the @afterTestCase the testCaseContext.getTestCaseSta tus() to show the status test case...
  • Setting up Environment Profiles in Katalon Studio (2)
    • Don Pedro: Not quite sure I understand. The term “Execution Profile” is normally used now, but they are still GlobalVariables and are created in the same way for version 7 as previous. You make a new execution profile, then...
  • Here is my drive cluster (2)
    • Don Pedro: While I still have those drives, the drive cluster looks nothing like that now. Almost all of my external drives have had the cases removed and they have been installed into a series of MediaSonic 8 Bay Drive Enclosures. I...
    • Marin Boucher: Hi! Verry funny blog with “go to the point” on many post! I spent good time reading some of your post. Regarding this one about NAS, “many NAS” in fact, I would be curious to see a screenshot of...