Katalon Studio reviews

Amazing product for collaborative API Testing

Pluspunten:

Team Collaboration, Test Management, Code snippets functionality.

Minpunten:

UI could be improved to have less clutter and Test Verification tab should have facility to open in side window for easy code writing.

Automation Tools that makes newby Automation Engineer can play around like a pro

Opmerkingen: its very easy tools to use especially if you don't have any experience with automation tool. Pretty easy to install and configure so junior team can easily install and create automation for your service (web,api, and mobile). Basically if you are newby once you try this tools your manager or other peers can see you like a pro.

Pluspunten:

- Easy to use because it has feature record and play so no need coding skill to use their feature - Good user interface - No need to worry about web driver like other automation tools - Katalon has feature to support Web , Mobile, API automation testing - It has feature to support Continuous Integration testing tools - It has ability to handle cross browser testing

Minpunten:

- Its use pretty big memory so some times its impact to performance issue (like crash or slow) when run many scenario - only Katalon 7+ version licensed owner, that able to use debugging feature - its limited to Java and Groovy

Not very much compatible with Salesforce

Opmerkingen: I would say average for initial config its good but for overall complicated scenarios its not

Pluspunten:

the ease of use - its very user friendly

Minpunten:

It is not very useful in case of shadow dom's

Front end web testing, with ease

Opmerkingen: We have to deploy software to numerous systems, numerous times per month. Katalon offers the flexibility to run some basic sanity checks to ensure our deployments were successful, without a ton of manual testing hours to verfiy.

Pluspunten:

Learning curve is relatively quick and easy to get going with your first few basic tests. There is also a lot of documentation out there if you get stuck on something.

Minpunten:

The design is horrible. It feels like interacting with an app built in the early 2000s. BUT, it works well.

Makes life easy

Opmerkingen: We have managed to fill in the gaps that Postman has left wide open in being able to share reports with teammates, using BDD/Cucumber in API testing, and being able to integrate with Jira. To be able to produce anything similar with postman would require tons of custom Node.js which would be difficult to use for our less technical team members.

Pluspunten:

What I like about this software is the fact that I can perform API, Web UI, and Mobile Applications testing all in one suite. I like the fact that the software is based on Eclipse, Java, and Selenium, and comes with all the drivers ready to go. It makes life easier for me who have to deal with a lot of the more technical components, but allows others on our team, who aren't as technical, drag and drop my scripts using the UI provided. I like the fact that the software encourages the Page Object Model and also makes Cucumber much easier.

Minpunten:

You guys are making improvements on your reporting tool, but it used to be a major headache. Other than that, no major headaches.

Good tool for API Automation but not so good for mobile UI

Opmerkingen: API Automation - It is good
UI Automation - Not good

Pluspunten:

Well organized and easy to use. For APIs its straight forward

Minpunten:

Mobile UI automation is quite tough to setup. Android automation, once we make a script using the a particular mobile using the recorder, we were not able to use it on another model phone. When recording, the ids which the Katalon Studio is creating were changing for the next phone and hence it is not recognizing the on other phones. On the Iphone UI automation, most of the Iphones are not getting recognized. We spent 2 months on doing research and it is pretty inconsistent. Finally we moved just to Appium and manually create the scripts which is the reliable solution from years.

Good option for automation

Opmerkingen: Despite I've had to deal with many issues using Katalon Studio, I think it is a great tool with a lot of potentials that need to mature. That's why I bet for Katalon Studio instead of other tools like ReadyAPI.

Pluspunten:

1- that you can use cucumber scripts along with groovy for automating test cases 2- Katalon Analytics is great

Minpunten:

1- you can not open more than one project at a time 2- it's very heavy, it consumes a lot of resources. I think it could be improved in terms of RAM and CPU management. 3- katalon analytics needs more improvement, there are some issues in the UI. 4- the logging motor can be better, right now is very unusual if you run multiple test suites at a time with suite collection and try to watch the logs for each and every test suite, you get lost and it's hard to know even when it finished executing. 5- The Katalon Studio UI (at least mac version) it's complicated to use when you create a Request, it's hard to define the variables and params since the components used are very archaic, some time you think you save (according to the common behavior in most of the tool) but you actually dont and lost all changes. That can be improved. 6- The way Katalon manage the project files etc. it's very complicated to deal with those non-sense files (for end user) and the repos, it generates a lot of conflicts everytime.

User Friendly software for Automated testing

Opmerkingen: My overall experience is that I could easily begin using the software without training (as a non-developer). I like that it records every step that is taken while navigating throughout an app to create the test scenarios. It makes for the perfect regression testing after a deployment, and before sharing with the client.

Pluspunten:

Katalon is user friendly, even for a non-developer. It records the steps within an app to create the test scenarios with ease. You could also manually write the test scenarios, step by step.

Minpunten:

The only con with the software is resolving issues sometimes requires a developer to help fix the test case.

Katalon Studio for Automation

Pluspunten:

It's automation capability. Integration with Jenkins and support for CI CD

Minpunten:

High Price Lack of support for Linux Object spy is not that great and helpful

Powerful, cost-free automation test tool

Opmerkingen: Easy test case management and ease of running UI based test cases using recording

Pluspunten:

IDE Ease of Use Easy to install Good documentation Easy Scripting

Minpunten:

Not a large community Did not have a large user community compared to other instruments like Selenium or Robot Framework. The method of support is sometimes slow.

Ultimate tool for automated and overall testing.

Opmerkingen: I found it really good as it even provides screenshots where the error occurs and has helped our firm to create the whole process easily testable through katalon .

Pluspunten:

The browser/desktop recording helps to automatically record scripts and helps a lot in saving time to create automation scripts, plus it helps in parallel execution to save time.

Minpunten:

It can't handle the load of a large number of test cases under one suite and consumes a lot of time. Rest functionality is good.

Katalon - sweet spot for GUI automation

Opmerkingen: We are using Katalon Studio for GUI automation. The tests run quickly, and are heavily customizable past Katalon's own Web UI functions.

Pluspunten:

Katalon is easily one of the best open source software tools for GUI automation testing. Its intuitive interface requires a minimal learning curve and with the official documentation online, someone with zero testing/coding experience can write a comprehensive test. Test suites and collections allow enterprise level testing by allowing users to run numerous tests in series or parallel in different browser configurations. If you have some experience as a programmer, Katalon's modularity allows it to be extremely flexible. Programmers can write robust keywords (functions) and classes, that can extend testing functionality. The Cucumber integration makes it easy to write BDD tests. Katalon also allows you to import .jar files to extend functionality making the program even more robust. Katalon also runs its tests quickly and provides users to run tests through command line allowing for Jenkins integration which is necessary for enterprise level testing.

Minpunten:

Katalon is an excellent software, but it is not without its bugs. For convenience I will list them: - Biggest issue is documentation. There is some great official documentation for Katalon, but there is also a lack of basic API documentation. I had to go to a Katalon forum to figure out about object parameterization. Why are the Web UI functions not explicitly documented? The links to the docs I've seen online are all dead. - Issues with building project path/classes: sometimes if you try to write classes and use them in other classes (OOP) Katalon will not recognize the class and you have to restart the program for a clean build. This was most prominent in how the Cucumber tests have to be structured. Feature files and step definitions have to be in specific locations, and there is not really any official documentation for this. - Git integration: While Katalon does come with Git integration, integration is limited to a project scope. If you clone a project through Katalon's interface, it treats the entire repository as a project which is kind of annoying. - Reports: It seems strange that Katalon offers so much flexibility but then doesn't allow users to customize their reports and build them as they see fit. - Object repository: There should be a way to import test objects/have a shared object repository between projects. Can you just put all your tests under one project? Yes, but it doesn't always make sense to do so and can lead to a cluttered project.

Katalon Studio, great tool to get introduced to Testing Automation, as well experienced users

Opmerkingen: We had very little test automation in place, and actually was using as an intern till the "purchased" product was up to speed. It surpassed my expectations the more I used it. Very reliable, easy to maintain and update. Was able to build out a decent library of smaller reusable modules, that have greatly decreased the time it takes to create new testcases. It took the frustration out of tool itself, making it enjoyable to work in.

Pluspunten:

Very fast to get up and running. Fits a variety level of users, flexible enough to allow advanced users to pretty much setup how they please at the same time enough of all the base needs for the new user. With it being free product, they update it regularly and are very attentive to user requests. Their application is actually fun to use. The setup and options are intuitive. Not hard to figure out how to do and implement even more complex, complicated operations with custom code. Very portable. The install being as isolated from the code, can easily install on another machine, and open project and be running tests, no special build, or install requirements to do this as I've seen in other tools.

Minpunten:

Not a fan of the Object Repository handling, doesn't do well of detecting dupes, can get quick messy if user of the object spy. The code repository integration is basic, the interface to it not very robust. Its scripting language is Groovy, which is not as popular as others.

Feedback and Experience by user

Opmerkingen: Finally, this tool is more comfortable to people who will like to handle it with single tool.

Pluspunten:

The tool is suitable to all people who will know and don't know the code, framework, error handle, data driven and deployment.

Minpunten:

1. I have faced some issue on sometime, like not able to call the method from keyword to test case. 2. Request to Katalon team to provide more reference.

Good tool for Functional and Automation testers.

Opmerkingen: I am very happy for UI and API automation testing. UI supports with all browsers option is good.

Pluspunten:

I liked Record and Playback feature. Sauce labs, chrome and Firefox execution. API execution is also very good and easy to implement for functional Testers. Predefined Git options are very good.

Minpunten:

Debug feature is complicated. Identify elements for desktop applications feature is not good using UISpy.

Good product and great alternative

Opmerkingen: Overall the tool has many good functions and capabilities. Pros, outweigh cons in a major way.
Pricing structure and support is excellent.

Pluspunten:

Somewhat easy to get started (see cons), Git integration, beginner and expert modes. Ability to export and continue with other IDEs if desired to go outside of the tool (not locked in to it forever). Plenty of information on the web to troubleshoot and ask questions (unlike our previous tool). May frequent updates and feature releases.

Minpunten:

A little cumbersome to setup all the needed plugins. Until everything is configured just right, you will run in to errors here and there that take time to troubleshoot. Test case navigation/folder structure could use a few more options and customization capabilities to be able to sort things better. Automatic centralized location for code and test case storage (similar to ALM) would be great. Having to commit and pull code each time from different stations is cumbersome. To schedule remote execution you must make sure the machine pulled latest code which is an issue if execution and development PCs are different.

plug n play automation software with many built in keywords

Opmerkingen: We adopted the tool after I highly spoke of it to higher management as they trust me as our main testing tool on the current project I'm working on. Had a very small learning curve and create custom keywords and scripts to be reused and acting as lego blocks in many tests. Cucumber is documenting all our scenarios.

Pluspunten:

It allow to somebody with no or little coding knowledge to get started in test automation with its intuituous interface and built in keywords. Also, with all the integration with various platforms and technologies make it a very easy to integrate tool in the day to day work environment.

Minpunten:

Some glitches still exist in some fields such as soap api calls where not all endpoints are loaded correctly and some improvemetns could be done in order to completely replace soap ui usage in my case. Also the cucumber integration doesn't seem to have all the solution's benefits working correctly such as tags and others that could be added. Finally the Database that is internal could allow to clone, copy, delete or manipulate data easily even the search is not there to make a query for instance.

Didn't see a tool that provides more flexible features like Katalon

Opmerkingen: Well with katalon. really loved it

Pluspunten:

1. Integrations with GIT, Bitbucket, Slack 2. Data binding 3. variable binding 4. Execution settings 5. Compatible with other languages even though it is running using groovy 6. Profiles 7. Data files

Minpunten:

1. Better to have options to connect multiple databases with windows auth mode 2. Execution reports in katalonanalytics seem not running properly 3. API automation report doesn't have the flexibility to trace the issues easily we need to do many clicks

My go-to app for Test automation for the web

Opmerkingen: being allergic to super-coding, I find Katalon studio friendly to QAs and data encoders, but can also be flexible enough to support other extensions or code snippets from other libraries.

Pluspunten:

Overall, the experience with record-play-customize code-replay has is reminiscent of its more expensive counterpart/s. But overall it's better than the other automation tools i used so far. online help and resources are bountiful. Object repository, test collection, input data files are some of my favorite places to work around with. there are other features which i havent explored yet, like mobile and API automation.

Minpunten:

There are certain customizations that i need with the software which are not yet supported (like full-page web screenshot and data file output), so our team is left to the care of old-school programming gurus on the web. the features that i miss is not a deal-breaker though, work arounds are fine by me for now.

Growing Tool in Test Automation

Opmerkingen: Katalon Studio as a Test Automation Tool satisfies the need of the Regression testing and is continuously improving as a Tool that gives a chance to Automate everything.

Pluspunten:

- Katalon Studio is easy to script - Support multiple platforms(WEB UI, Mobile, API) - Supports multiple Integrations for Reporting and Tracking

Minpunten:

- Newer versions have browser upgrade issue as each time we have to upgrade the browser for smooth execution. Most of the time it does not upgrade in one go.

Suhan - katalon Review

Opmerkingen: easy to handle and understand the product feature

Pluspunten:

easy to handle and understand the product feature

Minpunten:

Nothing like that; looks i have all the feature looking for till date

Katalon Studio is very good for automation testers and it develops a better-inbuilt framework

Opmerkingen: overall katalon is good for tester who don't have much programing knowledge

Pluspunten:

Katalon Studio is very good for automation testers and it develops a better-inbuilt framework easy to deploy code to git

Minpunten:

it won't handle drag and drop Functionality efficiently and upload image functionality also not good and select value from drop down also not handled properly

I still can't believe it's free

Pluspunten:

It's packed with features, which comes in handy when you want to perform many tasks with one single tool. Getting started is easy, even for beginners; I have a few years of experience in automation with pure scripting and transitioning to a UI based tool was like going from riding a horse to driving a sports car. SpyWeb is incredibly useful, I even prefer it to the recorder, which may seem faster at first, but in my experience it's been far more efective; selecting the right locator immediately after capturing the TestObject really saves time. Databinding in test suites is a blessing, very easy to use and drive tests from this data.

Minpunten:

The UI is a bit clunky, not very intuitive, and I guess the word is "overpopulated". There are many options, buttons, dropdowns, popups, which can be confusing. The learning process is fast at first, but when you are forced to use extended keywords, conditionals, method calling, the tool becomes a nightmare for beginner/intermediate users. I usually just write methods in script view, but many users have no experience in coding and really struggle with the UI assembly of methods or binary statements. Debugging is somewhat confusing as well, but that's not so important in my opinion. The application takes way too long to *start* running tests as the size of them increases (the execution is really fast though).

Katalon Studio - Free, Easy to Use, Best UI for Web, Mobile and API automation

Pluspunten:

Easy to setup Easy to use UI - Objecy Spy, Recorder, Keyword and Script view, debugging, Integration with GIT etc.., Easy to learn - Built in keywords, framework, simple external data integration, record and play back Advanced Capabilities - Multi browser, parallel execution, command line execution, record / spy mobile applications, API etc..,

Minpunten:

Newer version of Katalon Studio has moved some of the free features to paid (ex. Jira integration) Capturing objects, scripting and execution time on mobile apps must be improved Multilevel API calls are not efficient compared to tools like SoapUI, Postman etc.. Report cannot be customized Desktop app automation not available

app for developer

Pluspunten:

this app is very easy to use with tool od developed and you will make automation frameworks in an easy way

Minpunten:

this app is very simple to use to develop your tools and make structured framework