We performed a comparison between Appium and SmartBear TestComplete based on real PeerSpot user reviews.
Find out in this report how the two Regression Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."We develop apps using the React Native framework, and Appium integrates well for testing those apps. The Appium automation framework also has good integration with GitHub Actions and plenty of other tools and frameworks, including BrowserStack."
"The latest versions of the solution are stable."
"The most valuable features of Appium are the in-built functionality, which we can use in our code. For example, move back, move front, navigate one page before, and navigate one page ahead. You can do this by using the in-built functions from Appium."
"I haven't explored other solutions in this particular area, but what I like best about Appium is the fact that it shares functions with Selenium. The extension of Selenium functions allows me to use all of the methods that exist in that domain, and it just makes it simpler for me. I've been using Selenium for some time as well, so using Appium just seems like a natural fit for me."
"The solution is stable."
"Appium helps me to do as much as much as I want to."
"The most valuable feature is that it's easy to launch applications. Appium has everything that Selenium has. So many good tools support Appium. We can take some Excel sheets and use them to fill out the text box that's in there. We can also take screenshots of failures."
"It's an open-source solution with a very large community and available documentation."
"TestComplete is simple, it's a very easy-to-use tool."
"I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers."
"It allows us to test both desktop and web applications."
"The solution is great as a record and playback tool. It also has valuable regression testing."
"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."
"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
"The solution has a very nice interface."
"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
"Appium could improve by enabling record and run techniques similar to what they have in other licensing tools, such as Micro Focus. We have to all write the code, and then we can proceed."
"I rarely use Appium nowadays because I'm now at the managerial level, but the last time I used it, whenever I selected and clicked on an element, Appium was very slow. I tried to debug it, but I still couldn't find the problem, so this is an area for improvement in the solution. Another area for improvement lies with the connector and server. For example, the effort to get into the local machine sometimes causes the emulator to become slow, which then leads to failure in testing, and this is the usual issue I've encountered from Appium. An additional feature I'd like added to Appium in its next release is being able to do automation in iOS without using XPath and the name of the element. In Xcode, you can use previous UI tests for detecting elements, but in Appium, you have to use Xpath and the element name instead of being able to directly put the X-UiPath, which is what you can do in Xcode. In iOS as well, sometimes the element doesn't have a name or a path. Sometimes, there's also no element."
"Image recognition could be improved. We have some images in our mobile applications. It should be able to run from the cloud, so we can automate the catcher."
"Configuration-wise, there is a lot of room for improvement."
"An application developed on the Unity platform, such as a gaming application, objects are moving in that case. Interacting with those elements is still lacking in Appium. Appium doesn't have the internal library to play with the Unity platform. That is a huge lack right now."
"We previously worked with native applications, and there weren't any good mobile app testing tools. We started working with React Native, which works well with Appium, but it would be good to see better integration; the way elements are displayed can be messy. React Native is very popular nowadays, so it's essential to have that compatibility."
"We need some bug fixes for nested elements."
"The challenging part with Appium is that installation can be a bit tricky. It can be challenging to set up in Android versus iOS environments."
"The solution needs more training manuals or some form of online forum for learning. It needs more documentation."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"Headless testing would be a big improvement."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"The licensing costs are a little bit high and should be reduced."
"Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
Appium is ranked 5th in Regression Testing Tools with 25 reviews while SmartBear TestComplete is ranked 6th in Regression Testing Tools with 71 reviews. Appium is rated 8.0, while SmartBear TestComplete is rated 7.6. The top reviewer of Appium writes "It's easy to launch applications". On the other hand, the top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". Appium is most compared with Tricentis Tosca, Katalon Studio, Perfecto, Xamarin Platform and Eggplant Performance, whereas SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and LEAPWORK. See our Appium vs. SmartBear TestComplete report.
See our list of best Regression Testing Tools vendors.
We monitor all Regression Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.