Perfecto Room for Improvement

Roland Castelino - PeerSpot reviewer
QA Lead at BMO Financial

One improvement would be speed of execution. If it is an iOS native app, we have noticed that the speed is a bit slower. Perfecto might need to make some improvements in this area. 

I feel that some of the Perfecto reporting might require upgrades or enhancements to their APIs when pulling some numbers or stats. Perfecto reporting also requires upgrades, mainly from an API point of view.

View full review »
Glenford John - PeerSpot reviewer
Product Manager, Device Integration at a comms service provider with 10,001+ employees

We don't use Perforce's BlazeMeter with Perfecto. From my perspective, it's not really relevant.

View full review »
AG
Project Manager at a financial services firm with 10,001+ employees

I'm hoping that Perfecto will come up with browser testing as well, because it would be easier to access it.

View full review »
Buyer's Guide
Perfecto
March 2024
Learn what your peers think about Perfecto. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,234 professionals have used our research since 2012.
Bharat Malik - PeerSpot reviewer
Senior Automation Engineer at RBC

The monitoring features, in particular network traffic monitoring, could be improved.

View full review »
MB
Manager and Platform Lead, Canadian Digital Banking at BMO

In terms of cross-platform testing, I have used it mostly for the web and it's pretty strong. It's probably an eight out of 10. The reason it's an eight is that we've had a couple of issues lately with videos not loading or browsers dying after some execution, although that happens very rarely. For mobile, from what I have seen, it's probably also an eight out of 10. 

One thing they need to have is physical devices. And I am hoping in the future that there will be more virtual devices.

Also, there is some error tagging that you can do in Perfecto, but it didn't work very well when I was using it. I wish that you could tag it with an error message per test case and it would be done automatically, instead of manually.

In addition, if Perfecto could use AI to say, "Your environment is stable," or "not stable," and give a score on that, that would be really helpful. It could notify us through email. That would help, aside from the failed and passed test cases. It would be something more intelligent. If there were certain tags with certain errors and there were a certain number of them, it could tell us if login was broken in the environment, for example. There's definitely a little bit of room for improvement in terms of AI.

View full review »
Kristina Bogojevska - PeerSpot reviewer
Product Manager at a manufacturing company with 10,001+ employees

If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us.

View full review »
RG
Director, QE Automation & Analytics at a financial services firm with 10,001+ employees

I would like to see the inclusion of machine learning features. If we can have that, it will be a better tool.

On the analytics side, Perfecto is in need of improvement. The product has a cool dashboard, no doubt about that. But that dashboard is limited to visualization and slicing and dicing the numbers, as well as getting the reports in multiple formats. What I would like, beyond that, is if we can have some predictive intelligence capabilities. This includes machine learning and modeling capabilities. I would really like to see that from Perfecto.

As an example, I would like to be able to predict our failure rate in an upcoming release of our software.

The reliability of devices is very good, at perhaps 99.9%. However, sometimes, we find that some devices are offline and not available. I would like them to achieve even closer to 100% reliability. I know that 100% is not achievable but they can still push that number.

The timing of the software is an area that can be improved. For example, there is a new Appium release and Perfecto should be able to get it to us more quickly. They take their own time for internal testing before they roll it out to customers but we would like to use it faster, so it would be helpful if they can increase the speed of that process. It is somewhat related to improving their time to market.

View full review »
Rodrigo Candido Costa - PeerSpot reviewer
Software Quality and Automation Specialist at PRIME CONTROL

Sometimes, when the automated tests sync up or we have to debug remotely, we cannot interact directly with the device. We can interact with the code in the debugging tool, but we cannot directly click on the element on the screen or send other kinds of inputs to the device. This is possible with other tools. 

Also, it would be nice if there were some kind of API to get a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature was automated.

View full review »
AndyBrown - PeerSpot reviewer
Systems Engineer at a financial services firm with 10,001+ employees

I can't really say anything negative about Perfect, but if we talk about feature enhancement, there are a couple of things that I'm working on with our customer support manager. I'm hoping they can support on-premises instances. We have been working on a JIRA integration with Perfecto—and I'm extremely impressed that they have that—but at this time they're not supporting onsite JIRA instances, which is what we have.

I love the idea that the testers will be able to run either their manual or their automation scripts, and that the test report will automatically go into that team's JIRA instance. That will save some time. The testers won't have to extract the report, save it, and bring it over to their JIRA instances. Then, when the scrum master reviews the test results, if there are questions, they have all of the details from the report right there.

One other enhancement that I've already spoken with them about is that they don't support Android for ADA (Americans with Disabilities Act) testing. They mentioned that they're going to try to begin supporting that later this year.

View full review »
VR
Manager at a insurance company with 1,001-5,000 employees

Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making.

View full review »
reviewer1963857 - PeerSpot reviewer
Head of Quality at a comms service provider with 1,001-5,000 employees

There could be some improvements done on the interface. At times, there has been a bit of a struggle when finding things on the interface. A UI revamp would be a better option in future. That UI hasn't changed much in a long time, so I think they could just make it a bit better so that people could find stuff easily and intuitively.

View full review »
Sameer Bakshi - PeerSpot reviewer
Test Specialist at IBM

There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools.

View full review »
Govindaraj Ponnusamy - PeerSpot reviewer
Automation Architect at a tech consulting company with 10,001+ employees

Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us. 

View full review »
FA
Automation Tester at IGM Financial

When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good. For example, if I open up a Google Pixel on my laptop, using Perfecto, just navigating on Google Pixel is quite slow. Improving on that would help us a lot.

View full review »
KC
IT Quality Control at a insurance company with 10,001+ employees

Its performance should be improved. Anything to speed up the user interface would be a great help. On the admin side, it would be useful to be able to filter/sort any page with a list of items and export it to a CSV file.  

In the web testing area, we discovered when you select Windows 10 or 11, the VM is running a version of Windows server that emulates the desktop experience. We would like to have the ability to run on the actual desktop version of Windows 10 and Windows 11.

View full review »
FZ
Associate Software Engineer at a financial services firm with 10,001+ employees

The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well.

View full review »
PY
automation tester at a computer software company with 10,001+ employees

It is slow compared to physical device testing. The interactive speed could be improved. 

And sometimes we have issues with our app not working properly with Perfecto. Even though it is working perfectly on the physical device, in Perfecto we find issues. That is another thing we'd like to see improved. Perfecto support said not to use the instrument option so that you do not face that issue. But unless we use the instrument option we cannot do the inspection. We haven't had this issue with all versions of our apps, only with a few.

View full review »
PM
Automation Consultant at a consultancy with 10,001+ employees

The reporting can be improved due to the scrolling you need to do. We have an option for filtering and generating reports, but we are limited to three months of history. After that, we are no longer able to see the information. If they would maintain the history for a minimum of two years, that would be helpful.

Another issue is that sometimes, when we have to locate a button through physically accessing a mobile app, versus through Perfecto, we feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required.

View full review »
VG
Regional Head Customer Experience at a financial services firm with 10,001+ employees

We have had challenges while using this product.

The main problem has to do with OTP. OTP comes on the SIM but there is no SIM card in the cloud, so it makes it a big challenge for us. It is available in development but because we don't have the OTP API exposed, we don't have it in production.

We have had some issues with performance, which is something that should be improved.

The price of Perfecto Mobile should be lowered.

View full review »
JR
Prin IT Bus Systems Analyst at a healthcare company with 10,001+ employees

We bought this solution because it is supposed to be proficient at both web and mobile testing. It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution. Specifically, if it is a native app then it does really well. But, with a hybrid, or it is a native mobile web app, it seems to be lagging.

View full review »
AZ
Responsible for Test Management at a tech services company with 10,001+ employees

I looked at the solution a year ago. I'm not sure what functionalities were lacking or need improvement, but I do find it to be a good tool.

It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure.

View full review »
it_user510336 - PeerSpot reviewer
Associate - Projects at a tech services company with 10,001+ employees

Ability to use/automate Windows/iOS/Linux environment would be a great feature to add in cloud.

Increasing local deployment of cloud devices/resources worldwide would be even better.

View full review »
it_user173214 - PeerSpot reviewer
Test Lead at a tech services company with 10,001+ employees

In iOS, it needs improvements with some limitations.

View full review »
Buyer's Guide
Perfecto
March 2024
Learn what your peers think about Perfecto. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,234 professionals have used our research since 2012.