We cannot create test cases. Nothing is automatic. The tool hasn’t reduced our testing time. I have to do the manual testing. The version of the solution that I am using does not have the option to integrate with workflows.
For the moment we are looking to automated testing, and there today apparently it is not working well with the application we want to test. So we are using an application on a terminal server and some quirks make it challenging to make automatic testing. It would be nice to be able to test offline. What I mean by that is today most of the time things are in the cloud, but sometimes when we are in factories we do not have network access and we should be able to download a test script into our PCs and do the test offline. Once that is complete we can re-upload it when we again have a network connection.
The setup of Panaya Recorder is a bit complex. Panaya is a SaaS application, but you need to install some components on your computer. You need to set up your computer to allow Panaya Recorder to work. There are five or six things to do each time you install Panaya for any user. If you miss something, Panaya Recorder doesn't work. So, it is complex to install. Its reporting can be better. We cannot create some of the reports with different data. It is a little limited. There is no possibility for us to build specific reports based on specific fields and so on. We can use some templates for reports, but they are in a simple format. We cannot arrange things in the way we want. It has a pretty fine dashboard, which is good, but when you want something specific, you cannot do it. We should be able to share this dashboard with many people, but currently, only testers have access to Panaya. It is not easy to share this dashboard in real-time with a large group of people because they need a license just to see the report, and it can be very expensive. Its licensing should be improved. There should be more license types. There should be an advanced license and a basic license. Some users use Panaya in a very basic way to check defects or reports, but some users will use it in an advanced way. They need to be able to give different types of licenses and also better pricing because it can be expensive. We tried to have some automation with the tool to make some tests with Panaya, but it looks like it takes time to prepare automated scripts. We are still learning how to do this. It is hard to do, and it takes time to create automated tasks. It is not really an easy task. We need to invest a lot of time to build these automated scripts in Panaya. We should use more automation from Panaya.
I think the costs can be improved because replacing the existing solutions with Panaya was actually quite expensive. Especially since it is an open-source product that requires a lot of security control. I would also like the deployment of the custom codes to be handled in the system as well so that you can your build scripts and track all the fast links. So from that perspective, I would want to have the deployment prices being taken care of as well.
They provide options for custom fields or tabs, but customization of workflows would be great. Though, the standard defect workflow management is already great.
We cannot create test cases. Nothing is automatic. The tool hasn’t reduced our testing time. I have to do the manual testing. The version of the solution that I am using does not have the option to integrate with workflows.
For the moment we are looking to automated testing, and there today apparently it is not working well with the application we want to test. So we are using an application on a terminal server and some quirks make it challenging to make automatic testing. It would be nice to be able to test offline. What I mean by that is today most of the time things are in the cloud, but sometimes when we are in factories we do not have network access and we should be able to download a test script into our PCs and do the test offline. Once that is complete we can re-upload it when we again have a network connection.
The setup of Panaya Recorder is a bit complex. Panaya is a SaaS application, but you need to install some components on your computer. You need to set up your computer to allow Panaya Recorder to work. There are five or six things to do each time you install Panaya for any user. If you miss something, Panaya Recorder doesn't work. So, it is complex to install. Its reporting can be better. We cannot create some of the reports with different data. It is a little limited. There is no possibility for us to build specific reports based on specific fields and so on. We can use some templates for reports, but they are in a simple format. We cannot arrange things in the way we want. It has a pretty fine dashboard, which is good, but when you want something specific, you cannot do it. We should be able to share this dashboard with many people, but currently, only testers have access to Panaya. It is not easy to share this dashboard in real-time with a large group of people because they need a license just to see the report, and it can be very expensive. Its licensing should be improved. There should be more license types. There should be an advanced license and a basic license. Some users use Panaya in a very basic way to check defects or reports, but some users will use it in an advanced way. They need to be able to give different types of licenses and also better pricing because it can be expensive. We tried to have some automation with the tool to make some tests with Panaya, but it looks like it takes time to prepare automated scripts. We are still learning how to do this. It is hard to do, and it takes time to create automated tasks. It is not really an easy task. We need to invest a lot of time to build these automated scripts in Panaya. We should use more automation from Panaya.
I think the costs can be improved because replacing the existing solutions with Panaya was actually quite expensive. Especially since it is an open-source product that requires a lot of security control. I would also like the deployment of the custom codes to be handled in the system as well so that you can your build scripts and track all the fast links. So from that perspective, I would want to have the deployment prices being taken care of as well.
They provide options for custom fields or tabs, but customization of workflows would be great. Though, the standard defect workflow management is already great.