We performed a comparison between Postman and Runscope based on real PeerSpot user reviews.
Find out what your peers are saying about Postman, F5, SmartBear and others in API Monitoring Software."Postman lets you create, manage, and validate a suite of tests. It has several features to help you organize your test suite. You can also automate stuff with a lot of validations and assertions. Postman supports GraphQL, and you can do various kinds of calls."
"One of the most valuable aspects of Postman is scalability. We can scale the collection and for the multiple repositories of the collections."
"It allowed us to understand the working and performance of the APIs."
"This solution offers a free version."
"Postman allows you to incorporate and export the test cases we create. It enables me to share the test cases with my colleagues, so I don't have to copy them into an Excel sheet. Postman lets me export the dataset and share it with my team. They can use my test case for their testing."
"The most valuable feature of Postman is the large libraries."
"It is stable and does not lag."
"The solution has helped us very well in testing endpoint URLs."
"We love the fact that we can have our API tests run on a schedule as often as we need. We also take advantage of being able to set up different environment settings so that we can use the same test in our production, integration, and QA environments, easily. The ability to string together a number of API tests for a test suite is very important to us as well."
"As we have the APIs scheduled, we use the notifications. We know the exact moment it is breaking something that might impact the customer system, that might result in a feature not working. We know "in advance" and we can fix it before the customer notices. It helps us to be more proactive."
"The feature of automatically executing tests at a predefined time interval is great as we can be continuously testing our end-points before and after builds are deployed."
"It has a relatively simple user experience."
"We can receive an email and slack notifications if tests are failing/passing."
"This solution has improved our responsiveness to issues in both production and non-production environments. Through integration with Slack, our development and DevOps teams are quickly aware of issues related to new changes deployed to non-production environments, which tightens our feedback loop during testing. Through integration with PagerDuty, our DevOps resources are able to reduce the adverse impact of a given production issue."
"It is a cloud-based environment for building and executing tests, which allows me to focus on building, running, and reviewing test results."
"You can run it off the cloud and against different data centers. That's one of the plus points for most people for this product, as opposed to some other solutions."
"Postman is a bit more of a complex tool, making it an area where improvements can be made."
"Postman quality assurance could improve when doing tests."
"I have display issues in my Windows that need to be fixed."
"I would like to have a code snippet where I can write a code and for the responses of the endpoints to be validated using my custom business conditions."
"They should provide more specific documentation on configuration."
"We have previously used Tosca which allowed us to verify information using authentications. It would be useful if this was also possible using Postman. In a future release, Postman should connect to DB."
"Integration of the solution towards Bitbucket, BitHub, and CI pipelines is difficult."
"I would like to see improvements in the maintenance of the scripts and their collections. It is really painful that the user cannot drag and drop. It was also painful to create the standard suite of operations for the product. I am not sure if this is improved in the tool’s latest versions. The maintenance of the complex scenarios prompted us to use the solution only for unit testing. In the future, we may switch to the k6 framework."
"If you forget to set the default environment during test creation, you have to go through every test and make sure that it is set to the environment that you prefer if using shared environments. If there was an option to force all tests within a bucket into a specific environment with one click, this would save a lot of time."
"We would like the ability to configure Runscope behavior when a given test has its schedule modified. That is, in a non-production environment, we often need to pause a test (either by removing it from the schedule or adjusting its frequency) and this results in the automatic kick-off of this test in all other environments. We would like the ability to simply pause a test for a specific shared environment without causing additional tests to be started."
"If triggering test bucket via trigger API, there is no option to see if the tests which were triggered passed or failed."
"Needs the ability to create code which runs before and after API tests."
"One thing that can be improved is the logging. Sometimes, when we have an error, we don't know how to find more information about the problem that has happened. Sometimes, it just returns something like "that gateway." More information would be a way to improve it."
"There are not many options for scalability."
"Reliability. I would like to see more money invested in disaster recovery testing of the application. The product should be hosted across several AWS regions so if there are issues with an EC2 instance in a particular region, the whole application won't be affected. Once or twice a year there are issues with AWS that causes the reliability of the application to suffer."
"File upload is a big part of the products that we test. The lack of file upload in Runscope requires us to still use UI (Selenium) automated tests for these scenarios."
Earn 20 points
Postman is ranked 1st in API Monitoring Software with 52 reviews while Runscope is ranked 4th in API Monitoring Software. Postman is rated 8.2, while Runscope is rated 8.8. The top reviewer of Postman writes "Reliable and easy to expand with a helpful API network". On the other hand, the top reviewer of Runscope writes "Enabled us to set up automatic regression tests that cover everything we need to monitor". Postman is most compared with Apache JMeter, ReadyAPI Test, Tricentis Tosca, Katalon Studio and NGINX API Gateway, whereas Runscope is most compared with .
See our list of best API Monitoring Software vendors.
We monitor all API Monitoring Software reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
