Postman reports in Orangebeard

Jun 9, 2022

Postman is a great tool to test your API’s. Because Postman is a specialized tool for API testing, we see it used in conjunction with other automation tools a lot. Would it not be nice to have your Postman  CI-runs report in the same way as the other tools you are using?

Orangebeard can help! And it’s pretty easy to connect your postman collections to Orangebeard. Let us talk you throught the process.

To get started, make sure to run your Postman collections via Newman, the CLI for Postman. Already doing that, great! You’re ready to install our listener that will grab the test results at runtime, and sends them to your Orangebeard account!

 

Installation

To install our listener, simply install it using NPM:

npm install @orangebeard-io/newman-reporter-orangebeard

Configuration

Now to configure your test run to report to Orangebeard, you have the option to create a configuration file (orangebeard.json):

{
    "endpoint": "https://XXX.orangebeard.app",
    "accessToken": "00000000-0000-0000-0000-00000000",
    "project": "my_project_name",
    "testset": "My Test Set Name"
}

And run your tests with our listener enabled:

newman run ./postman-collection.json -r @orangebeard-io/orangebeard

The second option is to do all configuration on the command line. This works best from your CI Tool, as you can replace the values with secrets and environment variables. Typically, the command would look something like this:

newman run ./collection.json -r @orangebeard-io/orangebeard \
--reporter-@orangebeard-io/orangebeard-endpoint=https://my.orangebeard.app \
--reporter-@orangebeard-io/orangebeard-token=00000000-0000-0000-00000000 \
--reporter-@orangebeard-io/orangebeard-testset=testset_name \
--reporter-@orangebeard-io/orangebeard-project=project_name \
--reporter-@orangebeard-io/orangebeard-description=description \
--reporter-@orangebeard-io/orangebeard-attributes=key:value;secondkey:secondvalue;singleTag

Note: descriptions and attributes are optional!

Lastly, you could decide to programatically run with Orangebeard enabled. An example can be found in the readme of our listener’s GitHub repository!

Now you have your postman test results in Orangebeard. All detailed information from requests, responses and tests at a glance. Start analyzing defects right away and let Orangebeard help you analyze the cause of failing tests in the future.

Happy testing!

Operational benefits

Quality Owners

Locate & classify test bugs in no time

Shorten your test cycles

Test actual code changes

Collaborate on quality

Data driven insights

All test results in one place

Developers

Faster deliveries & feedback

Speed up development

Build confidence

Reduce number of releases

Boost quality

One tool to rule them all

Leaders 

Faster results with higher accuracy

Audit ready reporting

Save time & manpower

Boost efficiency

Lower costs & effort

Better insights, more control

Say goodbye to the test tool jungle!

View all your test results in one dashboard, making it super easy to read, understand and report what happened.

Realize maximum quality and efficiency

Let Orangebeard select and run the tests for maximum quality and coverage in the time you have available. 

With Orangebeard, your testing will get smarter and faster with every build.

Orangebeard’s artificial intelligence allows you to speed up your software releases in your automated pipeline up to 80%.

Orangebeard learns from your test results data and recognizes:

  • bugs, environment issues and test failures
  • trends in failure reasons
  • the maturity level of your test environment
  • which tests are associated with code changes check-ins
  • security vulnerabilities

With all that data, Orangebeard‘s intelligence helps you select and run the best test sets for the next deployment. Completely automated!

Start smarter testing today

Ready to learn what Orangebeard can do for your automated test process? 

Say goodbye to the test tool jungle!

View all your test results in one dashboard, making it super easy to read, understand and report what happened.

Realize maximum quality and efficiency

Let Orangebeard select and run the tests for maximum quality and coverage in the time you have available. 

With Orangebeard, your testing will get smarter and faster with every build.

Orangebeard’s artificial intelligence allows you to speed up your software releases in your automated pipeline up to 80%.

Orangebeard learns from your test results data and recognizes:

  • bugs, environment issues and test failures
  • trends in failure reasons
  • the maturity level of your test environment
  • which tests are associated with code changes check-ins
  • security vulnerabilities

With all that data, Orangebeard‘s intelligence helps you select and run the best test sets for the next deployment. Completely automated!

Start smarter testing today

Ready to learn what Orangebeard can do for your automated test process?