Answers to Frequently Asked Questions
Orangebeard supports all kinds of tests, from unit tests to end-to-end integration tests. It also works with every testing tool, including custom-built frameworks. We have already built a large collection of test listeners for the tests in your environment(s). In addition to this list of tools, we can also support new ones on request.
No. Orangebeard is a SaaS solution.
Yes, per run. Tools like Azure DevOps are great for storing test results.
But they’re less helpful in understanding them over time. Orangebeard looks at behavior, patterns, and reliability, something those tools don’t.
Maintaining and managing a test suite is a balancing act. On one hand, testing takes time to run and keep up to date. On the other hand, you want to run as many tests as possible to catch issues early. With insights from Orangebeard, you can make better decisions. Should I focus more on adding unit tests or creating end-to-end tests? Or would it be better to remove certain test suites all together?
How much of that is manual work? And how much trust do people have in it? For example, can you say from Jira today whether your test suite is more reliable than last month?
No. You already collect test results by a test tool/runner. Orangebeard connects to that. It is a layer on top of your existing stack and makes sense of all your test results.
No, fortunately not. Orangebeard works completely independently of your development tool. We only need your test results and metadata, and we are happy to help you with that process. It is quick and easy to set up.
Orangebeard is a SaaS product. We run a streamlined cloud-based operation from our headquarters in Leusden, the Netherlands. At this time, we (still) have no plans to make a hosted version available.
Well, testing and test automation take up a lot of valuable time. This is especially crucial in a continuous delivery environment. And when you have put together thousands of tests, can you still maintain them all?
Orangebeard does not use your production code to analyze your tests. The platform focuses on metadata such as the type of test, the logs, the test duration, and whether the test was successfully completed.
Not necessarily. Some of our customers only purchase software and create test sets to test API compatibility and perform end-to-end testing.
This depends on the test framework you are currently using. Orangebeard supports all major test frameworks such as JUnit 4/5 and NUnit. We also support tools and frameworks like Selenium, Cypress, WebdriverIO, FitNesse, Robot Framework, Ranorex, and Cucumber. During onboarding, our support team will help you connect every tool, completely free of charge. And we will not stop until it works.
Let us know. We will help you either way, and who knows, we might add your question here to help inform other curious minds.