Performance and scale testing your Data Center app

This page describes the performance and scale testing requirements for Data Center apps in the Atlassian Marketplace. Here, we provide guidelines for configuring an existing test platform to produce the test data we need to evaluate your app. For a general overview of Data Center app development, see Developing apps for Atlassian Data Center products.

Requirements

1. You’re required to conduct performance testing of a 1 node DC instance, with and without your app installed.
   • You're required to test the main actions of the base product.
   • You're also required to test any endpoints or interfaces your app provides.
2. You're required to conduct scale testing of your app. This means testing the same endpoints and interfaces in an additional 2 and 4 node configuration.
3. With the above testing, you're required to add data to your app that matches that of a typical enterprise installation.
4. The base dataset should mimic the dataset that ships with the Data Center App Performance Toolkit. See the datasets outlined below.

Dataset requirements

Concurrency requirements

We advise using the default workload for all tests. This uses a concurrency of 200, and total user transactions of 54,500. This workload is defined in the main $product.yml configuration.

Additional requirements

To help us evaluate your performance testing, you’ll also need to:

• Detail the method of performance testing used (Framework, Browser Testing etc).
• Outline the actions that users will have with your Data Center App (User actions).
• Outline the actions that other systems or services can have with your Data Center App (API Definition).
• Detail the performance results of each hardware and data complexity scenario for the actions above.
• Outline the load applied to your application in the performance testing conducted: - What were the response times of endpoints based on the actions taken. - For each product, how did the response times on each endpoint differ based on the number of nodes in the cluster.

Expected output

You'll need to produce two reports that satisfy the different Requirements:

Performance report

This report should show the response time of each action on a two deployments: one with your app installed, and another without.

Sample performance reports

CSV

Graph

Scale report

This report should show the response time of each action on instances with one, two, and four application nodes.

Sample scale reports

CSV

Graph