How to Set Up Incremental Refresh

Incremental Refresh Overview

Incremental refresh updates data without reloading the entire dataset from scratch. Instead of processing the whole dataset, it only adds or updates the parts that have changed since the last refresh.

new This feature is now supported by the Power BI Connector for Jira Cloud.

Please follow the guide below on configuring incremental refresh for Issues. The specific OData protocol used by the Power BI Connector for Jira does not support the Date/Time/Timezone data type. As a result, you will need to manually include a data type conversion in your query.

Supported Tables

A list of tables that support incremental refresh includes: Issues, Issue Custom Fields, and History-related tables (IssueAffectsVersion, IssueFixVersions, IssueLinks), Service Management Custom Fields, and Feedback.

Custom Fields Support:

• Custom fields exported as a column in the Issues table will not impact incremental refresh functionality.

• Custom fields exported as a separate table must be searchable.

Incremental Refresh Configuration

The setup process for incremental refresh involves the following steps:

→ creating parameters

→ customizing the query

→ defining the incremental refresh policy

→ publishing your model to Power BI Service

→ setting up refresh on Power BI Service.

Parameters

The parameters must have the constant names: RangeStart and RangeEnd. These are case-sensitive and must be of the Date/Time data type. No other data types are supported for incremental refresh.

Query

In Power Query Editor, you’ll need to customize your query. Simply copy and paste the provided query, substituting your variables as required. This customized query will serve as a filter for your data.

Incremental refresh

To define an incremental refresh policy, specify the range of historical data to retain and the time period to refresh. This partitions your dataset into time-based segments, such as days or months. During refresh, only the most recent partitions are updated, while historical data remains unchanged.

Power BI Service

After publishing, your model appears in the user's workspace in the Power BI Service. During the first refresh, both historical and incremental data are loaded. Subsequent refreshes load only incremental changes.

Right after the OData source is connected to Power BI, in the Navigator window, select Transform Data. If the data source has already been exported, select Transform Data from the Power BI ribbon.

1. Select Transform Data

2. Select Manage Parameters, and then select New Parameter.

3. In the Name field, enter RangeStart (case-sensitive).

4. In the Type field, select Date/Time.

5. In the Current Value field, enter a start date and time value.

6. Select New.

7. In the Name field, enter RangeEnd (case-sensitive).

8. In the Type field, select Date/Time.

9. In the Current Value field, enter an end date and time value.

10. Select OK.

11. Right-click the last step, and then select Insert Step After.

12. Navigate to your query, and then copy and paste the query below, carefully substituting variables.

• Issues_table is an actual table name

• CREATED is an column name

13. Select Close&Apply.

14. Right-click a table that will be configured, and then select Incremental refresh.

15. In the Set import and refresh ranges section, move the slider to On.

16. Depending on your specific needs for incremental refresh, configure all required settings, and then select Apply.

• When the Refresh only complete days option is selected, the incremental refresh will be adjusted to the last completed day.

• The Detect data changes option is not recommended to use, as it can increase server load and slow down refresh performance.

17. Select Publish.