How to Set Up Incremental Refresh
- Liliia Ostrovska
Please note that incremental refresh is supported only for specific tables. Refer to the list of supported tables for details.
Incremental Refresh Overview
Incremental refresh updates data without reloading the entire dataset from scratch. Instead of processing the whole dataset, it only adds or updates the parts that have changed since the last refresh.
Please follow the guide below on configuring incremental refresh. The specific OData protocol used by the Power BI Connector for Jira does not support the Date/Time/Timezone data type. As a result, you will need to manually include a data type conversion in your query.
Supported Tables
Table ID | Column Name |
|---|---|
Issues | ISSUE_RESOLVED |
Versions | VERSION_RELEASE_DATE |
Comments | COMMENT_CREATED |
Worklogs | WORKLOG_WORKLOG_DATE |
TempoPlanner | CREATED |
Incremental Refresh Configuration
The setup process for incremental refresh involves the following steps:
→ creating parameters
→ customizing the query
→ defining the incremental refresh policy
→ publishing your model to Power BI Service
→ setting up refresh on Power BI Service.
To begin setting up incremental refresh, please follow the steps outlined below.
This guide starts with data transformation. If you're unsure how to export data from Jira Data Center to Microsoft Power BI, please refer to this page for detailed instructions.
Right after the OData source is connected to Microsoft Power BI, in the Navigator window, select Transform Data. If the data source has already been exported, select Transform Data from the Microsoft Power BI ribbon.
Select Transform Data
Select Manage Parameters, and then select New Parameter.
In the Name field, enter RangeStart (case-sensitive).
In the Type field, select Date/Time.
In the Current Value field, enter a start date and time value.
When you configure incremental refresh in Power BI Desktop, these parameters are used to filter only a small period of data that's loaded into the model. When Power BI Desktop publishes the report to the Power BI service, with the first refresh operation the service creates incremental refresh and historical partitions, and optionally a real-time DirectQuery partition based on the incremental refresh policy settings. The service then overrides the parameter values to filter and query data for each partition based on date/time values for each row.
For more information, please refer to the Microsoft’s official documentation.
Select New.
In the Name field, enter RangeEnd (case-sensitive).
In the Type field, select Date/Time.
In the Current Value field, enter an end date and time value.
When you configure incremental refresh in Power BI Desktop, these parameters are used to filter only a small period of data that's loaded into the model. When Power BI Desktop publishes the report to the Power BI service, with the first refresh operation the service creates incremental refresh and historical partitions, and optionally a real-time DirectQuery partition based on the incremental refresh policy settings. The service then overrides the parameter values to filter and query data for each partition based on date/time values for each row.
For more information, please refer to the Microsoft’s official documentation.
Select OK.
At this stage, you should have two Applied Steps: Source and Navigation.
Right-click the last step, and then select Insert Step After.
Navigate to your query, and then copy and paste the query below, carefully substituting variables.
= Table.SelectRows(Issues_table, each [CREATED] >= DateTime.AddZone(RangeStart,0) and [CREATED] < DateTime.AddZone(RangeEnd,0))Issues_table is an actual table name
CREATED is an column name
Select Close&Apply.
It may take a few moments for query to be applied. Please wait.
Right-click a table that will be configured, and then select Incremental refresh.
In the Set import and refresh ranges section, move the slider to On.
If the slider is disabled, it means that the Power Query expression for the table does not include a filter based on the RangeStart and RangeEnd parameters. Another possible reason could be incorrect parameter names or data types.
Depending on your specific needs for incremental refresh, configure all required settings, and then select Apply.
When the Refresh only complete days option is selected, the incremental refresh will be adjusted to the last completed day.
The Detect data changes option is not recommended to use, as it can increase server load and slow down refresh performance.
For more information on setting up an incremental refresh policy, please refer to Microsoft’s Official Guide.
Select Publish.
You’ve configured the incremental refresh policy. Next, publish your model to Microsoft Power BI Service and set up the refresh.
After publishing, your model appears in the user's workspace in the Power BI Service. During the first refresh, both historical and incremental data are loaded. Subsequent refreshes load only incremental changes.