Retrieve more than 5000 records from dataverse or dynamics 365 in Power automate using fetchxml paging
In this post I will explain about paging concept using FetchXML with Power Automate to retrieve records from Dataverse or Dynamics 365 CE/CRM.
Watch the below video for practical knowledge. Or you can scroll down to read the article.
Step 1 – Create a Flow and add required variables
Create a new Instant flow and add 3 variable actions.
- Total Record Variable : To store number of records return and sum the total of every iteration
- Paging Cookie : To store the raw fetchxml paging cookie value returns from response of List row step
- Paging Cookie Only : to store the extracted page-cookie value from the raw paging cookie
Below in the screenshot.
Step 2 : Define a Object variable to store Raw JSON object
Step 3 : Define the loop do until and set variables value
inside loop check if paging cookie is blank. Run the loop till the paging cookie is null. Inside the loop use list row to read data. The rest of steps looks like below.
The check in loop is given to check if paging cookie variable blank or not. if not blank loop continue.
List Row sept of dataverse connector – We used Fetchxml with dynamic page count attribute and page cookie.
The Page expression and paging-cookie expression is given below.
add(iterationIndexes('Do_until'),1)
if(equals(iterationIndexes('Do_until'),0),'',concat('paging-cookie=''', substring(first(skip(split(string(xml(setProperty(variables('RawJSON'),'z',variables('PagingCookieOnly')))),'<'),1)),2),''''))
The Count variable incremented by the length of the row returned.
Paging Cookie expression mentioned below to read the raw paging cookie from response of list row get accounts.
Paging cookie only updated as below expression.
Now after test the count will return 6100 account which is more than 5000.
Hope this helps.
Follow my blog for more trending topics on Dynamics 365, Azure, C#, Power Portals and Power Platform. For training, Courses and consulting, call to us at +91 832 886 5778 I am working more for community to share skills in Dynamics 365 and Power Platform. Please support me by subscribing my YouTube Channel. My YouTube Channel link is this : https://www.youtube.com/user/sppmaestro