Pipedrive Pagination - using Klipfolio datasource.

Pipedrive pagination is tricky because we do not know how many pages or how many total elements are there before writing the API query. That makes the Klip maintainability a bit of a trouble.

The maximum number of items in the results are limited to 500 in the pagination API. You can use normal queries to get the data where data elements are less than 500. If the data items are more than 500 you can use dynamic data source. 

In the dynamic datasource there will be a dynamic property which is defined using a variable, each value change in the dynamic property will create new instance of the datasource using that value. 

You can also use filters to filter your data so that you do not always have to use dynamic datasource.  For example, deals have 89 types of filters.

You can get filters for different types using queries mentioned here.


filter_id = 73 is for deals created last month.

Where non dynamic datasource query will be like, If the data has less than 500 deals you can use this,


Pipedrive has a parameter called start which is actually an offset of the data. If there are more than 500 items then, dynamic datasource API query is, 


Please ensure that you create a variable called offset and assign a default value to the same in Klip editor and save it before you try to use it in the query.

{props.offset} is a variable and will be assigned values in the formula. Filter id is 73 to pull last months deals.

Consider for example you know there are 3 pages for this data with 1051 elements, so you will create a list of values for the start parameters as 0, 500, 100 with following formula. If there are 4 pages change 2 --> 3 in below formula.


You can use MAP function which acts as a loop and assigns these values to the start parameter in the query and create 3 instances of the dynamic data source with different start value and pull the Id from all the datasource instances.

MAP( CUMULATIVE(ARRAY(0, REPEAT(500, 2) ) ), "offset" , JOIN (id ))

You can use JOIN to join the Ids from one instances in a single value separated by comma, as MAP will return one value for each input value of the variable, Then you can join all the three Ids from three instances of the datasource and convert them in to array.

ARRAY (JOIN(  MAP( CUMULATIVE(ARRAY(0, REPEAT(500, 2) ) ),"offset" , JOIN (id ) ) ) )

New Information : Now instead of going all this trouble of joining all the results together and then making an array you can use MAPFLAT function, thanks to Klipfolio. So formula is much simpler now. 

MAPFLAT( CUMULATIVE(ARRAY(0, REPEAT(500, 2) ) ),"offset" , (id ) ) )

All these formulas and features explained here.




Please create a new dynamic data source from the scratch. You should not modify non dynamic data source to convert it to dynamic as it might make it unusable.


  • Avatar
    Janice Janczyn Official comment


    When a web service, such as Pipedrive, does not return the total count of the records, we recommend that you filter your query by date or some other parameter.

    You could arbitrarily set the number of pages requested in the Klip formula, however you must ensure this is the minimum number of pages expected so that no empty responses are returned. When empty responses are returned, null dynamic data source instances are created and this can cause unexpected results. In your scenario, if the minimum number of records is 300 and Pipedrive returns 50 records per query, your maximum number of pages would be 300/50=6.





  • 0
    Matthias Moeser

    Hi Data Girl,

    thanks for sharing!

    I strongly recommend you generate a new token for your pipedrive immediately and never share it ever again on the internet!

    Kind regards,


  • 0
    The Data Girl

    Hi Matthias,

    Thank you for pointing it out.I really appreciate it. I have updated my queries now.



  • 0
    Matthias Moeser


  • 0
    Dina Scheibye

    Hi Data Girl,

    Thank you for the article. We work with Pipedrive APIs a lot, and just came across this problem of pagination. Read your article, it is quite informative.

    However, if I do not know beforehand the number of records being returned by my query (as it might be 300 or 2000 at any point of time based on the sales), how will I know how many pages will be there to create a array for the offset.

    Please clarify.

    Thank you.

  • 1
    Adam Doogan-Smith

    Hi Dina,

    You can append &get_summary=1 to the end of your query if you want to see a summary of how many total deals. You can find it in the JSON response by following additional_data->summary->total count..


    Happy Dashboarding!


Please sign in to leave a comment.