2

Extract API Reponse Header Through REST/URL connector

I'd like to be able to extract an API response Header through the REST/URL connector in Klipfolio. I understand this functionality doesn't currently exist but it is the only way I can obtain the total number of records for an API class I am querying.

8 comments

  • 0
    Avatar
    Scott Lawrence

    Hi Sam,

    Thank you for contributing to the community!  

    Can you help me better understand what you are trying to do?  It would be great to know more about what information you are trying to capture and how you would like to use it.  This will help with defining the request and with prioritization.

    Thanks,

    Scott.

  • 0
    Avatar
    Sam Fairweather

    Hi Scott, there is an application I am connecting to called Tradegecko. I want to be able to build dashboards on a class called order_line_items which contains granular data at the product level. As it's a large dataset the only way to extract the data is to use pagination where I need to obtain the total number of records. Unfortunately this value isn't available as meta data when you create the datasource. I've been informed the only way I can extract the total number of records is throught the HTTP header.

  • 0
    Avatar
    Scott Lawrence

    Hi Sam,

    Thank you for the additional context.  I'll discuss it with the product team.

    Cheers,

    Scott.

  • 0
    Avatar
    Jon Karnofsky

    Scott,

     

    Has this been considered? I'm trying to accomplish the same thing. Thanks!

  • 0
    Avatar
    Leann Lewis

    Same situation - we can't effectively utilize the data from our ecommerce site because of the pagination issue.

  • 0
    Avatar
    Jerry Hsieh

    Similar situation here - I need to be able to paginate my data source but there is no way to get a record count or page count in advance to determine the number of pages required. The page count is stored in the response header, however... so if we could get a hold of that it owuld be immensley helpful.

  • 0
    Avatar
    Jerry Hsieh

    Similar situation here - I need to be able to paginate my data source but there is no way to get a record count or page count in advance to determine the number of pages required. The page count is stored in the response header, however... so if we could get a hold of that it owuld be immensley helpful.

  • 0
    Avatar
    Kaushi Bandara

    Hi Sam, Jon, Leann and Jerry,

    Thank you for raising this request in our community! It is currently not in our immediate roadmap; however, we will be scheduling an investigation into simplifying pagination of datasources. We will utilize this as a use case in addressing pagination and we will be sure to reach out to you with our results.

    Best regards,

    Kaushi Bandara.

    (Product Manager)

Please sign in to leave a comment.