PowerMetrics: About data source refresh

 

Our recent redesign combines raw and modelled data sources into a single object called a data feed.
If you see Data Feeds in the left navigation sidebar, go to this article to learn about data refresh.
These new features are being released gradually. If you don't see them in your account yet - no worries - they’re coming soon!

 

Data sources refresh based on a specified frequency rate, from every 15 minutes to every 4 hours (depending on your pricing plan). You can select an alternate refresh rate for any number of data sources in your account as long as your selection fits into your current plan limit. To attain more frequent refresh rates, you can upgrade to a different plan.

When refreshed, the data in raw (unmodelled) data sources is automatically updated, as well as the data in all associated modelled data sources and metrics.

This article includes:

Changing the refresh rate for instant metrics

When you add instant metrics, we create and model your data sources for you. To ensure the integrity and accuracy of your instant metrics, note that the underlying data in these modelled data sources is managed by Klipfolio PowerMetrics and cannot be edited. However, you can update their refresh rate frequency.

To change the refresh rate for an instant metric:

  1. In the left navigation sidebar, click Metrics to display the Metric List page.
  2. Select the metric you want to edit.
  3. Click the 3-dot menu in the top navigation bar and click Edit.
  4. Under Data > Refresh rate, click the drop-down beside your current refresh frequency rate and select a different one from the list of available options.

Note: The choices available to you depend on your pricing plan. If you want to access more frequent refresh rates, click Upgrade to move to a different plan. Note that this change will also impact related instant metrics that use the same service.

Changing the refresh rate for custom metrics

With custom metrics, you create and manage all associated raw and modelled data sources.

To change the refresh rate for a custom metric:

  1. In the left navigation sidebar, click Metrics to display the Metric List page.
  2. Select the metric you want to edit.
  3. Click the 3-dot menu in the top navigation bar and click Edit.
  4. Click the link under Data source to open the associated modelled data source details page.
  5. On the modelled data source details page, click the link beside Uses data source to open the details page for the raw (unmodelled) data source.
  6. Beside About this Data Source, click Edit Properties.
  7. Beside Queue for Refresh, click the drop-down and select a different refresh frequency rate from the list of available options.

Note: The choices available to you depend on your pricing plan. If you want to access more frequent refresh rates, click Upgrade to move to a different plan.

About the data source refresh queue

Data sources are automatically added to the refresh queue based on their specified refresh frequency rate.

The time it takes for a data source to refresh depends on:

  • The number of data sources already in the queue.
  • The number of data sources in your account being refreshed simultaneously.
  • The time it takes for the source system to respond to the query defined in the Klipfolio data source.
  • Whether or not the refresh needs to be deferred in order to avoid exceeding the API limits for the service.

Data sources are refreshed on a first-in-first-out order of priority. This ensures that resources are made available to active users. The only exception is deferred refreshes. When a refresh is deferred past the scheduled refresh time frame, the deferred refresh request is automatically added to the front of the queue.

You can also manually queue raw (unmodelled) data sources to be refreshed.

To manually queue a data source to be refreshed:

  1. In the left navigation sidebar, click your Account Name > Data Sources.
  2. Select the raw (unmodelled) data source from your list of data sources to open its details page.

Note: You can also access a raw data source from the associated modelled data source details page by clicking the link beside Uses data source.

  1. Under Connection, at Queue for Refresh, click Queue for Refresh.

About data source refresh and service API limits

Because some APIs, like Google Analytics, impose a limit on the number of requests per profile, number of concurrent requests per profile, and the number of tokens per user account, Klipfolio monitors the number of API calls for each OAuth token and profile. This is most commonly seen when you have a large number of queries set to refresh in close succession. In this case, Klipfolio can defer a new refresh request from executing for a short period of time in order to prevent an account from violating an enforced limit. This typically has little impact on queue refresh times.

Note: As an Admin, when you set a data source refresh rate, make sure the refresh rate complies with any limitations set by the service you're connecting to.

Troubleshooting refresh issues

For more information on handling data source refresh failures see Understanding data source refresh intervals, failures, and errors.

Have more questions? Submit a request