Introduction to data feeds (NEW)

 

Our recent redesign simplifies the data transfer experience by combining raw and modelled data sources into a single object - data feeds. We’re gradually releasing this new feature to our customers.
If you see Data Feeds in the left navigation sidebar, you’ll in the right place. If not, go here.

This article introduces you to data feeds and includes:

Notes:

What are data feeds?

Data feeds power your metric visualizations. They connect the source data from your files, databases, applications, and services to your metrics.

When you connect to your source data and bring it into PowerMetrics, you create data feeds. Data feeds combine your account connection (the service account you’re logged into that has the data for your metrics) and your data (as a visual component you can view and edit).

Think of a data feed as the information channel between your source data and your metrics. When you create a data feed, you define the query to use when retrieving data. Every time your data refreshes, the data feed gets updated accordingly. The resulting data is then added to the existing data for all the metrics that use the feed. The metrics then incorporate that new data into their history.

Note: In PowerMetrics, there are two kinds of data feeds, the ones you create for custom metrics and the ones we create for you when you add instant metrics. Data feeds you create are fully editable and controlled by you. Data feeds that are created automatically are managed by Klipfolio (referred to as “managed” data feeds). To ensure the integrity and accuracy of your instant metrics, these data feeds offer limited editing options. The underlying data they’re connected to cannot be edited.

Why data feeds?

  • Data feeds are a single and powerful way to manage the flow of data into your metrics. Connect to your data once and build one or more data feeds that can be reused across multiple metrics.
  • Data feeds broaden your team’s ability to create custom metrics by hiding data complexity from less technically inclined builders. The heavy lifting is done in the query builder and the data feed editor. Once your data has been queried, edited, and saved as a data feed, the action of creating custom metrics becomes accessible to everyone.
  • When you create custom data feeds, you can transform your data using Excel-like formulas and functions, unpivot, merge/join, and more. The abundance of editing options and the versatility and power of the formula bar make the data feed editor an effective tool for organizing large data sets and for cleansing messy, incomplete, or incorrect source data. 
  • If your data source uses tree-structured data, you can quickly convert it to tabular data in the data feed editor. The result is a more approachable format that’s easier to understand, especially for less-experienced builders. Converting JSON/XML data in the data feed editor.

Opening your data feeds list

To open your list of data feeds, click Data Feeds in the left navigation sidebar.

Adding data feeds to your list

If you don't have any data feeds yet, or you want to add more, click in the upper-right corner of the data feed list page.

Filtering your data feeds list

Apply filtering to your data feed list to quickly find the specific data feeds you're looking for. Filtering options (as shown below) display at the top of the page.

  • Narrow down your list using the search field: Type an entry into the search field to display associated data feeds. For example, to see a list of your Google Analytics data feeds, enter "Google Analytics" in the search field. Note: Searching is made easier when you give your data feeds meaningful names.
  • Filter by service: Display data feeds for one or all services, for example, display data feeds that connect to data in your Google Analytics account or to data in uploaded files. This list grows as you create data feeds for more services. You can either find the data feeds by service by typing in the field or by selecting from the drop-down list.
  • Display data feeds by category: Display all data feeds, only data feeds created by you, only data feeds that are shared with you, or only data feeds that are managed by Klipfolio.
  • Filter by status: Display all data feeds, regardless of refresh status type, or only those with no refresh errors (active), or only those with refresh errors (in error).

Viewing details for all data feeds

From your list of data feeds, you can view general details for all of your data feeds, including:

  • Name: The name of the data feed.
  • Owner: The person who created the data feed.
  • Created: The date and time the data feed was created.
  • Last refreshed: The last time the data feed was refreshed or re-uploaded (for data in uploaded files).
  • Refresh status: A refresh status of OK means the data feed is updating as expected. A refresh status of Failed refresh means the data feed is having trouble refreshing. A refresh status of Disabled means the data feed has failed to refresh 20 times and, as a result, has been disabled. Clicking “Failed refresh” or “Disabled” opens the data feed where you can click Edit and investigate these refresh status issues. (See below.) Learn more here.

Note: Refresh status for data feeds that are connected to data from an uploaded file will display as N/A.

  • Metrics: The number of metrics that use this data feed. You can click on the number that displays here to go to the data feed with the Metrics tab open. From there you can click a metric to open its homepage. (See below.)

  • 3-dot menu options: Click the 3-dot menu for a data feed in the list to share or delete it.

Note: To delete multiple data feeds, select the checkbox beside the name for each one in the list, then click the Delete button on the top-left of the page. When you delete a data feed, it’s removed for all users and the data connection for all metrics that used the data feed is broken (the metric will continue to be accessible but will no longer update with new or changed data).

Understanding data feed icons

In the list of data feeds, an icon displays beside each data feed name. (The same icon also displays in the title bar when you open a data feed.) Depending on the source, type, and refresh state of a data feed, the following icons can display:

Icon Description

The Service icon indicates the service, or services, the data feed is connected to.

The File upload icon displays for data feeds that are connected to data in uploaded files.

The REST/URL icon displays for data feeds that are connected to data that was created using a REST/URL query.

The Error icon warns you when a data feed has been deleted.

Note: If you delete a data feed for a metric, the metric will stop refreshing and will only display static data from that time onward.

Viewing details for specific data feeds

On the data feeds list page, you can select specific data feeds to take a closer look. Clicking a data feed in the list opens it in a new tab so you can view or edit it. Learn more about editing data feeds.

When you open a data feed, the data displays in the main window. If a data feed contains many rows of data, all rows may not display at once. To see additional rows or to go to the last few rows or first few rows, click one of the links that display below the data feed table. For example, “Showing 75 of 352 rows". "Show 100 more.” or "Go to the last few rows". (As shown below.)

With the data feed open, you'll see quick-access buttons for editing, sharing, and adding a metric, as well as the 3-dot menu, where you can share or delete the data feed. (See below.)

Note: When you delete a data feed, it’s removed for all users and the data connection for all metrics that used the data feed is broken (the metric will continue to be accessible but will no longer update with new or changed data).

Click the About tab to access the following details:

  • Name: The name of the data feed.
  • Owner: The person who created the data feed.
  • Metrics: The number of metrics that use this data feed. Clicking the digit opens the Metrics tab where you can view and open the metric(s) that are connected to the data feed.
  • Created: The date and time the data feed was created.
  • Data feed ID: The ID number for the data feed. This information may be needed, for example, when contacting Support if you’re having issues with a data feed.
  • Data service: This field displays information about the source data the data feed is connected to, including the service type (for example, Google Analytics or File Upload) and the data format (table or tree structure). (See below.)

  • Refresh rate: The current refresh frequency rate for this data feed (and its associated metrics). Note: This setting is not applicable for data feeds that are connected to data from an uploaded file.
  • Refresh status: A refresh status of OK means the data feed is updating as expected. (See below.) A refresh status of Failed refresh means the data feed is having trouble refreshing. A refresh status of Disabled means the data feed has failed to refresh 20 times and, as a result, has been disabled. You need to be in edit mode to resolve refresh status issues. Learn more in the “Editing data feeds” article.

Note: This setting is not applicable for data feeds that are connected to data from an uploaded file.

  • Last refreshed: The last time the data feed was refreshed.

Note: This setting is not applicable for data feeds that are connected to data from an uploaded file. For that file type, Last uploaded displays instead.

Click the Metrics tab to view and interact with its associated metrics:

Note: The 3-dot menu options you see depend on your access to the metric. For example, if a metric has been shared with you with view only rights, you’ll be able to open it in a new tab for viewing but you won't be able to delete it. Metrics that haven’t been shared with you will be greyed out and you won’t be able to interact with them.

  • If the data feed doesn’t have any associated metrics yet, you can add some by clicking +Add metric. (See below.) Note: This option is not available for data feeds that are managed by Klipfolio (the data feeds that get created when you add instant metrics).

Have more questions? Submit a request