Creating Google BigQuery data feeds and custom metrics (NEW)

 

Our recent redesign simplifies the data transfer experience by combining raw and modelled data sources into a single object - data feeds. We’re gradually releasing this new feature to our customers.
If you see Data Feeds in the left navigation sidebar, you’ll learn how to create data feeds and custom metrics for Google BigQuery in this article. If not, go here.

 

Ready to visualize and track your data that's stored in Google BigQuery? Get started by setting up a connection between PowerMetrics and your Google BigQuery account and adding one (or more) data feeds.

When you're finished adding data feeds, you'll use them to power your custom metrics.

This article includes:

Notes:

  • When you create a Google BigQuery data feed you can either choose a pre-built data source or, if the pre-built options don't include what you're looking for, create a custom one. 
  • If you choose to create a custom Google BigQuery data source (instead of a pre-built one), you first need to create an SQL query using the Google BigQuery Query editor. You'll copy and paste that query into Klipfolio when choosing the data to retrieve for your data feed. 
  • Occasionally, with very large data sources, you may notice some of the data is being duplicated. If this happens, try reducing the amount of data being returned.

Creating a Google BigQuery data feed

When you create a data feed, you:

Connecting PowerMetrics to your Google BigQuery account

The first step in creating a Google BigQuery data feed is to connect PowerMetrics to your account.

Here are a couple things to note:

Your data is safe with us. The first time you connect your Google BigQuery account to PowerMetrics, you'll be prompted to enter your Google login credentials and give permission to allow access to the data within your Google account. We are serious about protecting your data privacy.

Managing your connections. By default, your connection name looks like this: yourname_<date and time created>. You can modify the default connection name when you create a new connection or from your list of connections, accessed by clicking the button in the left navigation sidebar and selecting Connections. Each time you connect to Google BigQuery, you can use the same account (or switch to a different account if needed). If you have trouble accessing an existing connection, your OAuth token may have expired. If that happens to you, go here for help.

To connect PowerMetrics to your Google BigQuery account:

  1. In the left navigation sidebar, click the + button beside Data Feeds.

  1. Click Select data.
  2. On the Where is your data? page, select Google BigQuery. (See below.)

  1. Select a pre-built or custom connection to use for your data feed.
  2. If this is your first time connecting to Google BigQuery:
    • Click Connect an account. Enter your Google login credentials and click Next. If prompted, click Allow to enable Klipfolio to securely access your Google Big Query data. Click Continue.
  3. If you've connected to Google BigQuery before:
    • Select an existing connection from the drop-down list and click Continue.

Next step - Choosing data for the data feed.

Choosing data for the data feed

To choose data for the data feed:

  1. On the Configure data service page:
  • If you selected the List of Projects pre-built option, click Get data.
  • If you selected the Sample Query - Life Expectancy by Country pre-built option, select a Project from the drop-down menu (or, optionally, manually enter the Project name/ID in the text field). At Request Option, select either BigQuery SQL or Raw data (JSON), depending on the desired output format, and click Get data.
  • If you selected Create a custom Google BigQuery data source, select a Project from the drop-down menu (or, optionally, manually enter the Project name/ID in the text field). At Request Option, select BigQuery SQL, paste the SQL query you copied from the Google BigQuery Query Editor into the SQL Query text box. Click Get data. If needed refer to the Google BigQuery API documentation for details. Click Get data.
    Note: Be sure to include #standardSQL as the first line in your query, otherwise you may receive a date format error.

 The image below displays a Google BigQuery SQL query and its results in Klipfolio:

  1. Ensure this is the data you're looking for and, then, click Continue.
  2. You're taken to the data feed editor, where you can either save the data as-is or modify it.

If you want to modify the data feed, go to this article for detailed editing information.

  1. Click Save data feed.

The data feed is added to your account and is ready to use for custom metrics. To see a list of all your data feeds, click Data Feeds in the left navigation sidebar.

Next steps - Creating Google BigQuery custom metrics

Now that you've created one or more Google BigQuery data feeds, you can return to them and use them to make custom metrics. A single data feed can be used to create a single or multiple custom metrics.

To create custom metrics using a data feed:

  1. In the left navigation sidebar, click Data Feeds to open your list of data feeds.
  2. Select the data feed you want to use for your custom metric.
  3. Click either the +Add metric button in the top right corner of the window or open the Metrics tab and click +Add metric. (See below.)

  1. Choose settings for your custom metric and click Save metric. If you need help, go here to learn more.

The metric opens in its homepage and is added to your list of metrics (accessed by clicking Metrics in the left navigation sidebar).

Now you're ready to start interacting with and learning from your metric data!

Have more questions? Submit a request