Our recent redesign simplifies the data transfer experience by combining raw and modelled data sources into a single object - data feeds.
If you see Data Feeds in the left navigation sidebar, go to this article.
These new features are being released gradually. If you don't see them in your account yet - no worries - they’re coming soon!
Visualize, discover, and act on your data with metric visualizations and dashboards.
Ready to get the most from the data that's stored in your Snowflake database? Get started by adding some data sources. When you're finished adding Snowflake data sources, you'll use them to power your metrics.
This article includes:
Adding a Snowflake data source
If you’re using Network Policies to restrict IP access, before adding a data source, make sure you've added our Klipfolio IP addresses to your allow list. See the full list of Klipfolio's Allow list IP addresses.
To add a Snowflake data source:
- Click Data Sources in the left navigation bar.
If you don’t see the above option, go to the bottom of the left navigation sidebar and click your Account Name > Data Sources instead. - Click Create a New Data Source and select Snowflake.
- Fill in the following fields:
- Account name: Enter the number that displays under LOCATOR (see the example below).
- Snowflake Region: Choose the appropriate region from the drop-down list.
- Username: Enter the username that’s associated with the appropriate role. Learn more about user roles.
- Password: Enter the password for the selected username.
- Role: Enter the role that’s associated with the selected account name. PUBLIC is inserted into this field as the default setting but you can replace it if needed.
- Warehouse: Enter the name of the warehouse you want to use to access your data. Warehouses are listed in the Admin section in Snowflake. Note: Make sure the role you entered above has access to the warehouse.
- Database: Enter the name of the database where the data you want to retrieve is stored.
- Schema: Enter the name of the schema within the database that you want to access. Schemas are listed under Databases > <Name of the selected database>.
- SQL Query: Enter an SQL query to retrieve the desired data. Tip: You can test your SQL queries in Snowflake by adding a SQL worksheet. Learn more here. Go here for more information on querying data in Snowflake.
- Select whether to Include column headers.
(See below for an example of configuration settings for a Snowflake data source). - Click Get data.
- Ensure this is the data you're looking for, then click Continue.
- On the Verify your data page (the modeller) you can make modifications to your data if desired. Learn about modelling data sources.
- When you’re done making changes, click Save and continue to save your modelled data source.
The modelled data source is added to your account and is ready to use for custom metrics. To see a list of all your data sources, click your Account Name > Data Sources in the left navigation sidebar.
Creating Snowflake metrics
Now that you've created one or more Snowflake data sources, you can return to them and use them to make metrics. A single data source can be used to create a single or multiple metrics.
To create Snowflake metrics:
- In the left navigation sidebar, click Data Sources to open your list of data sources.
If you don’t see the above option, go to the bottom of the left navigation sidebar and click your Account Name > Data Sources instead. - Select the modelled Snowflake data source you want to use for your custom metric.
- On its details page, click Create metrics.
- On the Create a custom metric page, choose the desired metric value, segmentation, date & time, data shape, and display settings for your metric. If you need help, go here to learn more.
- Click Save.
Your new metric is added to your list of metrics (accessed by clicking Metrics in the left navigation sidebar) and is ready to add to a dashboard. Learn more about dashboards.
Troubleshooting Snowflake queries
Here are a few troubleshooting ideas you can try if you're having issues with your Snowflake query.
- Confirm that the SQL connection is working by using a query of Select 1. This should return the result of 1.
- Make sure your query isn’t trying to bring in too much data. Klipfolio supports a maximum file size of 10 MB. If you’re returning more than 10 MB of data, your query may not work. To see if this is the issue, try adding a LIMIT to your query (e.g., LIMIT 1000) to reduce the amount of data being returned.
- Confirm that it isn't taking too long to bring in your data. Klipfolio includes a global setting of 80 seconds within which to bring in data. If you think this might be the issue, try reducing the amount of your data so you stay within this range.