2

Is is possible to use a modelled data source to add all rows from a secondary data source (i.e. UNION)

I have multiple data sources representing the same kind of data over different time ranges. That is, each data source has the same columns. Can I use a modeled data source to build a union of the rows from both underlying data sources? I used a formula to add a column that's guaranteed to be unique across all rows, but I want to then merge the columns from the secondary data source, not *add* them. I'm hoping I'm just missing a step or trick.

Thanks

2 comments

  • 0
    Avatar
    Janice Janczyn

    Hi Tony, 

    Depending on your end goal, there may be a better approach than merging modelled data sources. Are you trying to build a PowerMetric that accumulates historical data? Any details you may be able to provide will help us guide you.

    Thanks,
            Janice

  • 1
    Avatar
    Tony Andrews

    Hi Janice - thanks for replying. I have a table that's pushing the size limits, and contains old data that rarely (if ever) changes. So I'd like to have data sources that contain data from 2017 & 2018 (and refresh those only daily) and then combine that with data for the current year (refreshing that more frequently) into a single modelled data source that's referenced by all of my klips.

    The data is all coming from a single Redshift table, but each data source would select data only from a single year, keeping their sizes under control.

    Is there a better way to achieve this?

    Thanks,
    Tony

Please sign in to leave a comment.