Reltio works to continuously improve our performance, functionality and usability. One of the ways we can do this is by finding, building, and developing relationships with other platforms and tools used by the same organizations that use us. Thus, we have developed Reltio Connected Data for Snowflake, a way for both Reltio Master Data Management and Snowflake’s data warehouse to work together.
Please note: Information about ReltiRelo Connected Data for Snowflake provided both here, in related articles, and on the linked webinar is intended for this purpose only- to inform our current and potential customers. No business decisions should be made off of this information alone, please contact us for more information. All of Reltio’s products and their development remain solely owned by Reltio.
In the first article related to the webinar Reltio Connected Data for Snowflake, we discussed a brief overview of how the two products can work together. In our second article, we went over the business solutions that Reltio Connected Data for Snowflake provides, as well as the product’s features, cost, and possible future developments.
Throughout this series, we aimed to answer some important questions. These questions were:
Much of this content has already been covered in prior articles, however, by the end of this article, we will fully answer all of these questions.
Remember, to best understand how Reltio Connected Data for Snowflake works, you must understand the following terms.
Before using Reltio Connected Data for Snowflake, you will need to perform four steps. These are:
In this demonstration, our presenter, Ganesh, shows a created data warehouse for a particular tenant, as well as a separate database where he is using Snowflake schema. He goes over how Reltio will only communicate certain information to Snowflake, as Reltio has ensured as minimal of access as possible. Keep in mind, if there is any data you do not want to share with Snowflake, like PII data, you will be able to choose which attributes to ignore before the data is sent to Snowflake. You can also export all data, or just updated data, by sending only an incremental batch.
We highly recommend watching his process in real time so you can see exactly how he performs the tasks.
He explains the views within the box Snowflake connector. When working through the Snowflake schema, you will be able to see two things. One of these is the source table. The other is an OV table, or operational value table. OV is intended for business users, thus, we convert the data into operational value and the most simplified form. The OV table will have the transformed simplified operational value structure. This simplified operational value structure will allow the user to create relational views and custom views easily.
The source table is where you can see the data, and is more for integration and analysis. This is a Reltio JSON structure with all cross falls and all information included. This will be your source landing table, with everything residing there. Use the source table to do a cross check analysis or a detailed analysis by the integration teams.
After the source table, the data is automatically converted into a more simplified format, which makes creating a relational view more simple. Furthermore, the JSON is very simple, and is still a JSON structure within Snowflake. If you would like to query it, it will mold like a relational column. Then, you can create a relational view. Or, create a custom view, which is an out-of-the-box relational view.
These are the two things that happen automatically for each entity and relations within the Snowflake connector.
Reltio could have made this even more complex, but we worked to make sure that anyone could use this product. Therefore, you will notice simplified views throughout. Business users will be able to run typical relational queries, and view a simple attribute or nested attribute. For example, if a business user would like to know who within their data lives in Chicago, they will be able to run this query, and see the results as a relational view.
Another valuable resource shared during our webinar is a breakdown of the Reltio Connected Data for Snowflake’s architecture. In the diagram shown, there are two different boxes. One represents the Reltio cloud, while the other is Snowflake. It shows the primary data storage clusters, which expand where your primary data resides.
From there, the data makes its way through one Apache Spark cluster, which runs in an AWS cloud, and enters an analytical data bucket. Another bucket, serving its purpose as a staging environment, is an S3 bucket. Once here, users trigger the Snowflake copy task. The whole process of data transformation begins, and the data is delivered into Snowflake using the Snowflake copy task. Remember, this process does not update you in real time, however, you will have data transformation complete in about thirty minutes. This is something Reltio may develop in the future.
At the beginning of this webinar, we focused on three main ideas. The answers to the first two questions, dealing with business solutions and how Reltio Connected Data for Snowflake works, have been discussed throughout the webinar and within two other articles on the subject. Here is the answer for the last question:
We have compiled everything you need to know about Reltio Connected Data for Snowflake within Reltio Documentation. To find the resources you need, simply follow Integration and Connectors from Home, and click Reltio Connected Data for Snowflake. Or, search “Integration and Connectors” in the search bar. For easiest access from this article, click here to find access immediately. You will find product terminology breakdowns here, as well as instructions for onboarding Reltio Connected Data for Snowflake, Snowflake schema, a guide to APIs, and videos of the product.
We look forward to our continued practice of making our products even better and more user friendly for our customers. If you have questions, or would like to leave feedback on what you would like to see down the road with Reltio Connected Data for Snowflake, join in the discussions in Reltio Community.
100 Marine Pkwy #275, Redwood City, CA 94065
+1 (855) 360-DATA+1 (855) 360-3282
© 2022 Reltio. All Rights Reserved
Site by eConverse MediaAlso of Interest: Master Data Management (MDM) Reltio Community Reltio Integration Hub Community, Data Management Community Matching, Merge, Survivorship Reltio Workflow Master Data Management (MDM)