We have a small project with four layers. When we added relationship tests between project layers, we started getting false test failures. The raw layer is a bit like dbt’s stage layer, we do renaming and some very simple changes here and have validation for duplicates and nulls. The validation layer we build dims and […]
He’s done it again! We’re proud to share that Deiby Gómez has been recognized as an Oracle ACE Director. The Oracle ACE Program defines an Oracle ACE Director as “top-tier community members who not only have been sharing their knowledge with the community for more than five years, but who also participate in an ongoing […]
What is it? Snowpark is an API for querying and processing data in a data pipeline. It abstracts the data on Snowflake using DataFrames, which is a famous data structure used among many other API’s, such as Pandas and Spark. The main advantage of this API is that it runs under the Snowflake environment, meaning […]
Snowflake is one of the most popular Software-as-a-Service (SaaS) solutions to store and process the data of your whole organization. It’s a pioneer in data management, which is why Snowflake places a high value on security. Imagine you are pulling data from different databases and sources in your organization, and you are centralizing all this [...]
If you’re looking to modernize your data, there’s no avoiding the lake analogies. So we figured we’d jump right into the Data Lake, Data Warehouse, and the brew of both: Data Lakehouse. Join us as we explain what they mean for the uninitiated. What is a data lake? Simplified, it’s the storage where data [...]
Security is crucial for data consolidation, especially in data warehouses where reporting tools are connected to show different dashboards. Snowflake provides two main features to help with these requirements: Row Access Policy: Allows a filter to be applied to the result of a query and return only those rows that a role is authorized to [...]
Anyone who has worked with dbt knows that one of the most powerful features is packages. Packages allow you to reuse code across multiple projects in an organization. Packages can be installed from other projects in your organization, or by using the dbt hub you can install packages from the open-source community and Fishtown Analytics. [...]
If there’s one thing we’re tired of this year, it’s canned marketing campaigns filled with false sentiment. We know what they really mean: “We’re in This Together” Please continue to buy our stuff. "Now, more than ever.. " What we’re selling is still important. And the worst offender: “In these unprecedented times..” I will get [...]
OAC has a nice button for a person to unsubscribe within an Agent itself. But this required a person to navigate to the catalog to find the agent and look inside the details of the agent. Seems like a lot of steps to me. But what if you want to enable this capability for an [...]
Are you considering a cloud-native data warehouse? Our experts debate the differences between Snowflake, Redshift, and BigQuery. Prefer to listen? Watch the Stump The Experts webinar on our Youtube channel. We are new to cloud data warehousing. We are considering Snowflake, Redshift, and BigQuery. What are some things to consider? Neal Achord Red Pill Consultant [...]