DBT is one of the most popular solutions to write and execute dynamic SQL Statements. It’s quick and easy to convert complex SQL statements into a few lines of code in DBT, we have the flexibility to use different configurations to customize our models, we can use Jinja and Macros, to schedule jobs in DBT […]
Analysts, Data Engineers and all data crew are always eager to offer the best set of analytical tools, qualified data, a good performance and agility when delivering data products to the user areas. And when it comes to KPI’s, the interest is a bit higher, because if you’re not tracking your indicators correctly, you may […]
What is it? Snowpark is an API for querying and processing data in a data pipeline. It abstracts the data on Snowflake using DataFrames, which is a famous data structure used among many other API’s, such as Pandas and Spark. The main advantage of this API is that it runs under the Snowflake environment, meaning […]
Snowflake is one of the most popular Software-as-a-Service (SaaS) solutions to store and process the data of your whole organization. It’s a pioneer in data management, which is why Snowflake places a high value on security. Imagine you are pulling data from different databases and sources in your organization, and you are centralizing all this [...]
Security is crucial for data consolidation, especially in data warehouses where reporting tools are connected to show different dashboards. Snowflake provides two main features to help with these requirements: Row Access Policy: Allows a filter to be applied to the result of a query and return only those rows that a role is authorized to [...]
Moving your data warehouse from on-prem to the cloud? Our experts discuss data lake and data warehouse building in AWS. Prefer to listen? Watch the Stump The Experts webinar on our Youtube channel. Our data warehouse is on-prem at the moment, but we are starting to evaluate moving it to the cloud. We are already [...]
Yeah. Yep. Big hero moment. (Captain Marvel 59:58) Good news is hard to come by these days, so it's nice when we have something to celebrate. The world, despite the doom, does go on. So when we got the news that Stewart Bryson (CEO of Red Pill Analytics) had been given the title of Data [...]
I recently downloaded Oracle Analytics Desktop (OAD)12.2.5.4 to check in on what's new. The last time I used Oracle's desktop tool, it was called Data Visualization Desktop; I figured they must have made some updates over the last few years. I was not terribly impressed with the original application (at least early versions of it), [...]
In Part 1 of our post about Migrating Data to Snowflake, we exported our data from on-premise, and uploaded it to S3. We are just about ready to start importing the data into Snowflake. First here is a quick recap of what we have done so far. Part 1 Recap Okay, to recap at [...]
In this series, we are showcasing a fictitious midsize brokerage company moving their technical environment to the cloud. We have established previously, the company is experiencing contention issues, at both the user and hardware level. We will talk about the Oracle BI migration in a future blog; but first, we have to get the data [...]
