What is it? Snowpark is an API for querying and processing data in a data pipeline. It abstracts the data on Snowflake using DataFrames, which is a famous data structure used among many other API’s, such as Pandas and Spark. The main advantage of this API is that it runs under the Snowflake environment, meaning […]
Snowflake is one of the most popular Software-as-a-Service (SaaS) solutions to store and process the data of your whole organization. It’s a pioneer in data management, which is why Snowflake places a high value on security. Imagine you are pulling data from different databases and sources in your organization, and you are centralizing all this [...]
Security is crucial for data consolidation, especially in data warehouses where reporting tools are connected to show different dashboards. Snowflake provides two main features to help with these requirements: Row Access Policy: Allows a filter to be applied to the result of a query and return only those rows that a role is authorized to [...]
Moving your data warehouse from on-prem to the cloud? Our experts discuss data lake and data warehouse building in AWS. Prefer to listen? Watch the Stump The Experts webinar on our Youtube channel. Our data warehouse is on-prem at the moment, but we are starting to evaluate moving it to the cloud. We are already [...]
Yeah. Yep. Big hero moment. (Captain Marvel 59:58) Good news is hard to come by these days, so it's nice when we have something to celebrate. The world, despite the doom, does go on. So when we got the news that Stewart Bryson (CEO of Red Pill Analytics) had been given the title of Data [...]
I recently downloaded Oracle Analytics Desktop (OAD)12.2.5.4 to check in on what's new. The last time I used Oracle's desktop tool, it was called Data Visualization Desktop; I figured they must have made some updates over the last few years. I was not terribly impressed with the original application (at least early versions of it), [...]
In Part 1 of our post about Migrating Data to Snowflake, we exported our data from on-premise, and uploaded it to S3. We are just about ready to start importing the data into Snowflake. First here is a quick recap of what we have done so far. Part 1 Recap Okay, to recap at [...]
In this series, we are showcasing a fictitious midsize brokerage company moving their technical environment to the cloud. We have established previously, the company is experiencing contention issues, at both the user and hardware level. We will talk about the Oracle BI migration in a future blog; but first, we have to get the data [...]
The sun is shining, and the data-driven community is coming out of hibernation to gather across the country. Check out where Red Pill Analytics will be in the coming months, and let us know if you will be attending. We’d love to connect in person! Kafka Summit 2019: April 2, 2019 New York, NY The [...]
How to use the Snowflake Data Warehouse destination in StreamSets Data Collector to replicate an OLTP database StreamSets Data Collector offers incredible flexibility while creating data integration pipelines by allowing developers to either create a custom stage (an origin, processor, executor, or destination) completely from scratch, tailor a universal stage to a specific requirement, or use [...]
