This blog, Deploying Kafka Streams and KSQL with Gradle – Part 3: KSQL User-Defined Functions and Kafka Streams was originally posted on the Confluent Blog on July 10, 2019. See the original source here. Building off part 1 where we discussed an event streaming architecture that we implemented for a customer using Apache Kafka, KSQL, and Kafka Streams, and part 2 where we discussed how [...]
This blog, Deploying Kafka Streams and KSQL with Gradle – Part 2: Managing KSQL Implementations, was originally posted on the Confluent Blog on May 29, 2019. See the original source here. In part 1, we discussed an event streaming architecture that we implemented for a customer using Apache Kafka®, KSQL from Confluent, and Kafka Streams. Now [...]
This blog, Deploying Kafka Streams and KSQL with Gradle – Part 1: Overview and Motivation, was originally posted on the Confluent Blog on May 15, 2019. See the original source here. Red Pill Analytics was recently engaged by a Fortune 500 e-commerce and wholesale company that is transforming the way they manage inventory. Traditionally, this [...]
It’s that time of the year again. Kscope19, one of the best Oracle User Group conferences of the year, is merely weeks away. If you’re only going to one conference this year, definitely take this one into consideration. Why Kscope? If you are heading to Kscope, you're probably already an Oracle aficionado. This is where [...]
By offering an impressive and ever-growing library of connectors, Fivetran has become a leading choice for extracting data from source applications and loading it in a cloud data warehouse. With reusability as a primary requirement, Fivetran has taken on the challenge of building out source system connectivity and established a core pattern of applying […]
Parameters in Looker increase interactivity for users and provide flexibility from the front end perspective without having to write custom code for each and every field the user asks for. A parameter creates a filter-only field that can be added as a filter when exploring, but cannot be added to the result set. The parameter [...]
In Part 1 of our post about Migrating Data to Snowflake, we exported our data from on-premise, and uploaded it to S3. We are just about ready to start importing the data into Snowflake. First here is a quick recap of what we have done so far. Part 1 Recap Okay, to recap at [...]
In this series, we are showcasing a fictitious midsize brokerage company moving their technical environment to the cloud. We have established previously, the company is experiencing contention issues, at both the user and hardware level. We will talk about the Oracle BI migration in a future blog; but first, we have to get the data [...]
The sun is shining, and the data-driven community is coming out of hibernation to gather across the country. Check out where Red Pill Analytics will be in the coming months, and let us know if you will be attending. We’d love to connect in person! Kafka Summit 2019: April 2, 2019 New York, NY The [...]
How to use the Snowflake Data Warehouse destination in StreamSets Data Collector to replicate an OLTP database StreamSets Data Collector offers incredible flexibility while creating data integration pipelines by allowing developers to either create a custom stage (an origin, processor, executor, or destination) completely from scratch, tailor a universal stage to a specific requirement, or use [...]
