Data Engineering

Explore our data engineering expertise. Learn how we design, build, and manage scalable data infrastructure for reliable and efficient data processing.

Teal cloud icon glowing on a microchip with circuit lines and a lock symbol, representing AWS Lambda Snowflake SSH authentication through secure key exchange.

How to Update your Lambdas to Authenticate with SSH Keys in Snowflake

By Deiby Gómez Snowflake is deprecating user/password authentication in favor of key pair authentication. This impacts AWS Lambda-based data pipelines that currently rely on legacy authentication. This article explains how to update your Lambda functions to use SSH key-based authentication when connecting to Snowflake. You’ll learn how to securely store your private key in AWS […]

How to Update your Lambdas to Authenticate with SSH Keys in Snowflake Read More »

AWS, AWS Lambda, Data Engineering, Security, Snowflake
Person walking through a labyrinth, symbolizing the complexity of solving the dbt row_count package bug

Behind the Error Message: Solving row_count package bug in dbt

By Tatum Brannan Photo by Photo by Ashley Batz on Unsplash Exploring dbt Test Features Struggling with the dbt row_count package bug? Follow our step-by-step guide to quickly resolve the issue and keep your data pipeline running smoothly. dbt provides a variety of intrinsic testing options. Among these, you’ll find fundamental tests like unique, not_null, accepted_values, and

Behind the Error Message: Solving row_count package bug in dbt Read More »

Data Engineering, dbt
The reflection of the sky in the image of a glass building

Master dbt Testing: How to Avoid False Negatives when Testing Between Project Layers

We have a small project with four layers:   1. Raw — incoming raw data2. Validation —Relationship and data validations. Transformations into facts and dims3. Reporting — joining facts and dims to meet presentation requirements4. Business Application — presentation layer. Views, with security where needed, of the reporting objects When we added relationship tests between project

Master dbt Testing: How to Avoid False Negatives when Testing Between Project Layers Read More »

Business Intelligence, Data Engineering, dbt
Scroll to Top