We have a small project with four layers. When we added relationship tests between project layers, we started getting false test failures. The raw layer is a bit like dbt’s stage layer, we do renaming and some very simple changes here and have validation for duplicates and nulls. The validation layer we build dims and […]
Anyone who has worked with dbt knows that one of the most powerful features is packages. Packages allow you to reuse code across multiple projects in an organization. Packages can be installed from other projects in your organization, or by using the dbt hub you can install packages from the open-source community and Fishtown Analytics. [...]
Google BigQuery has neat functionality that allows users to schedule queries in standard SQL, DDL or DML statements. Additionally, you can set them to run on a recurring basis. This can be great for light transformations; however, if more comprehensive transformation and automated regression testing is needed dbt (data build tool) is an affordable solution. [...]
Looker gives users the ability to swap between dimensions or measures in a visualization by the use of Liquid Parameters. To learn more, explore Looker’s documentation on Liquid Parameters here. Currently, when a user selects measure from the parameter filter, it does not pass through the value format given for that measurement. In the following [...]
The easy way Before I learned how to load only the columns I needed from DynamoDB into Redshift, I created an entire glue job to load a single table. I’d like to prevent you from making the same mistake. But to understand how much easier the easy way is, you will first need to understand how [...]
In this series, we are showcasing a fictitious midsize brokerage company moving their technical environment to the cloud. We have established previously, the company is experiencing contention issues, at both the user and hardware level. We will talk about the Oracle BI migration in a future blog; but first, we have to get the data [...]
This post is part 4 of 4 about using the Baseline Validation Tool (BVT) with Oracle Business Intelligence (OBIEE). The previous posts are: Post 1: An intro to BVT Post 2: Setting up BVT Post 3: Running the Tests Interpreting the BVT Results As described in my third post in this series, here’s how to […]
As technology moves further into a service-oriented (read: Cloud) world, people and enterprises alike need to ensure that securing their assets is taken seriously. Security has always been one of the first of topics covered before purchasing a cloud service which is why good cloud vendors typically spend more time securing their products than any […]
This post is part 3 of 4 about using the Baseline Validation Tool (BVT) with Oracle Business Intelligence (OBIEE). Post 1 with an intro to BVT, can be found here. Post 2 about setting up BVT to run, can be found here. Running the Test Against Both Environments We need to execute BVT twice with the same […]
This post is part 2 of 4 about using the Baseline Validation Tool (BVT) with Oracle Business Intelligence (OBIEE). Post 1 with an intro to BVT, can be found here. Obtain the BVT tool Download the latest version of BVT from Oracle. http://www.oracle.com/technetwork/middleware/bi/downloads/bi-bvt-download-3587672.html Unzip the download into a directory on your computer. To save yourself typing later on, […]