September 14, 2017

|

by: pete.scott

|

Categories: Oracle 12c, SQL, Tips

When I start a new ETL project I often find it useful to have some idea how the source tables relate to each other. If I’m lucky there is documentation to guide me or even a diagram showing me how the tables link up (I do dream a lot). Of course, I could pull the […]

April 19, 2017

|

by: pete.scott

|

Categories: Cloud, linux, Security, SSH

That title sounds a little weird, tunnels go through the ground and clouds are those fluffy things that float in the sky. However when we are talking about Oracle Cloud and SSH tunneling things make a lot more sense. Although this blog is specific to the Oracle Cloud Database, tunneling is a generic technique and […]

January 23, 2017

|

by: pete.scott

|

Categories: GitHub

Last time I blogged about getting started with the new Git VCS functionality in Oracle Data Integrator (ODI) 12.2. Then, I promised to write a bit on integrating Git into the deployment process. Firstly, a disclaimer. I used to work for a IT services company that also ran one of the largest ITIL training organizations […]

December 15, 2016

|

by: pete.scott

|

Categories: GitHub, ODI

Last time I went through some of the basics about getting the latest patch-set of ODI to connect to a GitHub.com VCS repository. Today I will talk a little about versioning our ODI development in Git. Navigator The first point to make is that we can select the objects we wish to version-track in Git, […]

December 9, 2016

|

by: pete.scott

|

Categories: GitHub

Working as an IT Professional I need to adhere to standards; working in consulting these standards may vary between customer organizations. Some places are Agile shops, some are classic waterfall, others use whatever flavor of methodology that suits them best. Two things are a given though: We use source control to protect and version the […]

October 11, 2016

|

by: pete.scott

|

Categories: General, OTN, SQL

As you may have seen in the Twittersphere, today is a special date in the Oracle community, a day where we can express thanks to OTN for wealth of technical content that makes our life easier.For my tiny contribution to the day here is a little note on detecting change using SQL MINUS, maybe not […]

September 30, 2016

|

by: pete.scott

|

Categories: Big Data, ODI, Snowflake

One of the features of Oracle Data Integrator that sets it apart from other data integration tools is the use of Knowledge Modules to define how parts of the data integration process occur. The developer creates a data load mapping from sources, joins, filters and targets (and in ODI 12 even more components are available). […]

April 25, 2016

|

by: pete.scott

|

Categories: ODI, Tips

At work last week I lifted the covers on the Red Pill Analytics Slowly Changing Dimension ODI IKM for Oracle. If you haven’t heard about this knowledge module, it was specifically written to take a dimension source table and transform it to a slowly changing dimension target table. Unlike other similar IKMs, this module uses […]

April 14, 2016

|

by: pete.scott

|

Categories: ODI, Tips

In the depths of time before ODI 12c, ODI Studio had a fairly simple canvas to design our interfaces. We dropped on our datastores (tables) and then dragged columns between tables to create joins, and columns to the canvas to make filters. If we needed to use expressions we just typed them on the target […]

March 8, 2016

|

by: pete.scott

|

Categories: General, SQL, Tips

My whole data career has been about finding the truth within data, seeking correlations within and between data sources (and not always relational sources at that). You get to notice patterns in the world and even develop skills to spot outliers on a rapidly scrolling screen. In those early days I used tools like i2 […]