Skip to main content

Posts

Slowly Changing Dimension (SCD) with ODI

SCD Types 1) Overwrite old data with new 2) Adding a new row with surrogate key 3) Adding columns represents first, last and previous data Other: If data is big, you can take monthly snapshots to save difference. Data is smaller and you want to track multiple columns, then you can take daily snapshots. SCD type 2 is mostly prefered as keeps old versions. So let's roll on ODI for SCD type 2. Our example will be sh.channels table comes default on Oracle db; CREATE TABLE CHANNELS (   CHANNEL_ID        NUMBER                      NOT NULL,   CHANNEL_DESC      VARCHAR2(20 BYTE)           NOT NULL,   CHANNEL_CLASS     VARCHAR2(20 BYTE)           NOT NULL,   CHANNEL_CLASS_ID  NUMBER                      NOT NULL,   CHANNEL_TOTAL     ...

Synchronous and Asynchronous execution in ODI

In data warehouse designing, an important step is to deciding which step is before/after. Newly added packages and required DW data must be analyzed carefully. Synchronous addings can lengthen ETL duration. Interfaces, procedures without generated scenario cannot be executed in parallel. Only scenario executions can be parallel in ODI. Default scenario execution is synch in ODI. If you want to set a scenario to executed in parallel then you will write “-SYNC_MODE=2″ on command tab or select Synchronous / Asynchronous option Asynchronous in General tab. I have created a package as interfaces executes as; INT_JOBS parallel  INT_REGIONS synch  INT_REGIONS synch  INT_COUNTRIES synch  INT_LOCATIONS parallel  INT_EMPLOYEES parallel (Interfaces are independent.) Selecting beginning and ending times and durations from repository tables as ODI 11g operator is not calculating these values. It is obvious in ODI 10g operator. SELECT    sess_no...