I have put together a link list of all the ODI resources I know off on the web. If you know any other relevant resources contact me and I will add it to the list below. In my opinion the best place to get started with is the Data Warehouse Best Practices using Oracle Data Integrator Enterprise Edition guide. This explains the concepts very well and also has some detailed examples on Knowledge Modules, the Substitution API, setup, deployment etc. ODI OTN Discussion Forums I monitor the ODI forum on OTN at the end of each day to see if any relevant items have been discussed. Oracle By Example: Oracle Data Integrator The Oracle By Example (OBE) series should be one of the starting points for learning any new Oracle technology. The OBE for ODI series is a must. Documentation Download all relevant PDFs on Knowledge Modules, the Substituion API, Jython, ODI Tools etc. from the documentation page. ODI homepage on the Oracle website Blogs Rittman/Mead ODI Experts John Good...
Posts
I am going to be writing up a few posts and tutorials on the basics of the architecture (see previous post) and a few beginner topics to get the masses in a mode where they are not intimidated by this tool. The previous post described various aspects to ODI, and the architecture. We saw various GUIs that ODI allows us to use. This post (and possibly another one or two) will look at the DESIGNER GUI in more detail. One of the first things I will say is that the tool can feel a bit foreign if you come from an Informatica/OWB type background like myself. The emphasis is on building smaller and reusable pieces of code, if you will. Other tools that tend to be more ETL based (Informatica) and also more GUI and non-declarative based (OWB) are not necessarily the easiest tools to break things into small pieces. Yes, there are many that say breaking mappings into smaller pieces is a best practice, but the tool doesn't necessarily thrive on your ability to follow th...
The following series will be a high level look at the pieces, components, and basic workings of ODI, which should help any reader comprehend some of the finer pieces of this data integration and ELT tool. The following series will be a high level look at the pieces, components, and basic workings of ODI, which should help any reader comprehend some of the finer pieces of this data integration and ELT tool. The GUI graphical modules are listed above. The four ODI GUIs – Designer, Operator, Topology Manager and Security Manager, are based on Java. They can be installed on any platform that supports Java Virtual Machine 1.4, including Windows, Linux, HP-UX, Solaris, pSeries and so on. Designer is the GUI for defining metadata, and rules for transformation and data quality. It uses these to generate scenarios for production, and is where all project development takes place. It is the core module for developers and metadata administrators. Operator is used to manage a...
Creating Entity Relationship Diagram in Visio It is a common task for a developer to build an Entity Relationship (ER) Diagram for an existing database. If you are dealing with an MS SQL Server, this can be done easily within SQL Server Management Studio, but what if you are given a database in MS Access, PostgreSQL, or MySQL. There are tools (such as ModelRight) to help you with this, but if you have got MS Visio Professional Edition, you have another option. Since Visio 2003, a new feature, Reverse Engineer, has been made available in its Professional edition (and Premium edition in Visio 2010). This feature allows you to connect to an existing database, extract database schema, and create an ER Diagram automatically. You can also lay things out in the way that you want, and catch changes made to the database. The key here is to create a connection to your database. It does not have to be a Microsoft database. Most ...
What to do when your query is too slow? First of all, you have to know why it is slow. What is the real cause of your problem. If the reason why is not known, suggesting to rewrite the query, or hinting the query, suggesting parallellization et cetera is not very productive. Once in a while you may get lucky. But even then you have to realize that if your problem seems "solved", but you don't know why, nothing guarantees you that the problem won't come back tomorrow. So the first step should always be to investigate the root cause . The tools at your disposal are, among more: - dbms_profiler - explain plan - SQL*Trace / tkprof - statspack Use dbms_profiler if you want to know where time is being spent in PL/SQL code. Statspack is a must if you are a dba and want to know what is going on in your entire database. For a single query or a small process, explain plan and SQL*Trace and tkprof are your tools. explain plan in SQL*Plus you have to type...
SQL injection attack is one of the most popular attacks that are observed in most of the web applications. This article will be very useful to the newly joined ELTP's, as they are more prone to write queries which are vulnerable to SQL Injection attack.In this article, I will explain what SQL injection is all about and the ways to prevent it. To begin with, what is SQL Injection (attack)? As the name suggests, it's an attack which is done with SQL queries. This attack is possible when a web application does not filter the user inputs correctly and trusts whatever the user provides. So in short, SQL forces the application to run queries which were actually not desired i.e a good SQL gone bad :) Most of the web applications use a form to authenticate users: When a user clicks the Login button, a request is posted to the action page via HTTP_POST. The action Page has a business logic which authenticates the user by running a query that counts the num...
The key general categories of data warehousing tools are: Spreadsheets Reporting and querying software: tools that extract, sort, summarize, and present selected data OLAP: Online analytical processing Digital Dashboards Data mining Decision engineering Process mining Business performance management Local information systems Except for spreadsheets, these tools are sold as standalone tools, suites of tools, components of ERP systems, or as components of software targeted to a specific industry. The tools are sometimes packaged into data warehouse appliances. Open source free products Eclipse BIRT Project JasperSoft Pentaho Community Edition RapidMiner SpagoBI R Open source commercial products Palo (OLAP database) : OLAP Server, Worksheet Server and ETL Server Pentaho : Reporting, analysis, dashboard, data mining and workflow capabilities Proprietary free products InetSoft MicroStrategy MicroStrategy Reporting Suite Proprietary products ActiveR...