There is always a confusion for many people regarding the above mentioned topic.
When an organization is small with similar data sources (for example all the sources are in Oracle), then its always easy to write the code as the company will have the in house staff who understand the technology very well. If you write the code and if you are an expert in the code what you write its easy to build any complex program, the problem is not every one in the organization is as good as you in writing the code. So, its always a trouble to maintain the code and fix the code when necessary.
Any thing we do with GUI (Graphical User Interface) tools, the development becomes faster (RAD -- Rapid Application Development) and most of the people understand what is your approach to solve the problem very easily and they can maintain the visualization and fix the same very fast and easily.
As business deal with heterogenious data sources, coversion to homogenious target becomes very easy with tools compared to hand written codes. Tools are fine tuned and tested for huge amount of data and for scalability as well. The code cannot take the advantage of new versions of software, manual modifications has to be done to take the advantage.
The transformations are being added to the tools as the different types of standard devices come into the industry for example RFID standards, XML Standards etc.
Even though there is an initial cost for ETL tool, every penny is worth in the long run based on our experience. Now a days we have open source tools (Pentaho, Talend) which can be used to implement the ETL layer in your DW architecture.
When an organization is small with similar data sources (for example all the sources are in Oracle), then its always easy to write the code as the company will have the in house staff who understand the technology very well. If you write the code and if you are an expert in the code what you write its easy to build any complex program, the problem is not every one in the organization is as good as you in writing the code. So, its always a trouble to maintain the code and fix the code when necessary.
Any thing we do with GUI (Graphical User Interface) tools, the development becomes faster (RAD -- Rapid Application Development) and most of the people understand what is your approach to solve the problem very easily and they can maintain the visualization and fix the same very fast and easily.
As business deal with heterogenious data sources, coversion to homogenious target becomes very easy with tools compared to hand written codes. Tools are fine tuned and tested for huge amount of data and for scalability as well. The code cannot take the advantage of new versions of software, manual modifications has to be done to take the advantage.
The transformations are being added to the tools as the different types of standard devices come into the industry for example RFID standards, XML Standards etc.
Even though there is an initial cost for ETL tool, every penny is worth in the long run based on our experience. Now a days we have open source tools (Pentaho, Talend) which can be used to implement the ETL layer in your DW architecture.
No comments:
Post a Comment