ETL:
E: means Extract, extract data from a database table into a flat datafile (like a text file on Unix. You already knew SQL, you can use SELECT to do the Extract from any kind of database.
T: means Transform, do some DATA manipulation, like SUM, or other kind of calculations.
L: means Load (or Loading) , load the data from a flat data file (or from a previous Database Table ) into a Database (or Data WareHouse).
Usually pure ETL jobs associated with the company which has large Data Warehouse.
You can write one or many simple Perl programs by yourself to do the relatively simple ETL jobs. Or many companies purchasing third party ETL tool to do the complex ETL job.
For example, For the Retail industry like large Retail Stores, Oracle offers Retail Suite (former name is Retek).
I did designed and managed a 10 Tera Byte Data Warehouse used for Retek System, so called RDW, for a lager USA Retail Chain Store. The Retek ETL process contains about more than two hundred Unix Shell process, It takes from Midnight to about 10:00am to run all the ETL process to load Data from front end RMS (Retek Management System) Database into RDW data warehouse. Then the business reports are generated from the RDW. Then the buyers IN New York read the generated report, knowing what merchandise to buy.
Run other people’s ETL’s process or tool is a relatively simple job, you may feel boring than the Data Mining job.
Many companies with Data Warehouse need people with ETL knowledge. If running with Oracle database, they will need ETL people to know PL/SQL (the Oracle native Data programming tool, not hard to handle).
Wish this answered your question.
Thanks!美国老土
E: means Extract, extract data from a database table into a flat datafile (like a text file on Unix. You already knew SQL, you can use SELECT to do the Extract from any kind of database.
T: means Transform, do some DATA manipulation, like SUM, or other kind of calculations.
L: means Load (or Loading) , load the data from a flat data file (or from a previous Database Table ) into a Database (or Data WareHouse).
Usually pure ETL jobs associated with the company which has large Data Warehouse.
You can write one or many simple Perl programs by yourself to do the relatively simple ETL jobs. Or many companies purchasing third party ETL tool to do the complex ETL job.
For example, For the Retail industry like large Retail Stores, Oracle offers Retail Suite (former name is Retek).
I did designed and managed a 10 Tera Byte Data Warehouse used for Retek System, so called RDW, for a lager USA Retail Chain Store. The Retek ETL process contains about more than two hundred Unix Shell process, It takes from Midnight to about 10:00am to run all the ETL process to load Data from front end RMS (Retek Management System) Database into RDW data warehouse. Then the business reports are generated from the RDW. Then the buyers IN New York read the generated report, knowing what merchandise to buy.
Run other people’s ETL’s process or tool is a relatively simple job, you may feel boring than the Data Mining job.
Many companies with Data Warehouse need people with ETL knowledge. If running with Oracle database, they will need ETL people to know PL/SQL (the Oracle native Data programming tool, not hard to handle).
Wish this answered your question.
Thanks!美国老土
选择“Disable on www.wenxuecity.com”
选择“don't run on pages on this domain”
